Is it possible to delete application level settings if you have not logged in to application?

Answer:

If you are using DeleteSetting function to accomplish the requirement then it is not possible. As DeleteSetting function requires to access the HKEY_LOCAL_USER registry key, which is not active until a user logs on interactively.