Where are you supposed to put your eyes when you're not using them?

Growing up everyone around me treated me like a weird freak for staring off at like a wall or out the window or something else when I was lost in thought or bored, so what are we supposed to do when we're not actively look at something?