I definitely had a phase like that. I also was quite disgusted with myself and tried to rein it in as much as possible. I wouldn't intentionally walk somewhere to see more girls. I also started to fight the urge to glance, because it just felt wrong to me. That went on for a while until I got tired of fighting my own body. I briefly stopped, but quickly noticed that the more I indulged, the stronger these urges got. So, I started to rein them in again to a level that felt good for me.

I think it's okay to glance at a pretty women, but that's it. No staring, no trying to get more glances. It takes some willpower, but the more I practiced and the older I got, the easier it became. Also it does feel a little rewarding to notice the urge to peak at the girl in the short skirt, but to keep your eyes straight until she is gone. Makes me feel like a little superior to the other men I see leering.

One simple trick is to look around and check out who is glancing/staring instead. A lot of people do that, men and women, though mostly men (at least at women). It's probably normal, but can be interactive for some. I think it's important to accept that part of yourself, but also to not indulge it too much. If this seems impossible, I think consulting a therapist might be the way to go.