Don’t give yourself permission to ogle at women but like @tmeidan93 says it is not helpful to try fleeing from women or fearing them, as that will only give undue power to your compulsion. It’s ok, you can withstand a few interactions with women as long as you do so from a position of genuineness and calm self confidence.
Regarding my personal experience, this is less of a problem for me than most guys because I trained myself not to stare sexually at women’s bodies from a young age - yes I was pretty hard on myself and have actually needed to teach myself to loosen up a little in later years. Having said that, I have experienced that allowing myself to look at women sexually or for too long gradually builds up sexual thoughts in overall over a period of days, even if it appears to be harmless fun initially. So if I am doing NoFap (and I am currently on 115 days of hard mode), then I gently remind myself that girl-watching doesn’t align with my current goals. Or more precisely, I remind myself that I should not look at a woman sexually unless I am prepared to walk up to her and open a conversation with her and be upfront about my interest in her. It usually works.