Epraider: I guess I started to like the attention men gave me and I felt like I belonged/normal with my peers. Speaking personally, I think part of the reason you see that difference is that some people are intimidated by hijabs.
There have been several women I’ve found attractive but never felt comfortable approaching or talking to because I felt I would have also needed to be Muslim to approach, or, non-romantically, some I was hesitant to approach to befriend or work with because of the same thought of an expectation.
I suppose it can be a subconscious symbol of cultural division that affects how people think or act.