What about the "conversely, if a girl is with a guy more attractive than she is, she is rich..." Sometimes I contemplate being a man-whore. Alas, I am not nearly suave enough and probably wouldn't like it if it happened.
I think BTR is onto something with being able to tell a bit about a person by their looks, dress, and all that. As far as the Abercrombie and Fitch thing goes, they probably think it is some sort of qualifier, just like some people believe being unique is a qualifier. I'm not sure if that makes sense, but you know, like a free cool-pass. Be unique, fit in, but be yourself - I like women who like themselves.
To answer the OP: I do like to admire a pretty woman, and probably do more gazing than a woman might. I think guys care more, I do... I kinda wish I didn't.