As in most people are quicker to vilify ugly people?
I believe this to be the case. Although we hear a lot of people always bitching (out of jealousy) about good looking people, when it comes down to it, people will flock to people whom they think have power/influence over others. Good looks are of course a form of power as is physical strength, athleticism, money or a fancy title.
But, as mean as this may sound, I think it may also have to do with aesthetics. People are repulsed by physical ugliness, like it or not, so they already receive an ugly person with a somewhat negative attitude. So if the ugly person says or does something they don't like, even if it's minor, this effect will be magnified. Kind of like how we hate those ugly looking monsters in horror movies. If the person is good looking, however, we tend to be more forgiving. Since even if they do something wrong their being aesthetically pleasing 'soothes' the feelings of hostility toward them.
I could get on my high-horse and say that I treat everyone equal, but I recognise I sometimes react this way and try to minimise it as best I can. Of course I never consciously treat better looking people better - okay, I admit it, if I think I have any chance with an attractive female I might be inclined to be nicer than usual - but it's something I notice.
For instance, if a fat, ugly woman says something mean to you versus someone who is slightly attractive, you're often likely to call the first woman a 'fat ugly *****', instead of just 'a *****.'
You'll associate the negative qualities of her appearance with the negative way she treated you, doubly villifying her.