I agree that socioeconomic and racial segregation often LOOK the same, but I think there IS a difference. In one, the message is "you aren't EVER going to belong here, no matter what you may achieve"; in the other, the message is "you can fit in once you HAVE achieved".
But I don't think this has anything to do with Frasbee's swastika.