IF you're gonna be a little pussy about these things you can start being a pussy 24/7 since there will always be places like that. I don't get why all the town should be ethnic diverse.
I understand that this won't help young children consider black/asian/whatever people as their equal or whatever but I think that has more to do with education than anything else.
I never saw a person other than a white dutch person until I was 12 years old. after that I've pretty much always had to deal with foreign people. For me personally no big deal..