Ok I'm going to take back my advice. There's rude, and then there's dangerous. I don't think F--- you is necessary, maybe more like "Hey dude, gotta go now. Gotta go now. Gotta go now." You can always tell the family, rightly so, that his attitude about race is causing you personal issues.