I can't count the times this has happened to me growing up. I thought this was normal. I guess I would just do what I always do. Leave, walk away, whatever. As long as no one touches me there's no problem. On the other hand if I didn't have a choice then he'd have to back up his sh*t.