People receive it as being rude but the reality is, you're setting very clear boundaries. People in general aren't used to that so when they get hit with it, you're a bitch. Yes, I'm speaking from experience.
People can call me a bitch all day long for sticking up for myself. So long as they do it as they're heading for the nearest exit.