Well, what are his rights?

He has the right to tell you how your behavior affects him, to leave the room or the home for a while to cool down, or even to leave the relationship permanently if you displease him so much. But one sign of an abuser is that they hang on with one hand while slapping you with the other. A healthier man would just leave such a "defective" woman as he claims that you are!