If you consider yourself a rational person, and people are telling you you're hurting them, someone else, or the community, then please. Interrogate your motivations.
It is so amazingly easy to draw a chain of implications that ends with something like "they deserve it" or "they're weird" or "they hurt me first." But you not only need to ask why, but you need to ask why in the many different ways. Don't just ask "why do they deserve it?" that's a loaded question. Ask "why should I punish them if they do?"
If you consider yourself a rational person, in particular a rationalist, I highly recommend you learn formal logic.
If you've never learned it formally, you need to take a hard look at how you think logic works, and how it actually does. Knowing lists of logical fallacies is not enough. You must be able to distinguish between valid and sound arguments. You must understand that a fallacy in an argument does not prove the conclusion false. You must understand that debates are not how truth is determined.
@SuricrasiaOnline ... oh, and thinking through a lot of related topics (many of them social and cultural issues), what's struck me is that at the heart of many of these questions is somewhat less a matter of *logic* but of *values*.
What ultimately are the goals of life, society, and the various implements and institutions of it.
Generalistic and moderated instance.