I feel the same thing so it's probably an aro thing. I can understand that people's emotions are not always guiding them to do what makes them happy. I too can feel the urge to do things that makes me feel bad. But to not even be aware of it. It's like if someone was eating nothing but junk food and getting health problems and responding with "but I wan't to eat this food". What you want has nothing to do with it. It's making you feel bad, so don't do it.