I mean, as always it depends on which Superman we're talking about. I've seen some depictions that treat the super-hearing more like a curse. Could you maintain your apathy if you could hear every pained scream and every cry for help in your city?

Not to mention, some depictions have him on the level of a god where you certainly could do whatever the hell you wanted, whereas others have him a lot weaker and closer to something that the world could defeat if he really became a problem. I don't think I'd want to take on the world if I knew a nuclear arsenal could still take me out.