I found some humor in that I can get a badge for down voting someone.
I try to look at the positive things in life.
It's a waste of energy looking for the negative.
I'm sure someone will down vote this so they can get that badge. :-)
Agree 100% with @muru. The only thing I'ld add is that downvoting is arguably even MORE important than upvoting in the answer sorting process. There's also a badge for retracting a negatively received post/answer.
I have, in the past for example, gone through and started deleting all my 0 or negative answers or questions as site cleanup assuming there's another more thorough answer present.