Stack Exchange network consists of 176 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.
I accidentally downvoted a question (misclick, drank lots of coffee heh...) and then upvoted the same answer. I noticed I was award the critic badge for giving my first downvote.
Why is it wrong? You indeed cast a downvote.
Whether you revoke it later or not isn't relevant, it was indeed cast for at least a few minutes (that's how long the badge process takes to run).