Some of my answers got down voted just because I down voted an answer of some other user or an user suspects me to be probable down voter as I left a comment on his/her down voted post.

Usually my motive behind down voting an answers is to point out technically incorrect instructions in it - purely constructive. But in reply my answer had been down voted several times.

I know there are preventive measures against serial down voting. But what about a few abusive down voting. Should I accept them? A down vote for a good answer is very disappointing and frustrating rather than only few reputation loss.

I really need to think before down voting or leaving a comment in a post for constructive criticism in future.

A down voter is usually tracked by his reputation change. In profile the reputation change due to down voting is not shown. It will be more secure if reputation change due to down voting is not reflect immediately. It can be adjusted at the end of day or at some convenient time all together.