A user was removed, and I lost 590 points! That's kind of excessive, no?

Please advise.

A user was removed, and I lost 590 rep points!

The reason that this question got asked again, is I still don't understand why us (other) users get penalized because some user got removed. Their votes, up or down, counted when they were cast, and when the user was still active on this system. I don't need a big dialog here, but mostly to let SE know that I don't think this policy is fair to the rest of us.