You do get to keep the +2 reputation from closed questions.

However, you will lose the +2 reputation if the question is actually deleted.