The bounty doesn't get refunded under any circumstance. As per the [help center][1].  Take a look at the first bullet in the list.

So if the bounty is not awarded to any one, it gets lost.

  [1]: http://askubuntu.com/help/bounty