Part deactivated users in the background

One room at a time so we don't take out the whole server with leave
events, and restart at server restart.