As with most things it's not simple and depends on several factors: size of the party, how well acquainted you are to the rest of the party, carpeting, dirt level of shoes, if the organizer is a right bell-end or not and my mood.
I usually just keep them on.