The trick is to rotate off of your hand when its on the ground.  I pop off my tails and put my hand down towards the tail of whatever ski I'm doing the handrag on.  When you hand hits, and  your feet are kind of at the peak of extention, pull your hand in towards your hip kinda, pivoting your body off of your hand.  You also need to throw it like a cork 180 with a little help from your hand to bring yourself back down.
The robe + wizard hat couldnt hurt though.  try both ways, it works different for everyone.