bro, I know it's probably not what you want to hear.. but seriously, let it heal.
take it from me. A few years back I thrashed my body.. all kinds of injuries. I rode on that shit and never gave a damn... and because I never gave it enough time to recover... it's still screwed up to this day.
not worth it.
even if your wrist is in a cast... if you take a hard fall on it.. or jolt it rough.. you can screw it up.