Uh... no?
Wearing a helmet protects your head from sharp impacts. While it wont save the rest of your body, I'd rater take a baseball bat swing to any of my arms, legs or torso rather than to the head. Your chest and muscles can absorb impacts pretty well, but your brain just kinda sloshes and slaps around inside your head if it gets hit. Not good.
"just because you have a helmet on doesn't mean you're really any safer"
I could really never hope to find a single doctor or EMT that would agree with this statement. Wearing a helmet will increase your chances of surviving and injury you take to the head. It rarely will actually be better for you to not have one on (instances of whiplash are a rare exception, and the benefits far outweigh the risks when it comes to wearing one). Obviously, there are some injuries that you can incur where no helmet will save your life (like falling out of a plane without a parachute), but a helmet will pretty much always increase your threshold for survival. Head injuries are the leading cause of death when it comes to action sports, so please, wear a fucking helmet.