helmets aren't made to be worn without the padding, it's part of the protective feature to absorb impact. I suggest wearing it with the padding, and just put a bandana under lezbien style on your head and then your goggles on top of that. Works great for me