I was wrong.
"The middle pocket is sewn onto one side, the other
side is held in place with 2 large magnets. No, the pocket never comes
loose when you don't want it to. The force of skiing actually pushes
the pocket against the jacket, not away."
I bet the middle pocket could be removed fairly easily, but I wouldn't mess around with the other two.