sounds like you either
a) trashed the anti fog coating on the inside of the lense. Have you wiped that at all? especially while its wet? cuz thats a no no
or
b) you have a faulty lense, if its fogging between the two lenses
also try and keep your goggles on your face, when you put em up on your forehead that makes em fog