I rarely wear either of them. I just cant stand goggles, let alone sunglasses (i've tried so many different ones but the fov is still too damn narrow and anything but clear lenses are annoying  + every goggle that seems okay is way too expensive) so i only wear goggles when it snows so much i cant see anything. Otherwise, i've gotten pretty used to the wind, cold, sun and so on. I haven't seen any effect on my eyesight yet but im sure it can't be good.