i break all the "rules" for lens cleaning all the time.
rub the inside when it's wet or fogged, use a cotton t-shirt to wipe em, use my fingers, etc.
i've never had a problem with oakleys, smiths, or giros.  that's just me though, i've heard of lots of people who haven't had my luck.