im sure uve heard many stories like mine but here is what i have to say...
i was in a similar situation last winter. i play hockey and as a freshman i made the varsity team and started as goalie.  i also enjoyed skiing a lot and every chance i had i would go.  As my hockey season came to an end, i looked back at the winter season and really was disapointed i spent more time thinking about skiing and doing backyard jibs with friends.  dont get me wrong i love skiing and wont give it up untl my back tells me too, but i believe if basketball is important to you i think u should stick with it.  I always tell myself that i can ski before and after hockey season but during hockey season, hockey is more important to me and i dont feel like going hardcore in the park then brake a leg and be out for the season.  Do what u want, dont let someone influence you.  Also its fun to hang with the upper classmen and chill with them. so lastly if u really want another opinion i would say stick with it, but if its not important to you dont feel obligated to play.