freshman year is full of boring classes and lots of partying. If you are not partying I could see why it would suck.
Second year you will get a taste for what university, and your program is about. You will get to take introductory classes in whatever field you chose, and therefor start to meet more professors and students in your department.
Third and fourth year is where you take the basics and use them to get in depth about a subject. In some programs (like physics), you will basically have to retake the "real" version of your intro courses in third year.
Either way, what that means is second year is where you should really decide if you like your program, or just university in general. If you are not enjoying first year (academic) stuff, don't worry, no one does. However if in second year you are not getting excited about the material you are learning, then you probably will not want to spend the next two years learning about essentially the same thing. Upper level courses will kick your ass if you don't enjoy the material.