Here's the problem with the patriot act.
The laws in America do not reflect the will of the people. People, even good people, constantly break the law in America, from smoking weed to speeding to illegal fireworks. Every year laws get harsher and harsher. Since politicians continue to run the same "tough on crime" shit, and no one is going to speak up and say that giving life sentences to armed robbers and 15 years for possession of crack is a little ridiculous, its only going to get worse.
The patriot act would be alright if the government was a purely benevolent, uncorrupted entity just looking out for the good of the people. But a few individuals could easily abuse it. And since most people have some sort of illegal or embarassing secret to hide, unscrupulous government agents, if they had something against you, could do something like check the records on your computer to find some asian schoolgirls website you've been looking at, and threaten to make it public.