Go to a shop and sit in a bunch of boats, fit is pretty important in a boat, especially if your taller. All brands have their strengths and weaknesses. Jackson boats are currently some of the better intro boats that can carry you well into higher intermediate (Fun series for more river running and Star series for more play). Also depends if you are looking to buy new or used, most areas have paddling clubs who not only can give you advice, but also have people with boats for sale (kayakers tend to have high gear turn over). As for the other gear, get yourself a good, well fitting PFD and helmet. Skirt you don't need anything special and generally are all the same as far as beginning is concerned, price may be a big factor. Don't totally skimp on the paddle, a heavy old beast will definitely affect your learning curve, and I would never trade my bent shaft for a straight. Find a local group or training school and talk to them, demo some boats and see how it all goes.
and yeh I warnedd you I was a mad newb