I'm a few shorter than you and I have a large, I don't wear my clothes like a clown and find that this size is just about average for a loose fitting crewneck or hoody. If you are going for the baggy look you will not be happy with a large.
...or the abstract mall shipping for that matter.