I would go with Large, it is still going to be really baggy and look good, XL is going to be below your knees. You could go with the Fatigue XL, it is classic fit, a little shorter so you can size up.
My advice is to look at the sizing charts and get a measuring tape and start it from your chin.
You can also measure your old jackets to see how they will compare.