I've been to Eastern Africa, to climb Mount Kilimanjaro. Never been to Uganda, but:
I really enjoyed it there, generally. It feels very, different, to say the least. I went to Tanzania and our hotel was like a little Oasis.. Ten seconds out the gates and it was poverty, dirt and crumbling buildings... That being said it was an amazing experience seeing what there was to see, and my favourite part of being in the city was taking a cab ride through the town... People driving there are crazy... If you're planning on driving, good luck. There was one time, on a two lane highway, three transport trucks were all trying to pass each other, along with an oncoming jeep, and four motorcycles dodging between all of them.
Anyway, I'm not sure if Uganda does Safaris and all that... But I'd say I'd go to a country that has good safaris just for that. The safari was amazing, hands down the best part of the trip.
I'd recommend Africa as a place to go, but it's not for everybody. If you're adventurous, go for it, you won't regret it. Unfortunately the airfare from my place is fucking ridiculous.