I have owned both...
My CJ was 4 spd manual, with a super heavy clutch. Learned to drive it with 3 feet

, and loved it.
My 55 was an auto, with manual valve body, I really miss it.
My F-250 is a man 5 spd, towing machine, love it.
My Dodge CTD is auto/ ATS built, a blast to drive.
My 69 is auto, and someday I will get to drive it.
Ect...
By far, the most fun, pleasurable trans was the auto with the manual valve body. It cruised thru PHX rush hour traffic with little effort from me. When it was time to play, it was awesome. I could easily bark the tires through every gear, then down shift it through the corners. Tight turning mountain highways were a hoot!
I contemplated the man VB in my 69, but decided to let it cruise more than eat. My next truck build will be low lean and mean, and I'll save the valve body for it.
So I guess it's what you want to do with it