My 2005 TJ just hit 101,000 miles, so I know it still has a lot of life in it. And while not ideal, it IS doable loading my 3 month old son in and out.
My wife tried it last night, it takes her longer, but she did it.
And we've only been taking the TJ out of we want to go out for lunch/dinner. Otherwise, we take her 2012 grand Cherokee.
We still owe more than I like on it, but I'm now making double payments on it to pay it off. It just hit 64,000 miles as well.
It's probably smarter to have the wife drive the better family vehicle. She has a longer drive to work anyway.
Not having a 2nd payment would allow me to buy more fun things too.