That's awfully low miles for a engine tear down if it doesn't need it. If it does, this is probably a drop in bucket of expenses. Be aware of the frequency of cam lobes getting wiped out on break-in these days.
You might look into Harland Sharp 1.7 non-adjustable roller rockers. These provide approximately .029" additional lift on the stock TJ 4.0L cam and pushrods, fit under the valve cover and should net somewhere in the 9-12hp range while also improving breathing above 3500 rpm. It's coming up soon-ish on Jezza's bolt-on dyno thread. It's only $100 or so cheaper than a cam and flat tappet lifters assuming you don't need pushrods as well. This will work fine on a stock tune.
The Comp Cams 163-201-5 is a newer option from Comp appropriate to the thrust plate TJ 4.0L with .450/.450 lift that would play nice. It's nitrided which helps with break-in, but I think the problem seems to stem from bad lifter quality more than the cams. I would expect this would work OK with a stock tune on an 04, though it might not be optimal without some timing or fuel adjustment. It is a no springs required option (NSR)
https://www.summitracing.com/parts/cca-163-201-5
https://www.angelfire.com/my/fan/Jeep4.0Camshafts.htm