This is an important point. If you don't have an SYE this discussion is a whole different animal than if you do have an SYE.
As others have said, its fine to remove the rear shaft entirely, maybe remove whatever gears are still going to grind in the rear diff, put the Jeep in 2 high and then drive on the front. It basically turns your Jeep into front wheel drive, which means it could handle a little differently. Take a good look at your front shaft first though, give it a firm shake and make sure there aren't any loose parts, maybe grease things if there are grease fittings. The front shaft in a TJ spins all the time just not under load, which means it is wearing out whether out are in 2wd or 4wd. The stock front shafts in these Jeeps are kind of cheap as they are meant to be a sort of back up shaft, that you use only when you switch over into 4WD. Pulling the rear shaft means the front shaft is now your main shaft and is 100% responsible to get you down the road. If it it is in poor condition putting the full burden of moving your Jeep down the highway on the front shaft could be the thing that pushes it over the edge. Not trying to scare you, just want to make sure that the front shaft is up to the task. If it's a newer aftermarket shaft it's probably fine though.