I have listened to that over and over till wifee said no more haha. It sure sounds like an exhaust leak to me. but it is really hard to tell by that short video. So have to ask some questions and really it can be so many things
But...
Do you only hear it or can you feel it in your shifter knob?
How about your transfer case knob? Can you feel it there?
Can you feel it anywhere, like your seat your gas pedal.
Does it change pitch when turning under a load?
In the video it sounds like the same noise no matter how fast you are going? Is that true, or does it speed up or slow down or change pitch at different speed and gears?
What does your oil pressure gauge say under a load? Do you have oil in your engine, trans and transfer case? What about differential? Are they topped off? What do your u-joints look like?
I see you have a pretty good pattern you figured out it only happens when you give it gas but goes away on coast that is good, but we need more.
I noticed your boot is not on right? If your inner boot is missing or ripped anything from under the Jeep will sound like it is coming from the transmission.
So tomorrow morning do me a favor. before you start the jeep open the hood and roll down your windows and then start the jeep and give it a couple of low revs in neutral, and let me know if you hear that noise?
Meanwhile I will try and think of something that can tick during accell and quiet during coast. Right now without being able to touch it I am thinking something with the motor, but just a guess based on the short video. (That video was a good idea though)