Yes, you got it right.
Here are my OEM ones, you can see which end has been exposed to the elements, and the three little divots which help clamp it in place.
View attachment 402794
Are these same for all four corners or they have separate part numbers for front and rear? My 2004 TJ was built in 11/2003 and jounce bumpers are black (below) so can I replace them with the one in your picture!