Is there a way to adjust outside mirrors so they don’t keep moving

They shouldn’t be moving at all once adjusted. It sounds to me like you might be in need of some new mirrors.
 
There are two Philips head screws under the housing that may seem tight. But if you'll tighten them more your mirror should stay put better. It worked on my 97 TJ.
 
I had the same issue, tightened the screw, fought with it forever and finally changed to mirrors off a newer model tj. Greatest $30 investment ever
 
Thanks for posting this. Same problem here. Seems like closing the doors makes the mirrors move. Constantly adjusting them. Will look for that screw today.
 
Again my 97 had two screws and they tighten the bracket that surrounds the ball the mirror sits on. Getting the screws tighter was not easy but once done it did the trick. Once tightened it never moved out of adjustment again. It could still be adjusted by hand.