I want to remove my factory mirrors from my 1998 tj since the ball socket has warn out and they won't stay set and replace them using the hinge loop where the factory mirror is installed. Do i need to remove the hinge to take the mirror out of the loop on the hinge?