J head Bridgeport is the way to go. Or a copy like a Sharp.
J head because the variable speed setup and R8 collets. Or the Sharp because its an exact Bridgeport copy and if you need accessories or parts they are available.
In my home shop, I had a really good drill press till I got my mill...