I was more looking for one machine to do all my drilling/ milling needs and was looking at mini mills like the Grizzly G0704 or Precision Mathews PM25mv but I don't think they would take care of my larger drilling needs in the shop. That and as much as I'd like one a mill is out of my price range right now.
Only thing you might consider is a drill press normally is capable of much higher spindle speed making drilling small holes cleaner. As far as low speed stuff there isn't too much difference. For example the maximum speed on the two machines you listed is about 2k or 5/8" diameter hole for wood so anything smaller than that you might get a rough finish. I only mention wood because you were talking about the forstner bit. I'm pretty regularly running 6400rpm to drill 1/4 holes. Like I said just something to consider if you enjoy woodworking too.