What's wrong with my mill/drill and improving it

I built this machine primarily as a milling machine last year. Its not quite stiff enough to be a good milling machine, but I love using it as a drill press with XY table. So making improvements to the mechanism for setting the drill height, as well as making a better rack and pinion plunge mechanism using a lantern gear