Howard Hill shot hundreds of shots every day. He may not be the best model for most of us, who can't do the same thing.
I know what you mean, though. I think there is a tempo that best utilizes our muscles. I've tried shooting with a very slow draw, and it doesn't work very well for me either. By the time I come to full draw, I'm shaking. If I draw more rapidly, particularly if I focus of getting my back muscles engaged early on in the draw, I find that I can come to anchor with a lot less effort. I also slow down my draw when I'm just about anchored, in order to allow things to stabilize, and then I slowly pull through my anchor as I release.