It's kind of like the old joke, "Doctor, it hurts when I do this". "Well, don't do that"...
Not yet having seen a video of you shooting, I can give a general suggestion to shoot from up close while concentrating totally on follow through. If your hand drops, simply pull it back up so you are on the target. After enough reps, this will become automatic.
At least for me, the smoother my release and release hand follow through (my hand pulls straight back and my thumb ends up on top of my shoulder), the less bow hand movement I have...