I'd look at two things.
1. I shoot 3-fingers under. When you release your draw hand should immediately slide along your face under your ear. Think "thumb to the shoulder" and then relax the hand so the string leaves. Your hand should immediately follow-through to the shoulder.
2. If you are already doing this and still having the problem. Let's look at your grip. Your grip should be such that it pushes (actually leans) against the center of the grip.
The wrist should form and "L". If you have a straight or high wrist with the webbing of the thumb/index finger against the grip you could be torqueing the bow forward and kicking your arrow up. If your grip isn't leaning against the throat of the grip you could be heeling the grip with your palm, again torqueing the riser.
Once you've set your draw hand, then the bow hand, forget about them. Start thinking step by step, draw, anchor, active back muscles, and then release and follow-through.