Hey madjack, I had the same thing happen to me when I first got my Black Widow. It was so bad that I had to wear a glove on my bow hand. I raised and lowered my nock point, turned my nock all different ways, tried different arrows (aluminum and carbon) and even bought a left wing jig for my Bitzenburger and switched from RW to LW feathers.
Nothing I did solved my problem of the feathers cutting my hand, so I called Black Widow and told them what was happening and if they knew something I could do.
The first thing he asked me was if I shot with three fingers under and I answered, Yes.
He then told me to put a nocking point above and below my arrow, I was thinking, "Yeah right", when he told me that but as soon as I got off the phone I tied a nocking point below my arrows nock.
That was about 3 months ago and several thousand arrows later I have yet to touch my hand with a feather.
GOOD SHOOTING!
Slufoot