I can be sweating because of core warmth and still have cold hands if my hands are in the wind at all - just I guess. My father was one of the "no gloves" guys and even when he's admittedly cold on stand, his hands are warm to the touch. I didn't get that gift.
I use a hand muff (fleece lined) and put the hand warmers in there and keep my hands in it when it's cold, and especially if it's windy. I'm rarely cold when hunting in terms of my feet, my body, or my head - but my hands will be cold often if I don't take these extra precautions. The muff and the hand warmer combination are the ticket for me. I do most of my cold weather hunting in WV - not cold by some standards, but many an all day sit in the teens, 20's, and low 30's.