You guys are talking "calm" days around here! Try 50 to 60 mph for days, even a month on end, with gusts reaching much higher. Deer move normally around here...they are used to it...have to be or they'd starve.
Real windy days are great stillhunting days, and you just adjust and use other tactics. I killed one 6 by 6 on a day that the wind derailed 13 boxcars off the tracks nearby....from the ground of course. There are days I stay not only out, but away from trees, and head for brush or "out of the wind" hidey holes. So to answer your question....around my neck of the woods, it's almost never too windy.