I'm with you guys, it's usually windy here. I hunt two different parts of the state however, and the wind is different in each.
In the farm country in central Ohio we get a consistent wind, very rarely swirls but it is definitely hard to hear them coming and a lot of times there will be a deer right in your lap without you ever knowing so you've got to be careful with how much you move.
In the south/eastern part of the state we have more hills and the winds swirl much more, I get winded a lot more in my hill country spots. They are harder to hunt but I like the big woods and the hilly country. I prefer it to the farm lands and fencerows I hunt in central OH. But both are fun.
On super calm evenings I feel like the deer don't move much until after dark.
I'm pretty much limited to weekend hunting, so hunting certain areas based entirely on the wind is not really an option. I like to use a mobile setup and drop milkweed on my way into the area I plan to hunt and pick my tree based on the milkweed drifting and potential travel routes of the deer. If the wind is blowing hard and directly at the bedding areas I usually just go home.