You can't beat the wind, you can only adapt to it. I deal with the same problem hunting near a lake.
If you can look at the weather patterns you can make a good bet what direction the prevailing wind will be coming from. I'll set up my "hide" based on that. The wind may swirl, but I've learned the worst thing I can do is move around based on a fickle wind, leaving a scent trail all around.
Usually just before sundown, the wind will settle just as the deer start to move.
Getting winded is just part of getting close!