Its amazing what little movement these deer can see, I have had the same expierance, wind is one of the biggest factors no doubt, especially on the ground! I have seen a smaller buck several times already, I have learned an amazing amount of knowledge just watching him, how he reacts to sounds in woods, the wind etc,I have drew on him several times but there is a much nicer one in my area, plus a couple nice does so its a waiting game! My neighbor and I have put up trail cams this year I can't believe deer especially bucks that we are seeing on the cams, no rut yet though!