I'm in central VA, and I would have agreed with you up until Saturday, November 16th. That day I saw ten different bucks between 8:00 a.m. and 10:30 a.m. Apparently a hot doe had been in the area, and all the bucks came to check her out. I saw scraping, rubbing, chasing, and fighting. It was very exciting to witness all that activity. Five days later I sat in the same stand and I didn't see a deer all day.
If I'd been sitting 200 yards in any other direction, I may not have seen anything that day. Sometimes you're just in the right spot