To answer your question about the does, they are not far.
What you have found is a buck mecca. The area contains all of the elements the bucks prefer, and barring some major change, the area will always hold bucks. When the rut starts, the bucks will probably be elsewhere, but if you can hunt the area without spooking them, you have an excellent opportunity to learn alot and possibly tag a buck in the process.
Young bucks sometimes pester does, and they try to avoid them because of this. This is another possibility for the lack of does in the area.
Whatever the case, congrats on the new baby, and I hope one of those bucks wanders too close to your bow.