On my pack in trips for deer, I used to shoot for about a half mile. Now have a cabin so don't do that anymore,. Do have a good stand just 300 yards or so from my cabin.
I now get packed in on my Western elk/mule deer hunt. Not unheard of to have critters come through camp. A little forky walked up to 5 yards away from me while I was eating dinner last year. I figure I'm hunting as soon as camp is out of sight, which doesn't take long.
I suppose some critters make the camp, but not much one can do about it miles from the trailhead. However, as light as you're camping, you could move every day or so, so they wouldn't be able to pattern you.