I always use a GPS when I'm hunting, but as has been said, always use good common sense so if the thing breaks, you'll be able to find your way back anyway.
One time I was hunting elk in Colorado, and stopped to rest for a while and eat a snack. Sometime later, I realized I didn't have my shooting glove anymore, and thought I'd probably left it on a log where I took my break. I had no idea of how to find my way back to that spot; I didn't think I would ever have to come back to that spot, so I didn't try to remember anything about it. But I did remember that I had turned on my GPS to get a fix on where I was; how many miles from camp, etc. Whenever you turn on a GPS, it leaves "breadcrumbs" at that spot, even if you don't mark the spot as a waypoint. By zooming in and panning around, I was able to locate the breadcrumbs, and create a waypoint there. Then I was able to walk back and find my shooting glove!