I'm a runner and run in those goofy vibram toe-shoes almost exclusively. I did a trail 50k several years ago and did a fast 50-mile weekend with a buddy up in Yosemite a couple years ago -- all in vibrams. I've worn through the soles of at least 6 pairs by now. When on trails, I use Dirty Girl gaiters.
While I would like to hunt with the Vibrams (and have a few times), I've found that off-trail hiking requires something sturdier, more water resistant and secure against brush. I've been using my Tactical Research Mini-Mil boots for hunting for the last few years. While it's not fully zero-drop, it's about as close as I've found in a boot that sturdy. It doesn't have the same ground-feel as a true minimalist shoe but it's WAY better than any "hunting" boot on the market. I'd say it's a good compromise. They're compliant with most police & military required specs if that gives you a sense of how they're built.
My wife picked up a pair of Xero boots that she likes. You can easily pick up a set of Dirty Girl gaiters for them, too. This would be more for hiking than hunting, I'd think, since it's like a mid-top boot. I like having a higher top for hunting as brush, loose dirt, sand and thick mud all occur in my woods.
If I can ever find something more like a moccasin (higher top but thinner, rubber-soled boot with a more sturdy upper) for a reasonable price, I'd be all-in. Tried making some about a year ago & it didn't come out all that great. So I'm back to the Mini-Mil.