Ryan,
Im not a fanboy of any gear. I own Grey wolf wool, KOM wool, first light, sitka gear, and Kuiu,Helly hansen, with some other wool, Cabelas fleece sprinkled in. They all have features I like, for different purposes.
I think in your situation I would be mostly be using Kuiu outer ware, they have lots of options in non camo. I love the attack pants, they have a really non reflective finish, dry real quick, relatively quiet, and my favorite part is the fact that the material has stretch to it. I simply love their material. I have had really good luck with it, and I put stuff through the paces. Im also pretty damn particular, and brutally honest about my purchases.
All their gear,along with Sitka, is full of great features for hunting. I think therein lies the difference with them and just hiking apparel.
Padded knees, zipper placement and features, things like that with hunters in mind.
Couple that with merino wool undergarments, things like ultra lightweight super down vests, you can have a modular setup, brave some pretty extreme elements, and keep your weight to a minimum.
The thing you will like least is the weight that will be lifted out of your bank account.