From the start of bow season until the weekend after Thanksgiving I have the same clothes in my pack all the time (only summer fishing trips will it vary)
My first layer is mid a mid weight Smartwool Henley (like a 180 thread count.) My second layer is a Smartwool mid weight TML
http://www.smartwool.com/mens/midlayer/mens-tml-light-sportknit-half-zip-8818.html Then for an insulation layer I keep a Western Mountaineering GWS downie in the pack (it's stored in a Sea to Summit dry sack when I'm not wearing it, no way will it get wet)
http://www.westernmountaineering.com/index.cfm?section=products&page=Down%20Garments&cat=Jackets%20and%20Vests&ContentId=64 Also in my pack is a Montane wind shirt, sized to fit over the TML. You'd be stupid to not have something like this in your kit. I wouldn't bank on it's claims to be waterproof. It DOES keep wind from carrying heat out of your mid layer, and it will keep you pretty dry in a drizzle for a while.
http://www.montane.co.uk/products/men/windproof/featherlite-smock/40 Then, depending on time of year and historic weather patterns in my area. There may be rain gear in my kit. I use the cheap pants that Red Ledge makes, because I destroy pants every other season. For a top, I'm going to have something eVent in there this year. When I DO pack raingear, the windshirt stays home.
Pants are easy... I've got an old pair of Filson Whipcords that I wear anytime I'm hunting. I'll use a heavier base layer later in the year as it cools. Your friends will give you crap for hunting in dress slacks, but you'll get over it.
It's also worth noting that all my tents have a wood stove, so drying gear at the end of the day is a non-issue. But I feel that wet synthetics aren't any better than wet wool. I've ran a clothing system like this for the last 2 years in NW Montana and I'm good to go from 20 degrees to 90 degrees. I spend a lot of time in the field, and the choices I've made on gear (although not cheap) have never let me down.