For those cool days where a wool shirt isn't enough, I have an outer shell I bought 25 years ago in Germany. It is dead soft and completely quiet with a really thin lining and GoreTex type membrane. Its a very pale dead green color; not camo, but really disappears in the woods. A lot of our hunting clothing is much too dark. Wish I could find a replacement that is soft, quiet, thin and wind and water proof.
For anything other than sub-zero temps, I find it easiest to wear the light outer shell and adjust the warmth by varying the amount of under-layers I wear - a wool shirt, light wool sweater and then the wind-proof outer shell. I can unzip or completely remove the outer shell while walking out to my blind.
When it hits the minus number, insulated coveralls are the only way for me.