I'm guilty of never washing my clothing....just my thermals, socks, underwear and camo t shirts.
I bowhunt with fleece and have them impregnated with my masking scents. We are talking years of spraying the camo to keep the scent there year round. Thats me.....
If you wash your clothing, and don't want any masking scents on them, then after drying spray them down with a good Scent eliminator and store them in a large plastic container.
You should use a good cleaner other than baking soda...baking soda absorbs odors...if it didn't, people wouldn't put BS in their fridge!?!?!