So, why the non-camo requirement? I wear camo hunting clothes as well as non-camo. Deer don't seem to care one way or the other as long as I stay still. I buy camo for the features rather than for concealment. Camo hunting clothes tend to be designed for hunting, thus things like wind blocker, quiet fabric, and plenty of pockets are designed into them as well. As you are finding, it is difficult to find clothing with the features we want that doesn't come with some sort of camo pattern on it.
The other reason I buy camo is often economics. "Hunting" clothes tend to go on sale after the season, which is usually when I buy them. For example, I have a Carhartt hooded arctic jacket that I bought several years ago. It's camo, but I didn't buy it for hunting since until now when it's nearly worn out, it is too noisy. I bought it because I wanted a warm jacket and the "hunting" ones were half price at the end of the season. The same jacket in black, tan or olive green would have cost twice as much, so camo it is.