Deer see differently - but they also see contrast quite well. Therefore, contrast between you and your environment is more important when it comes to concealment than the colour choice. Leaf and twig patterns probably don't make a difference, but how many truly solid colours do you see in the woods? The key is not to stand out. The closer you look to your surroundings by any metric the better.
That being said, movement and scent are key. How hard is it to see a deer in the bush when they're not moving? The other thing is cover. If you've got decent cover in front or even behind you, that can be as effective as camouflage.