Fortunately, I don't usually get it until after the shot. It's pretty thick most places I set up to hunt and the deer are usually pretty close when I see them, and often times moving. Once I make a quick decision on if I'm going to shoot it I'm usually focused on picking out a spot where I want to stop the deer.
If I do happen to see one where I can watch it for a while before shooting, I TRY to only look at the rack once, then focus on his "sweet spot" while waiting for a shot.
Still shake sometimes after I shoot one, but that's all part of the excitement.
YB