Even out of spine arrows will fly straight down the middle--bare shafts, not so much.
Just because you're looking straight down the shaft in a mirror doesn't mean you're in bone-to-bone alignment. Unfortunately, we can't see what you're doing. If you could post a video from the front, back and above, perhaps we could help.