I have tapered several dozen sets of Surewoods with hand held tools, and still do (I'd like a sanding rig, but can't afford one).
I was gouging some early on, but do fine now. It does require a decent blade, and a light, gradual touch, as others are advising. Don't push the shaft in to the tool so much as let it cut at it's own pace, feeding the shaft gently.
Also, I was having trouble with the (original) TruCenter tool-the blade is just not that good. I have both the "Traditional" and a Bearpaw pencil sharpener type: both cut cleaner, so I do the point tapers with one or both of those - then just use the TruCenter to finish, as I get the full 1" taper depth with that. Nocks, the pencil sharpeners work just fine.
What sharpener are you using?