Be gentle with your scraper. It's best to use an edge with a light burr roled over so that it removes less material each pass. And be gentle... swipe the scraper with finess, setting it down gently each time on rind if possible and swiping toward exposed bamboo.
Too heavy a burr and/or setting it down harshly, or with too much pressure creates a 'cut line', or 'dig' each time which is a perfect opportunity for a splinter to raise.... and going back and sanding too much to remove them all can raise the likelyhood too. Working lightly, with a fine burr, and wiping into the previously worked area, eliminates or minimizes such damage or the need to sand it out. Leave litlle wisps of the powdery 'under-rind' behind, and then sand the whole back lightly with fine grit paper... 240-320 and call it good. You'll soon get the feel for it, and know when you're going too far.
I can post pics when I get home if it'll help.