I apparently was another of the lucky ones that Ipe doesn't bother, but I have a friend that starts itching, sneezing, and eyes watering like crazy at the slightest contact with unfinished Ipe. So, as has been suggested, better safe than sorry, until you're sure.
I tried to get some pictures yesterday evening but we have so much smoke blowing around NC, from a large forest fire south of Jacksonville, that they didn't show the various Ipe colors well. I'll have to try again when conditions clear.