Troy,
Hope you get better quickly. Also, thanks for bringing this subject up, it might inspire some to use a respirator all the time.
Ipe is the wood that affects me the most. It completely cloggs my nose after five minutes and my arms develop a bunch of little red dots about half an hour after that.
Yew, cocobolo, and recently Osage, have all started to make breathing difficult if I don't wear at least a dust mask when working them. I think the Osage is the result of accumulation over a twenty year period.