Well, I got a bunch done. After rasping the facets on the backing I used the farriers rasp to reduce the crown. I remover the Sharpie lines added earlier so I could see the glue line better.
My first autopsy finding is like I suspected and someone else mentioned, a dry area of glue line along one edge right where the backing broke and lifted a splinter. I also found some discoloration in the hickory backing I've never seen before. I can't tell if this is fungal or maybe mineral deposits...
Once I got most of the backing down as far as I was comfortable using a rasp...
I went to the "Stave Master" and scraper to get the backing down...
...starting with the crown and working that down until I got near the edges...
The guy on PA(PatM) that suggested rasping instead of grinding said that when you hit the glue line it was like the sound made when chasing an osage ring and get into the early wood and it was. I got the majority of the backing off but still have more to go. I'll continue with a fresh head later.