Karl, I think it depends on your handle material. I use a heat-curing epoxy and cure it at 170 - 200 degrees F. I wouldn't do that with ivory, of course, but I have yet to experience any warpage with giraffe bone, buffalo horn or stag. I generally use stabilized woods and have had no problems with them either. Once that epoxy is cured, there is no way the handle can warp and it will not loosen. I have to grind every last bit of the handle material off if I want to change it. You can definitely not peel it off with a flat wood chisel and mallet - I've tried.
I like doing my finish shaping with files, but hog quite a bit of material off with a fresh belt first. Your handles are made to disassemble and obviously have to be treated differently. I don't have your or Lin's ability to finish a guard and handle before final assembly. I try to get a perfect fit fore and aft, then lock everything together and shape the handle material and guard together. That's a big difference between a bladesmith and hobbyist knife maker