Blades have been effectively hafted to antler handles for centuries. The smaller the antler the smaller the blade and hence the lighter duty it should perform. In earlier times there were few antlers hanging on the walls as trophies for the woodsman found they were far more valuable as knife and tool handles.
Tippit has shown some methods, the hidden tang being what is used mostly. Proper fitting and preparation along with the right glue will yield a strong, beautiful, and functional tool.