It isn't an issue if done properly.I scuff the adapter with 60 grit sand paper and roll up a small piece to lightly sand inside the broadhead's ferrule.You can use a Q-tip to get any dust out and wiping it out with acetone or laquer thinner,doesn't hurt.I glue with a fast set epoxy called Epo Grip,but others use hot melt or slower set epoxies.
The most important thing is to get the tip aligned perfectly.The best and easiest way for me is to use an alignment jig.I built this one.It doesn't have to be that fancy.You can make 2 "V" blocks out of wood or angle,instead of rollers and it will work just as well.
I use an arrow with a field point to establish a tip reference point on the angle at the end.Them use a pen so I can see it more easily.
Then glue the broadhead and put the arrow on the jig,with blade vertical.Now tweak the head till it meets the dot.
Then turn the arrow 90 degrees(horizontal blade)and tweak it till the tip aligns with the dot again.Set the arrow aside where it won't get bumped,until the glue sets up.I find the jig faster and easier than just aligning the tip by spinning.
It may seem complicated but it is actually fairly easy.When you get into it and have questions,I'm sure you can get plenty of help here.