Lots of folks use clickers and even more SHOULD. If you develop a problem such as yours (I use a clicker for the same reason), that is almost the ONLY way you will overcome it. Forget abot what others say. They have no clue.
Someone smarter than me needs to develop a soundless clicker. . ie one that lights a small LED or uses some of that special 3D material to change colors at different angles(red to green maybe?), so we can stop worrying about spooking the critter.
All the clicker is doing is taking the decision to release away from your brain and giving it a stimulus marker as to when to release.
Xia. . for hunting, using broadheads, if you take your time and determine the exact length arrow you need, using your broadhead against your finger as a switch works pretty well too. Fred Bear said he did that.
ChuckC