Every time I've tried bare-shafting with and without a bow quiver, it affected the spine, normally reducing it by one size. If you use one, you should tune with it on the bow and full of arrows, just like you would hunt with it.
I prefer my bow unencumbered, but I don't like traditional back quivers because they don't like my thick woods- always complaining by grabbing something. I use a bow quiver for a back quiver by hanging it in the middle of my back, fletching down, with leather laces over each shoulder that I attach to my belt in front with a loop on one and a hook on the other. It's easy to get on and off, I can get through the woods more easily, and the arrows are very accessible from either side. I like side quivers, but I walk with a limp and it makes the fletching wave like a flag. Not good for hunting.