If you're right handed and the arrows are hitting left, they are showing stiff.
You would need to increase the point weight, or, reduce the side plate thickness, as you did, which, in bringing the shaft closer to the center of the bow, requires a stiffer shaft.
If the arrows are now impacting to the right, removing the rest moved the arrow too close to the center of the bow and you will need to build the side plate back out a little.
On the other hand, if "got them hitting right" means they're shooting where you want them to, you're set to go. Maybe put a thin piece of leather or tape on the side plate to cut down on noise.