Jarvis,
I am still (probably always will be) a newbie to trad archery. However I have been dealing with the exact same for a while. I discovered that I wasn't getting my shoulders aligned with the target and arrow very well. What worked for me was to really try to pinch my shoulder-blades together when I draw, which also kinda feels like you're sticking your chest out. For me it really started making my arrows fly exactly where I was looking as far as left and right goes. Plus, this helps me use my back muscles (Lats) more. I also think my arrows are too short, feels like I'm crowded and can't get back far enough.
If you have any way I'd do what Mr. Green suggested and film yourself, these guys are great about helping and advice.
Hope you have a great day, HH