If they are you buddys, and you want to go spend some time with them, then go. Have a good time with your friends and don't worry about the gun thing.
I am of the same attitude as you as far as rifle hunting goes. I really don't care to shoot a deer, or any other critter with a rifle.
That being said though, if one of my friends asked me to go hunting with him, and all we could do was rifle, I would go just to spend some time with my friend. Don't know if I would shoot anything or not, but I would go, and I would have fun with my friend.
Bisch