A big factor on speed opinion is in tuning. A pefectly tuned bow, with the best set of arrows for it, will produce top performance for that bow. It will effect speed, clean release, quietness, arrow flight, and other factors.
Many guys put a lot of time and effort into tuning their bows to that exact "sweet spot".
This can be effected by the bow string material, construction, number of strands, string lenth (fistmele), nocking point, finger placement style, and many othr factors.
These guys take a lot of pride in the effort they go through to get their setup as perfect as they can, and this is understandible.
This has to be coordinated with all the factors of their perfectly matched set of arrows. Arrow length, weight, and spine; fletching factors, point weight, etc.
With all that said, it all goes out the window if they can't shoot accurately and consistantly.
There is an old saying from the days of traditional tournaments. "The bow is not as important as the man behind the bow"
So, it is not so much that guys are negative about speed. They just my have other factors involved that are more importand to them in attaining the accuracy they strive for.
If you really want to start a heated topic, ask what is the "Best bow in the world" and see where that goes.
Although there will be many opinions, we all know it is the "Jack Howard Gamemaster Jet"