I'll be the voice of desent. It matters. The 100 grain inserts I've used are much longer than the regular inserts. That additional length can act as a footing, shortening the flexible portion of the shaft and stiffening the arrow. Some may find that it doesn't matter, but it makes a huge difference for me.
I find this fact very annoying, because I don't particularly enjoy tuning and this kind of finicky tuning stuff means more time tuning and less time shooting. That's why I'm a newly minted Arrow Dynamics shooter. I don't know what kind of pixie dust they put into those shafts, but they are far, far less finicky to point weight. I can do a full 75 grain swing in bh weight with no arrow flight issues.