I like the Velcro also, but if you are getting excessive wear it is likely that something else is going on.
While some wear is expected, excessive wear is depicts undesireable contact. In most cases it will be the quill of the feather. A slight rotation of the arrow nock, cut off and reglue if you are not shooting carbon.
If the nocking point is too high, or too low in some cases, you will get excessive wear. If all those things are o.k., you will get good use of the arrow shelf materail of your choice.
I shoot both carbon and aluminum and my rests look nearly as good when I replace them as they did when they were installed.
You might ask why I would change them if they were fine, simple, I will from time to time shoot different feather configurations, such as four fletch, or I might shoot a different size arrow, in which case it will require a more custom fit between rest and arrow.