Careful!
A nail set will work, but it is very subtile, too much and CRACK.
You can use a steel punch with bigger angle, it'll only flare the very end of the thonghole. It doesn't take much.
If you don't have to flare it, you can bevel the edge with countersink bit in drill, to keep from wearing on the thong.
Dan