WIteacher...
One year I called in 3 mature toms on the first morning for my Son, Son-in-law and myself. My Son shot one (we were hunting with shotguns back then) and my Son-in-law knocked some feathers out of a second one.
Two days later I called the same two birds in and my Son and I got a "double" (killed both birds with simultaneous shots). The second encounter with them... they came in silent. One gobbled initially, a long ways off, but were silent after that. Don't be surprised if he sneaks in silently to carefully check things out.
Yeah... I think you can still kill him. As suggested set up a little different... not in exactly the same place. Set your decoys near the top of a rise and position yourself where you can shoot as he approaches (if you have an idea).
Good luck!