I wonder if someone already created a panel field that is just a simple button that executes the code of a plugin?
Any idea on how to build something like that?
I would imagine something like that:
Do you know the boiler field? Maybe that helps as a starting point.
Yes I know that. Just want to make sure that I am not reinventing the wheel 
The Boiler field is a pretty good starting point. You can use a route for your field, add a link to it to the fields’ template and throw everything else out. The route will do the magic as it will get run once the button is clicked.