I haven’t used the Panel in personal projects, nor in most client projects. We also write all content for the getkirby.com website in a text editor, not in the Panel.
My personal opinion: if you don’t need it, don’t use it. If there is no backend, nobody can even try to hack their way into it .
In your case I understand why you use the panel but for me that’s actually not relevant. Especially my skills are not so good that I use hooks or something like this. Later it could be but not yet.
Your point is something what I really agree. As a “newbie” I want to have a secure website as it is possible and kirby makes me easy to work without a backend. And so one point of a hackable door is closed when I don’t use it.
Another question:
Have I only delete the panel folder or can I delete e.g. the blueprint folder as well?