I had the same requirement for my modules plugin because I use a container page that should not be directly accessible in the Panel. While I also hide the item in the breadcrumb via CSS, Kirby redirects to the parent page after deleting a child page so I needed a redirect. After some attempts to solve this with routes I finally wrote a very simple field that sets the window.location.href to the parent page.
Maybe you could adapt it to your needs?