Okay, after quite some testing I found the solution.
The problem was I was using the <k-inside> element, not the <k-panel-inside> element.
After checking some plugins this seems to be the correct solution.
The documentation for the different vue elements can be found here Kirby Panel (just as a reference if others also need some help finding the right site…)