Changing the breadcrumb (per example) is a matter of custom CSS, which can be loaded in the panel (by defining it in your site.config).
And you can add functionality to the panel, by wrapping all the functions in an invisible field.
I did this using my quick-menu en image-grid plugins (both work in progress).