Speed up flushing of file cache

Adding a button to flush the cache kinda defeats its purpose, no? I’m afraid pushing that button will timeout too, since cache:flush is used by the panel to flush cache too…

I’m thinking the problem has something to do with too much files in a single folder?