Please check this post: No German umlauts
Can you provide the code you use to render your menu links?
I don’t think this is a Kirby related problem, must be something related to your server. If this does not help, please provide more information about your OS, PHP version etc.