My default language EN and after I added a layout It disappears when I switch to TR. Also I tried German language and I have same issue.
If the non-default version is already stored on disk, that is standard behavior, just like with the structure field.
Is it possible to change this behavior? Otherwise, I will have to repeat this process in every language.
No, there is no setting for that. The only thing you could do would be to update the other languages with this newly added layout as well, but then you would end up with untranslated content in all non-default languages.