The content folder hold the original files. The media folder is more of a cache, the complete folder can be deleted and will be recreated again from the files in the content folder. So you should never remove your original files from the content folder. These are the ones that you keep and that should and would be version controlled (if you use version control), not the media folder.
Background: Image URLs - How to remove string?