You could create a custom image tag (copy the existing one to overwrite it) that get’s the caption from the image meta data.
The procedure is similar to the one described in this post, with the difference that you don’t want to create thumbnails but add captions.