After looking at many different instagram feed plugins, this is the only one I found that can enable displaying captions without paying for a premium version of the plugin.
This plugin only has two options, the number of photos displayed and whether or not to show captions. Even though this limits the user to the automatic size of the images, if you need something quick and dirty, this is a great solution.
I didn't like how the background color of the captions has CSS to make it appear black, but this was easily fixed with one custom CSS class: .simple-instagram-caption
Currently using this plugin with Wordpress 4.8.7