Thank you for posting steps and detailed info!
The problem is happening because of the plugin you mentioned:
http://wordpress.org/extend/plugins/wordpress-nextgen-galleryview/
That plugin uses jQuery that isn't properly called after Infinite Scroll loads more posts, so the gallery doesn't appear. Can you please try contacting the other plugin author directly about this issue to see if there's anything they can do to fix it from their side?