You can insert captions for each photo right in the Photo Album dialog.

 

 

Note that this option may be unavailable depending on the picture layout you have selected.

Although you can’t type in the captions here, PowerPoint will leave room on the slides so that you can add them later.

You can also modify the photo order using the arrows below the photo list.