Return to same place in playlist

How can I control where in the playlist I will return if I leave that playlist’s preset to go to another one and then come back? Sometimes it opens again on the last image I looked at (which I want!) but usually it starts back on number 1. It seems random. How do I control the behavior?