They had to swim back to the shore