Ver PelisPlus. Every winter, four penguin species begin their breeding in four very different locations in southern New Zealand. In the rugged Fiordland National Park, some Fiordland crested penguins build cave-like nests inside the fiord, while others prefer the coastline.