Caves Beach has a network of sea caves which can be explored at low tide.