‘When we were looking for locations on our first series, the producer was always stepping away to take calls. We learned later they wanted to cancel us’