The horror-film choreographer’s new show, Vessel, weaves spells with writhing limbs, menacing ritual figures and a cauldron of gloop. He explains its origins