Developers are increasingly constructing Compound AI Systems, i.e. systems that use multiple model calls and/or external components, to tackle the most challenging AI tasks. These systems can often outperform models alone, but the best way to design these systems and the components that go into the…