We benchmarked LLM training and inference on an Intel Gaudi2 cluster and found that it delivered great single-node and multi-node performance.