Orca: A Distributed Serving System for Transformer-Based Generative Models | USENIX
www.usenix.org