Model parallel transformers in JAX and Haiku. Contribute to kingoflolz/mesh-transformer-jax development by creating an account on GitHub.