tf.distribute.MirroredStrategy  |  TensorFlow Core v2.6.0

Synchronous training across multiple replicas on one machine.