NVIDIA TensorRT

An SDK with an optimizer for high-performance deep learning inference.