Freezing a layer, too, is a technique to accelerate neural network training by progressively freezing hidden layers.