This is a survey of YouTube’s recommender algorithm, from deep neural network to reinforcement learning.