This course provides students with an extensive exposure to deep learning. Topics include shallow and deep neural networks, activation functions and rectified linear unit, construction of deep neural networks and matrix representations including deep convolutional neural networks and deep recursive neural networks, computational issues including backpropagation, automatic differentiation, and stochastic gradient descent, complexity analysis, approximation analysis including universality of approximation, design of deep neural network architectures and programming according to various applications.