This advanced elective course introduces the essential elements and mathematical foundations of the modern reinforcement learning: the optimal control theory, including dynamic programming and numerical techniques. It emphasizes both the fundamental theories in control theory and the numerical methods in context of reinforcement learning algorithms. It also equips students with computing algorithms and techniques for applications to some practical problems.