The following are the lecture notes that I prepared while auditing UC Berkeley's Deep Reinforcement Learning course.