Schedule

Date Topic Code Snippets Assignment due
1/18 Introduction, Syllabus Review,
1/21 Using Pybullet Simulator
1/25 Motion Planning
1/28 Neural Networks: MLPs HW1
2/1 Neural Networks: CNNs
2/4 Reinforcement Learning: Bandit Problem
2/8 Reinforcement Learning: Q-learning HW2
2/11 Reinforcement Learning: DQN
2/15 Overview of nuro.arm API
2/18 Final Project Guidelines
2/22 Quick Project Pitches HW3
2/25 NO CLASS
3/1 RL for Continuous Control Project Proposal
3/4 Discussion & Project Planning
3/8 Special Topic Lecture
3/11 Discussion
3/15 Spring Break
3/18 Spring Break
3/22 Special Topic Lecture
3/25 Discussion
3/29 Special Topic Lecture
4/1 Discussion
4/5 Special Topic Lecture
4/8 Discussion
4/12 Special Topic Lecture
4/15 Discussion
4/19 Special Topic Lecture
4/22 Discussion
4/26 Final Project Presentations