Deep Reinforcement Learning

M_TuIT_EVA_1037

HS/22-FS/24

3

Reinforcement learning is one of the most exciting areas of machine learning and unfortunately, also one of the most complex. It is a machine learning (ML) paradigm that is capable of optimizing sequential decisions. RL is interesting because it mimics how we, as humans, learn. We are instinctively capable of learning strategies that help us master complex tasks like riding a bike or taking a mathematics exam. RL attempts to copy this process by interacting with the environment to learn strategies. RL is a highly mathematical topic.

This course is aimed at MSE students of data science and other technical disciplines. It is intended to be an introduction to deep RL and no prior knowledge of the subject is required. However, we do assume that readers have a basic familiarity with machine learning and deep learning as well as an intermediate level of Python programming. Some experience with tensorflow, keras is also useful but not necessary.

The students…

- learn the theory and application of models and algorithms used in Reinforcement Learning (RL)
- understand the key concepts of Deep Reinforcement Learning: Markov Process, Bellman equation, Q-Learning, TD-Learning, Deep Q-Learning, policy gradients and actor-critic methods.
- get to know a wide range of possible application examples and useful RL environments
- learn how to approach their own DRL projects and how to implement them in a working Python code.
- get the skills to research, study and understand primary sources in form of academic papers.
- get the skills in Python and Tensorflow to work on and implement practical, industrial DRL control projects.

Würsch Christoph

Buchs

Standard-Modul für MSE Master of Science in Engineering BB STD_08 (BU)(Keine Semesterempfehlung)

Standard-Modul für MSE Master of Science in Engineering BB STD_16 (BU)(Keine Semesterempfehlung)

Standard-Modul für MSE Master of Science in Engineering BB STD_13 (BU)(Keine Semesterempfehlung)

Standard-Modul für MSE Master of Science in Engineering VZ STD_08 (BU)(Keine Semesterempfehlung)

Standard-Modul für MSE Master of Science in Engineering VZ STD_16 (BU)(Keine Semesterempfehlung)

Standard-Modul für MSE Master of Science in Engineering VZ STD_13 (BU)(Keine Semesterempfehlung)

Standard-Modul für Technik und IT MSE_20(Keine Semesterempfehlung)

Fachliche Vertiefung / 3 Punkte

Fachliche Vertiefung / 3 Punkte

Fachliche Vertiefung / 3 Punkte

Fachliche Vertiefung / 3 Punkte

Fachliche Vertiefung / 3 Punkte

Fachliche Vertiefung / 3 Punkte

Fachliche Vertiefung / 3 Punkte

Note von 1 - 6

Deliverables:

- Documented DRL-Project in form of a working Python Code or Jupyter notebook

- Presentation and short oral interview (15’)

- Participation in online-lessons (>75%)

Note von 1 - 6

Dokumentiertes DRL-Projekt mit einem mündlichen interview (Gewicht 100%).

Deep Reinforcement Learning

TuIT_EVA_1004

90

1

Reinforcement learning is one of the most exciting areas of machine learning and unfortunately, also one of the most complex. It is a machine learning (ML) paradigm that is capable of optimizing sequential decisions. RL is interesting because it mimics how we, as humans, learn. We are instinctively capable of learning strategies that help us master complex tasks like riding a bike or taking a mathematics exam. RL attempts to copy this process by interacting with the environment to learn strategies. RL is a highly mathematical topic.

This course is aimed at MSE students of data science and other technical disciplines. It is intended to be an introduction to deep RL and no prior knowledge of the subject is required. However, we do assume that readers have a basic familiarity with machine learning and deep learning as well as an intermediate level of Python programming. Some experience with tensorflow, keras is also useful but not necessary.

The students…

- learn the theory and application of models and algorithms used in Reinforcement Learning (RL)
- understand the key concepts of Deep Reinforcement Learning: Markov Process, Bellman equation, Q-Learning, TD-Learning, Deep Q-Learning, policy gradients and actor-critic methods.
- get to know a wide range of possible application examples and useful RL environments
- learn how to approach their own DRL projects and how to implement them in a working Python code.
- get the skills to research, study and understand primary sources in form of academic papers.
- get the skills in Python and Tensorflow to work on and implement practical, industrial DRL control projects.

- Introduction to RL
- Markov Decision Processes, Dynamic Programming, and Monte Carlo
- Temporal-Difference Learning, Q-Learning, and n-Step Algorithms
- Deep Q-Networks: DQN and DDQN
- Policy Gradient Methods
- Actor-Critic-Algorithms: synchronous and asynchronous parallelization techniques that are applicable to any of the algorithms
- Practical Reinforcement Learning

Durchführung gemäss Stundenplan

Ergänzende Veranstaltung mit Lektionen pro Woche

- Max. Teilnehmer: 99

- Harte Grenze: nein