In this thesis, we contribute to new directions within Reinforcement Learning, which are important for many practical applications such as the control of biomechanical models. We deepen its mathematical foundations by deriving theoretical results inspired by classical optimal control theory and the connection between neural networks and differential equations. The resulting approach is applied to control complex motions.
In this thesis, we contribute to new directions within Reinforcement Learning, which are important for many practical applications such as the control of biomechanical models. We deepen the mathematical foundations of Reinforcement Learning by deriving theoretical results inspired by classical optimal control theory. In our derivations, Deep Reinforcement Learning serves as our starting point. Based on its working principle, we derive a new type of Reinforcement Learning framework by replacing the neural network by a suitable ordinary differential equation. Coming up with profound mathematical results within this differential equation based framework turns out to be a challenging research task, which we address in this thesis. Especially the derivation of optimality conditions takes a central role in our investigation. We establish new optimality conditions tailored to our specific situation and analyze a resulting gradient based approach. Finally, we illustrate the power, working principle and versatility of this approach by performing control tasks in the context of a navigation in the two dimensional plane, robot motions, and actuations of a human arm model.
Simon Gottschalk
Fraunhofer ITWM neural networks & fuzzy systems machine learning probability & statistics Deep Reinforcement Learning optimal control necessary optimality conditions machine learning applied mathematics optimization Mathematiker Informatiker Data Scientists Mathematiker Informatiker