Leveraging Domain Knowledge for Reinforcement Learning Using MMC Architectures

Author: R. Ramamurthy, C. Bauckhage, R. Sifa, J. Schücker, S. Wrobel
Journal: ICANN 2019: Artificial Neural Networks and Machine Learning – ICANN 2019: Deep Learning
Booktitle: International Conference on Artificial Neural Networks (ICANN)
Year: 2019

Citation information

R. Ramamurthy, C. Bauckhage, R. Sifa, J. Schücker, S. Wrobel:
Leveraging Domain Knowledge for Reinforcement Learning Using MMC Architectures.
International Conference on Artificial Neural Networks (ICANN),
ICANN 2019: Artificial Neural Networks and Machine Learning – ICANN 2019: Deep Learning,
2019,
https://doi.org/10.1007/978-3-030-30484-3_48

Despite the success of reinforcement learning methods in various simulated robotic applications, end-to-end training suffers from extensive training times due to high sample complexity and does not scale well to realistic systems. In this work, we speed up reinforcement learning by incorporating domain knowledge into policy learning. We revisit an architecture based on the mean of multiple computations (MMC) principle known from computational biology and adapt it to solve a “reacher task”. We approximate the policy using a simple MMC network, experimentally compare this idea to end-to-end deep learning architectures, and show that our approach reduces the number of interactions required to approximate a suitable policy by a factor of ten.