PUB - Publikationen an der Universität Bielefeld

This thesis analyses the psychological concept of “scaffolding” as a candidate for being able to facilitate the learning process not only of human learners but also of artificial agents. The original concept employs a range of techniques to improve the learning process of novices by analysing their current skill level, adjusts the task’s complexity, directs their attention and provides temporary support. By transferring these methods to the field of machine learning and proposing scaffolding as a general principle for guiding the learning process of an artificial agent, this work demonstrates that the learning performance can be improved significantly and even enables the learning of new skills that would otherwise be impossible.

First, the relations of the individual key aspects of this psychological theory to historical and recent findings in the field of machine learning are discussed. Second, a suitable refined definition of “scaffolding for machine learning” is put forward by positioning scaffolding as a special form of meta-learning that is inspired by psychology. As a result, four different scaffolds for reinforcement learning agents are designed for supporting different parts of the learning process by facilitating efficient acting, perception or pre-learning of sub-skills. In the final analysis, their positive impact is demonstrated by testing these supportive approaches on selected interaction problems.