Learning and retrieval of hierarchically organized information in a simple, one-layered RNN
Cruse H, Schilling M (2010)
In: Proceedings of the International Joint Conference on Neural Networks (IJCNN 2010 at WCCI 2010 IEEE World Congress on Computational Intelligence). 1–9.
Konferenzbeitrag
| Veröffentlicht | Englisch
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Einrichtung
Abstract / Bemerkung
How is it possible for an autonomous agent to learn and retrieve hierarchically organized information? The question is particularly interesting if there is not a simple, treelike hierarchy, but when low-level items may belong to several superordinate elements. In this article we propose a solution for this problem following the ideas of O'Connor et al. [1], which are guided by the observation that children learn superordinate concepts from implicitly given information. For the simulation, we use a simple, one-layered RNN consisting of IC units and a very simple learning rule based on teacher forcing [2], [3]. We assume the capability of figure-ground separation as being given. Furthermore, the agent is assumed to owe sensory systems. There are, however, no explicit, preformulated concepts given like 'Red'. Further, the agent is assumed to be able to record words. Each object presented to the agent is separately and individually learned and represented in the RNN forming an episodic memory. We show that, using this simple approach, learning and retrieval of hierarchically organized information is possible, although this information is not given explicitly and no hierarchical structure can be found in the network. Learning is very fast. The net shows top-down generalisation and bottomup activation. Furthermore, asymmetric priming effects can be observed similar to those fond in human subjects. The agent is able to chunk different sensory inputs to represent the same object in memory, but nevertheless being able to distinguish between the different stimuli if, during learning, a supervisor labels the different stimuli with the same name.
Stichworte
sensory;
Memory;
network;
Simulation;
STIMULI;
Observation;
SENSORY INPUTS;
Human;
NO;
input;
system;
ACTIVATION;
learning;
SYSTEMS;
agent;
Information
Erscheinungsjahr
2010
Titel des Konferenzbandes
Proceedings of the International Joint Conference on Neural Networks (IJCNN 2010 at WCCI 2010 IEEE World Congress on Computational Intelligence)
Seite(n)
1–9
Konferenz
IJCNN
Konferenzort
Barcelona
Page URI
https://pub.uni-bielefeld.de/record/1681307
Zitieren
Cruse H, Schilling M. Learning and retrieval of hierarchically organized information in a simple, one-layered RNN. In: Proceedings of the International Joint Conference on Neural Networks (IJCNN 2010 at WCCI 2010 IEEE World Congress on Computational Intelligence). 2010: 1–9.
Cruse, H., & Schilling, M. (2010). Learning and retrieval of hierarchically organized information in a simple, one-layered RNN. Proceedings of the International Joint Conference on Neural Networks (IJCNN 2010 at WCCI 2010 IEEE World Congress on Computational Intelligence), 1–9.
Cruse, Holk, and Schilling, Malte. 2010. “Learning and retrieval of hierarchically organized information in a simple, one-layered RNN”. In Proceedings of the International Joint Conference on Neural Networks (IJCNN 2010 at WCCI 2010 IEEE World Congress on Computational Intelligence), 1–9.
Cruse, H., and Schilling, M. (2010). “Learning and retrieval of hierarchically organized information in a simple, one-layered RNN” in Proceedings of the International Joint Conference on Neural Networks (IJCNN 2010 at WCCI 2010 IEEE World Congress on Computational Intelligence) 1–9.
Cruse, H., & Schilling, M., 2010. Learning and retrieval of hierarchically organized information in a simple, one-layered RNN. In Proceedings of the International Joint Conference on Neural Networks (IJCNN 2010 at WCCI 2010 IEEE World Congress on Computational Intelligence). pp. 1–9.
H. Cruse and M. Schilling, “Learning and retrieval of hierarchically organized information in a simple, one-layered RNN”, Proceedings of the International Joint Conference on Neural Networks (IJCNN 2010 at WCCI 2010 IEEE World Congress on Computational Intelligence), 2010, pp.1–9.
Cruse, H., Schilling, M.: Learning and retrieval of hierarchically organized information in a simple, one-layered RNN. Proceedings of the International Joint Conference on Neural Networks (IJCNN 2010 at WCCI 2010 IEEE World Congress on Computational Intelligence). p. 1–9. (2010).
Cruse, Holk, and Schilling, Malte. “Learning and retrieval of hierarchically organized information in a simple, one-layered RNN”. Proceedings of the International Joint Conference on Neural Networks (IJCNN 2010 at WCCI 2010 IEEE World Congress on Computational Intelligence). 2010. 1–9.
Google Scholar