Qualitative Spatial Abstraction in Reinforcement Learning

Reinforcement learning has developed as a successful learning approach for domains that are not fully understood and that are too complex to be described in closed form. However, reinforcement learning does not scale well to large and continuous problems. Furthermore, acquired knowledge specific to...

Full description

Bibliographic Details
Main Author: Frommberger, Lutz
Format: eBook
Language:English
Published: Berlin, Heidelberg Springer Berlin Heidelberg 2010, 2010
Edition:1st ed. 2010
Series:Cognitive Technologies
Subjects:
Online Access:
Collection: Springer eBooks 2005- - Collection details see MPG.ReNa
LEADER 02725nmm a2200325 u 4500
001 EB000385584
003 EBX01000000000000000238636
005 00000000000000.0
007 cr|||||||||||||||||||||
008 130626 ||| eng
020 |a 9783642165900 
100 1 |a Frommberger, Lutz 
245 0 0 |a Qualitative Spatial Abstraction in Reinforcement Learning  |h Elektronische Ressource  |c by Lutz Frommberger 
250 |a 1st ed. 2010 
260 |a Berlin, Heidelberg  |b Springer Berlin Heidelberg  |c 2010, 2010 
300 |a XVII, 174 p  |b online resource 
505 0 |a Foundations of Reinforcement Learning -- Abstraction and Knowledge Transfer in Reinforcement Learning -- Qualitative State Space Abstraction -- Generalization and Transfer Learning with Qualitative Spatial Abstraction -- RLPR – An Aspectualizable State Space Representation -- Empirical Evaluation -- Summary and Outlook 
653 |a Control, Robotics, Automation 
653 |a Artificial Intelligence 
653 |a Control engineering 
653 |a Artificial intelligence 
653 |a Robotics 
653 |a Automation 
041 0 7 |a eng  |2 ISO 639-2 
989 |b Springer  |a Springer eBooks 2005- 
490 0 |a Cognitive Technologies 
028 5 0 |a 10.1007/978-3-642-16590-0 
856 4 0 |u https://doi.org/10.1007/978-3-642-16590-0?nosfx=y  |x Verlag  |3 Volltext 
082 0 |a 006.3 
520 |a Reinforcement learning has developed as a successful learning approach for domains that are not fully understood and that are too complex to be described in closed form. However, reinforcement learning does not scale well to large and continuous problems. Furthermore, acquired knowledge specific to the learned task, and transfer of knowledge to new tasks is crucial.   In this book the author investigates whether deficiencies of reinforcement learning can be overcome by suitable abstraction methods. He discusses various forms of spatial abstraction, in particular qualitative abstraction, a form of representing knowledge that has been thoroughly investigated and successfully applied in spatial cognition research. With his approach, he exploits spatial structures and structural similarity to support the learning process by abstracting from less important features and stressing the essential ones. The author demonstrates his learning approach and the transferability of knowledge by having his system learn in a virtual robot simulation system and consequently transfer the acquired knowledge to a physical robot. The approach is influenced by findings from cognitive science.   The book is suitable for researchers working in artificial intelligence, in particular knowledge representation, learning, spatial cognition, and robotics.