Reinforcement Learning for Sequential Decision and Optimal Control

The purpose of the book is to help researchers and practitioners take a comprehensive view of RL and understand the in-depth connection between RL and optimal control. The book includes not only systematic and thorough explanations of theoretical basics but also methodical guidance of practical algo...

Full description

Bibliographic Details
Main Author: Li, Shengbo Eben
Format: eBook
Language:English
Published: Singapore Springer Nature Singapore 2023, 2023
Edition:1st ed. 2023
Subjects:
Online Access:
Collection: Springer eBooks 2005- - Collection details see MPG.ReNa
LEADER 04598nmm a2200421 u 4500
001 EB002156126
003 EBX01000000000000001294252
005 00000000000000.0
007 cr|||||||||||||||||||||
008 230505 ||| eng
020 |a 9789811977848 
100 1 |a Li, Shengbo Eben 
245 0 0 |a Reinforcement Learning for Sequential Decision and Optimal Control  |h Elektronische Ressource  |c by Shengbo Eben Li 
250 |a 1st ed. 2023 
260 |a Singapore  |b Springer Nature Singapore  |c 2023, 2023 
300 |a XXX, 462 p. 217 illus., 213 illus. in color  |b online resource 
505 0 |a Chapter 1 Introduction of Reinforcement Learning -- Chapter 2 Principles of RL Problems -- Chapter 3 Model-free Indirect RL: Monte Carlo -- Chapter 4 Model-Free Indirect RL: Temporal-Difference -- Chapter 5 Model-based Indirect RL: Dynamic Programming -- Chapter 6 Indirect RL with Function Approximation -- Chapter 7 Direct RL with Policy Gradient -- Chapter 8 Infinite Horizon Approximate Dynamic Programming -- Chapter 9 Finite Horizon ADP and State Constraints -- Chapter 10 Deep Reinforcement Learning -- Chapter 11 Advanced RL Topics 
653 |a Machine learning 
653 |a Control, Robotics, Automation 
653 |a Engineering mathematics 
653 |a Machine Learning 
653 |a Computational intelligence 
653 |a Control theory 
653 |a Systems Theory, Control 
653 |a Computational Intelligence 
653 |a System theory 
653 |a Control engineering 
653 |a Robotics 
653 |a Engineering Mathematics 
653 |a Automation 
041 0 7 |a eng  |2 ISO 639-2 
989 |b Springer  |a Springer eBooks 2005- 
028 5 0 |a 10.1007/978-981-19-7784-8 
856 4 0 |u https://doi.org/10.1007/978-981-19-7784-8?nosfx=y  |x Verlag  |3 Volltext 
082 0 |a 006.31 
520 |a The purpose of the book is to help researchers and practitioners take a comprehensive view of RL and understand the in-depth connection between RL and optimal control. The book includes not only systematic and thorough explanations of theoretical basics but also methodical guidance of practical algorithm implementations. The book intends to provide a comprehensive coverage of both classic theories and recent achievements, and the content is carefully and logically organized, including basic topics such as the main concepts and terminologies of RL, Markov decision process (MDP), Bellman’s optimality condition, Monte Carlo learning, temporal difference learning, stochastic dynamic programming, function approximation, policy gradient methods, approximate dynamic programming, and deep RL, as well as the latest advances in action and state constraints, safety guarantee, reference harmonization, robust RL, partially observable MDP, multiagent RL, inverse RL, offline RL, and so on 
520 |a As an interdisciplinary field of trial-and-error learning and optimal control, RL resembles how humans reinforce their intelligence by interacting with the environment and provides a principled solution for sequential decision making and optimal control in large-scale and complex problems. Since RL contains a wide range of new concepts and theories, scholars may be plagued by a number of questions: What is the inherent mechanism of reinforcement learning? What is the internal connection between RL and optimal control? How has RL evolved in the past few decades, and what are the milestones? How do we choose and implement practical and effective RL algorithms for real-world scenarios? What are the key challenges that RL faces today, and how can we solve them? What is the current trend of RL research? You can find answers to all those questions in this book.  
520 |a Have you ever wondered how AlphaZero learns to defeat the top human Go players? Do you have any clues about how an autonomous driving system can gradually develop self-driving skills beyond normal drivers? What is the key that enables AlphaStar to make decisions in Starcraft, a notoriously difficult strategy game that has partial information and complex rules? The core mechanism underlying those recent technical breakthroughs is reinforcement learning (RL), a theory that can help an agent to develop the self-evolution ability through continuing environment interactions. In the past few years, the AI community has witnessed phenomenal success of reinforcement learning in various fields, including chess games, computer games and robotic control. RL is also considered to be a promising and powerful tool to create general artificial intelligence in the future.