Continuous-Time Markov Chains and Applications A Two-Time-Scale Approach

This book gives a systematic treatment of singularly perturbed systems that naturally arise in control and optimization, queueing networks, manufacturing systems, and financial engineering. It presents results on asymptotic expansions of solutions of Komogorov forward and backward equations, propert...

Full description

Bibliographic Details
Main Authors: Yin, G. George, Zhang, Qing (Author)
Format: eBook
Language:English
Published: New York, NY Springer New York 2013, 2013
Edition:2nd ed. 2013
Series:Stochastic Modelling and Applied Probability
Subjects:
Online Access:
Collection: Springer eBooks 2005- - Collection details see MPG.ReNa
LEADER 03291nmm a2200397 u 4500
001 EB000364561
003 EBX01000000000000000217613
005 00000000000000.0
007 cr|||||||||||||||||||||
008 130626 ||| eng
020 |a 9781461443469 
100 1 |a Yin, G. George 
245 0 0 |a Continuous-Time Markov Chains and Applications  |h Elektronische Ressource  |b A Two-Time-Scale Approach  |c by G. George Yin, Qing Zhang 
250 |a 2nd ed. 2013 
260 |a New York, NY  |b Springer New York  |c 2013, 2013 
300 |a XXII, 430 p  |b online resource 
505 0 |a Prologue and Preliminaries: Introduction and overview- Mathematical preliminaries -- Markovian models -- Two-Time-Scale Markov Chains: Asymptotic Expansions of Solutions for Forward Equations -- Occupation Measures: Asymptotic Properties and Ramification -- Asymptotic Expansions of Solutions for Backward Equations -- Applications:MDPs, Near-optimal Controls, Numerical Methods, and LQG with Switching: Markov Decision Problems -- Stochastic Control of Dynamical Systems -- Numerical Methods for Control and Optimization -- Hybrid LQG Problems -- References -- Index.- 
653 |a Operations Research, Management Science 
653 |a Operations research 
653 |a Engineering mathematics 
653 |a Management science 
653 |a Calculus of Variations and Optimization 
653 |a Probability Theory 
653 |a Engineering / Data processing 
653 |a Mathematical optimization 
653 |a Mathematical and Computational Engineering Applications 
653 |a Calculus of variations 
653 |a Probabilities 
700 1 |a Zhang, Qing  |e [author] 
041 0 7 |a eng  |2 ISO 639-2 
989 |b Springer  |a Springer eBooks 2005- 
490 0 |a Stochastic Modelling and Applied Probability 
028 5 0 |a 10.1007/978-1-4614-4346-9 
856 4 0 |u https://doi.org/10.1007/978-1-4614-4346-9?nosfx=y  |x Verlag  |3 Volltext 
082 0 |a 519.2 
520 |a This book gives a systematic treatment of singularly perturbed systems that naturally arise in control and optimization, queueing networks, manufacturing systems, and financial engineering. It presents results on asymptotic expansions of solutions of Komogorov forward and backward equations, properties of functional occupation measures, exponential upper bounds, and functional limit results for Markov chains with weak and strong interactions. To bridge the gap between theory and applications, a large portion of the book is devoted to  applications in controlled dynamic systems, production planning, and numerical methods for controlled Markovian systems with large-scale and complex structures in the real-world problems. This second edition  has been updated throughout and includes two new chapters on asymptotic expansions of solutions for backward equations and hybrid LQG problems. The chapters on analytic and probabilistic properties of two-time-scale Markov chains have been almost completely rewritten and the notation has been streamlined and simplified. This book is written for applied mathematicians, engineers, operations researchers, and applied scientists. Selected material from the book can also be used for a one semester advanced graduate-level course in applied probability and stochastic processes