Markov Chains Gibbs Fields, Monte Carlo Simulation and Queues

This 2nd edition is a thoroughly revised and augmented version of the book with the same title published in 1999. The author begins with the elementary theory of Markov chains and very progressively brings the reader to more advanced topics. He gives a useful review of probability, making the book s...

Full description

Bibliographic Details
Main Author: Brémaud, Pierre
Format: eBook
Language:English
Published: Cham Springer International Publishing 2020, 2020
Edition:2nd ed. 2020
Series:Texts in Applied Mathematics
Subjects:
Online Access:
Collection: Springer eBooks 2005- - Collection details see MPG.ReNa
LEADER 03289nmm a2200325 u 4500
001 EB001897517
003 EBX01000000000000001060522
005 00000000000000.0
007 cr|||||||||||||||||||||
008 200604 ||| eng
020 |a 9783030459826 
100 1 |a Brémaud, Pierre 
245 0 0 |a Markov Chains  |h Elektronische Ressource  |b Gibbs Fields, Monte Carlo Simulation and Queues  |c by Pierre Brémaud 
250 |a 2nd ed. 2020 
260 |a Cham  |b Springer International Publishing  |c 2020, 2020 
300 |a XVI, 557 p. 93 illus  |b online resource 
505 0 |a Preface -- 1 Probability Review -- 2 Discrete-Time Markov Chains -- 3 Recurrence and Ergodicity -- 4 Long-Run Behavior -- 5 Discrete-Time Renewal Theory -- 6 Absorption and Passage Times -- 7 Lyapunov Functions and Martingales -- 8 Random Walks on Graphs -- 9 Convergence Rates -- 10 Markov Fields on Graphs -- 11 Monte Carlo Markov Chains -- 12 Non-homogeneous Markov Chains -- 13 Continuous-Time Markov Chains -- 14 Markovian Queueing Theory -- Appendices -- Bibliography -- Index 
653 |a Operations research 
653 |a Electrical and Electronic Engineering 
653 |a Electrical engineering 
653 |a Probability Theory 
653 |a Operations Research and Decision Theory 
653 |a Probabilities 
041 0 7 |a eng  |2 ISO 639-2 
989 |b Springer  |a Springer eBooks 2005- 
490 0 |a Texts in Applied Mathematics 
028 5 0 |a 10.1007/978-3-030-45982-6 
856 4 0 |u https://doi.org/10.1007/978-3-030-45982-6?nosfx=y  |x Verlag  |3 Volltext 
082 0 |a 519.2 
520 |a This 2nd edition is a thoroughly revised and augmented version of the book with the same title published in 1999. The author begins with the elementary theory of Markov chains and very progressively brings the reader to more advanced topics. He gives a useful review of probability, making the book self-contained, and provides an appendix with detailed proofs of all the prerequisites from calculus, algebra, and number theory. A number of carefully chosen problems of varying difficulty are proposed at the close of each chapter, and the mathematics is slowly and carefully developed, in order to make self-study easier. The book treats the classical topics of Markov chain theory, both in discrete time and continuous time, as well as connected topics such as finite Gibbs fields, nonhomogeneous Markov chains, discrete-time regenerative processes, Monte Carlo simulation, simulated annealing, and queuing theory. The main additions of the 2nd editionare the exact sampling algorithm of Propp and Wilson, the electrical network analogy of symmetric random walks on graphs, mixing times and additional details on the branching process. The structure of the book has been modified in order to smoothly incorporate this new material. Among the features that should improve reader-friendliness, the three main ones are: a shared numbering system for the definitions, theorems and examples; the attribution of titles to the examples and exercises; and the blue highlighting of important terms. The result is an up-to-date textbook on stochastic processes. Students and researchers in operations research and electrical engineering, as well as in physics and biology, will find it very accessible and relevant