Cover Image
Read Now

1
by Ching, Wai-Ki, Huang, Ximin, Ng, Michael K., Siu, Tak-Kuen
Published 2013
Springer US
Table of Contents: “... Classification -- Markov Decision Processes for Customer Lifetime Value -- Higher-order Markov Chains...”
Cover Image
Read Now

2
by Chung, Kai Lai
Published 1967
Springer Berlin Heidelberg
Cover Image
Read Now

3
by Bremaud, Pierre
Published 1999
Springer New York
Table of Contents: “... Behavior -- 5 Lyapunov Functions and Martingales -- 6 Eigenvalues and Nonhomogeneous Markov Chains -- 7...”
Cover Image
Read Now

4
by Douc, Randal, Moulines, Eric, Priouret, Pierre, Soulier, Philippe
Published 2018
Springer International Publishing
Table of Contents: “...Part I Foundations -- Markov Chains: Basic Definitions -- Examples of Markov Chains -- Stopping...”
Cover Image
Read Now

5
by Norris, J. R.
Published 1998
Cambridge University Press
“...Markov chains are central to the understanding of random processes. This is not only because...”
Cover Image
Read Now

6
by Brémaud, Pierre
Published 2020
Springer International Publishing
Table of Contents: “...Preface -- 1 Probability Review -- 2 Discrete-Time Markov Chains -- 3 Recurrence and Ergodicity...”
Cover Image
Read Now

7
by Freedman, David
Published 1983
Springer New York
“...A long time ago I started writing a book about Markov chains, Brownian motion, and diffusion. I...”
Cover Image
Read Now

8
by Revuz, D.
Published 1984
North-Holland
Table of Contents: “...; 4. Renewal theory; CHAPTER 10. CONSTRUCTION OF MARKOV CHAINS AND RESOLVENTS; 1. Preliminaries...”
Cover Image
Read Now

9
by Graham, C.
Published 2014
Wiley-Dunod
Table of Contents: “...; Chapter 1 First steps; 1.1 Preliminaries; 1.2 First properties of Markov chains; 1.2.1 Markov chains...”
Cover Image
Read Now

10
by Hermanns, Holger
Published 2002
Springer-Verlag Berlin Heidelberg
Cover Image
Read Now

11
by Behrends, Ehrhard
Published 2000
Vieweg+Teubner Verlag
“...The aims of this book are threefold: -- We start with a naive description of a Markov chain as a...”
Cover Image
Read Now

12
by Privault, Nicolas
Published 2013
Springer Nature Singapore
Table of Contents: “...-Time Markov Chains -- 5) First Step Analysis -- 6) Classication of States -- 7) Long-Run Behavior...”
Cover Image
Read Now

13
by Kemeny, John G., Snell, J. Laurie, Knapp, Anthony W.
Published 1976
Springer New York
Table of Contents: “... in n Dimensions -- 5. Potential Theory for Denumerable Markov Chains -- 6. Brownian Motion as a Limit...”
Cover Image
Read Now

14
by Privault, Nicolas
Published 2018
Springer Nature Singapore
Table of Contents: “...Probability Background -- Gambling Problems -- Random Walks -- Discrete-Time Markov Chains -- First...”
Cover Image
Read Now

15
by Hermanns, Holger
Published 2002
Springer Berlin Heidelberg
Table of Contents: “...Interactive Processes -- Markov Chains -- Interactive Markov Chains -- Algebra of Interactive...”
Cover Image
Read Now

16
by Bobrowski, Adam
Published 2021
Cambridge University Press
“...Elementary treatments of Markov chains, especially those devoted to discrete-time and finite state...”
Cover Image
Read Now

17
Published 1995
Springer US
Table of Contents: “... solution of Markov chains -- 5 A Parallel Block Projection Method of the Cimmino Type for Finite Markov...”
Cover Image
Read Now

18
by Yin, G. George, Zhang, Qing
Published 2005
Springer New York
“...Focusing on discrete-time-scale Markov chains, the contents of this book are an outgrowth of some...”
Cover Image
Read Now

19
by Hernández-Lerma, Onésimo, Lasserre, Jean B.
Published 2003
Birkhäuser
Table of Contents: “... Convergence of Measures -- 1.5 Complements -- 1.6 Notes -- I Markov Chains and Ergodicity -- 2 Markov Chains...”
Cover Image
Read Now

20
by Sutter, David
Published 2018
Springer International Publishing
Table of Contents: “...Introduction -- Classical Markov chains -- Quantum Markov chains -- Outline -- Preliminaries...”