Understanding Markov Chains Examples and Applications
This book provides an undergraduate-level introduction to discrete and continuous-time Markov chains and their applications, with a particular focus on the first step analysis technique and its applications to average hitting times and ruin probabilities. It also discusses classical topics such as r...
| Main Author: | |
|---|---|
| Format: | eBook |
| Language: | English |
| Published: |
Singapore
Springer Nature Singapore
2018, 2018
|
| Edition: | 2nd ed. 2018 |
| Series: | Springer Undergraduate Mathematics Series
|
| Subjects: | |
| Online Access: | |
| Collection: | Springer eBooks 2005- - Collection details see MPG.ReNa |
Table of Contents:
- Probability Background
- Gambling Problems
- Random Walks
- Discrete-Time Markov Chains
- First Step Analysis
- Classification of States
- Long-Run Behavior of Markov Chains
- Branching Processes
- Continuous-Time Markov Chains
- Discrete-Time Martingales
- Spatial Poisson Processes
- Reliability Theory