1 Table of Contents: “...Discrete Markov Processes and Numerical Algorithms for Markov Chains -- Markov Decision Processes...”

2 Table of Contents: “... -- Stochastic optimal control problems and Markov decision processes with infinite time horizon -- A game...”

3 Subjects: “...Operations Research and Decision Theory...”