Numerical Methods for Stochastic Control Problems in Continuous Time

Changes in the second edition. The second edition differs from the first in that there is a full development of problems where the variance of the diffusion term and the jump distribution can be controlled. Also, a great deal of new material concerning deterministic problems has been added, includin...

Full description

Bibliographic Details
Main Authors: Kushner, Harold, Dupuis, Paul G. (Author)
Format: eBook
Language:English
Published: New York, NY Springer New York 2001, 2001
Edition:2nd ed. 2001
Series:Stochastic Modelling and Applied Probability
Subjects:
Online Access:
Collection: Springer Book Archives -2004 - Collection details see MPG.ReNa
LEADER 03382nmm a2200361 u 4500
001 EB000620833
003 EBX01000000000000000473915
005 00000000000000.0
007 cr|||||||||||||||||||||
008 140122 ||| eng
020 |a 9781461300076 
100 1 |a Kushner, Harold 
245 0 0 |a Numerical Methods for Stochastic Control Problems in Continuous Time  |h Elektronische Ressource  |c by Harold Kushner, Paul G. Dupuis 
250 |a 2nd ed. 2001 
260 |a New York, NY  |b Springer New York  |c 2001, 2001 
300 |a XII, 476 p  |b online resource 
505 0 |a Review of Continuous Time Models -- Controlled Markov Chains -- Dynamic Programming Equations -- Markov Chain Approximation Method -- The Approximating Markov Chains -- Computational Methods -- The Ergodic Cost Problem -- Heavy Traffic and Singular Control -- Weak Convergence and the Characterization of Processes -- Convergence Proofs -- Convergence Proofs Continued -- Finite Time and Filtering Problems -- Controlled Variance and Jumps -- Problems from the Calculus of Variations: Finite Time Horizon -- Problems from the Calculus of Variations: Infinite Time Horizon -- The Viscosity Solution Approach 
653 |a Calculus of Variations and Optimization 
653 |a Control theory 
653 |a Systems Theory, Control 
653 |a Probability Theory 
653 |a System theory 
653 |a Mathematical optimization 
653 |a Calculus of variations 
653 |a Probabilities 
700 1 |a Dupuis, Paul G.  |e [author] 
041 0 7 |a eng  |2 ISO 639-2 
989 |b SBA  |a Springer Book Archives -2004 
490 0 |a Stochastic Modelling and Applied Probability 
028 5 0 |a 10.1007/978-1-4613-0007-6 
856 4 0 |u https://doi.org/10.1007/978-1-4613-0007-6?nosfx=y  |x Verlag  |3 Volltext 
082 0 |a 519.2 
520 |a Changes in the second edition. The second edition differs from the first in that there is a full development of problems where the variance of the diffusion term and the jump distribution can be controlled. Also, a great deal of new material concerning deterministic problems has been added, including very efficient algorithms for a class of problems of wide current interest. This book is concerned with numerical methods for stochastic control and optimal stochastic control problems. The random process models of the controlled or uncontrolled stochastic systems are either diffusions or jump diffusions. Stochastic control is a very active area of research and new problem formulations and sometimes surprising applications appear regu­ larly. We have chosen forms of the models which cover the great bulk of the formulations of the continuous time stochastic control problems which have appeared to date. The standard formats are covered, but much emphasis is given to the newer and less well known formulations. The controlled process might be either stopped or absorbed on leaving a constraint set or upon first hitting a target set, or it might be reflected or "projected" from the boundary of a constraining set. In some of the more recent applications of the reflecting boundary problem, for example the so-called heavy traffic approximation problems, the directions of reflection are actually discontin­ uous. In general, the control might be representable as a bounded function or it might be of the so-called impulsive or singular control types