Synopsis
Review of Continuous Time Models.- Controlled Markov Chains.- Dynamic Programming Equations.- Markov Chain Approximation Method.- The Approximating Markov Chains.- Computational Methods.- The Ergodic Cost Problem.- Heavy Traffic and Singular Control.- Weak Convergence and the Characterization of Processes.- Convergence Proofs.- Convergence Proofs Continued.- Finite Time and Filtering Problems.- Controlled Variance and Jumps.- Problems from the Calculus of Variations: Finite Time Horizon.- Problems from the Calculus of Variations: Infinite Time Horizon.- The Viscosity Solution Approach.
"synopsis" may belong to another edition of this title.
