Controlled Markov Processes

Dynkin, E. B.; Yushkevich, A. A.

ISBN 10: 1461567483 / ISBN 13: 9781461567486

Published by Springer, 2012

New. Delivery takes 25-30 days. Excellent Customer Service. Seller Inventory # POD-68566

Synopsis:

This book is devoted to the systematic exposition of the contemporary theory of controlled Markov processes with discrete time parameter or in another termi­ nology multistage Markovian decision processes. We discuss the applications of this theory to various concrete problems. Particular attention is paid to mathe­ matical models of economic planning, taking account of stochastic factors. The authors strove to construct the exposition in such a way that a reader interested in the applications can get through the book with a minimal mathe­ matical apparatus. On the other hand, a mathematician will find, in the appropriate chapters, a rigorous theory of general control models, based on advanced measure theory, analytic set theory, measurable selection theorems, and so forth. We have abstained from the manner of presentation of many mathematical monographs, in which one presents immediately the most general situation and only then discusses simpler special cases and examples. Wishing to separate out difficulties, we introduce new concepts and ideas in the simplest setting, where they already begin to work. Thus, before considering control problems on an infinite time interval, we investigate in detail the case of the finite interval. Here we first study in detail models with finite state and action spaces-a case not requiring a departure from the realm of elementary mathematics, and at the same time illustrating the most important principles of the theory.

Bibliographic Details

Title: Controlled Markov Processes
Publisher: Springer
Publication Date: 2012
Binding: Soft cover
Condition: Brand New