Further topics on discrete-time Markov control processes Onésimo Hernandéz-Lerma, Jean Bernard Lasserre. Applications of mathematics 42.

Hernandez-Lerma, Onesimo; Lasserre, Jean B.

ISBN 10: 0387986944 / ISBN 13: 9780387986944

Published by New York, Springer, 1999

About this Item

Ex-library with stamp and library-signature. GOOD condition, some traces of use. Ancien Exemplaire de bibliothèque avec signature et cachet. BON état, quelques traces d'usure. Ehem. Bibliotheksexemplar mit Signatur und Stempel. GUTER Zustand, ein paar Gebrauchsspuren. 49 HER 9780387986944 Sprache: Englisch Gewicht in Gramm: 1200.

Seller Inventory # 2506545

Bibliographic Details

• Title: Further topics on discrete-time Markov control processes Onésimo Hernandéz-Lerma, Jean Bernard Lasserre. Applications of mathematics 42.
• Publisher: New York, Springer
• Publication Date: 1999
• Language: English
• ISBN 10: 0387986944
• ISBN 13: 9780387986944
• Binding: Hardcover
• Seller catalogs:
  • SA MATHEMATIK

About this title

Synopsis

This book presents the second part of a two-volume series devoted to a sys­ tematic exposition of some recent developments in the theory of discrete­ time Markov control processes (MCPs). As in the first part, hereafter re­ ferred to as "Volume I" (see Hernandez-Lerma and Lasserre [1]), interest is mainly confined to MCPs with Borel state and control spaces, and possibly unbounded costs. However, an important feature of the present volume is that it is essentially self-contained and can be read independently of Volume I. The reason for this independence is that even though both volumes deal with similar classes of MCPs, the assumptions on the control models are usually different. For instance, Volume I deals only with nonnegative cost­ per-stage functions, whereas in the present volume we allow cost functions to take positive or negative values, as needed in some applications. Thus, many results in Volume Ion, say, discounted or average cost problems are not applicable to the models considered here. On the other hand, we now consider control models that typically re­ quire more restrictive classes of control-constraint sets and/or transition laws. This loss of generality is, of course, deliberate because it allows us to obtain more "precise" results. For example, in a very general context, in §4.

Synopsis

This book is devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes. Interest is mainly confined to MCPs with Borel state and control spaces, and possibly unbounded costs. The book follows on from the authors earlier volume in this area, however, an important feature of the present volume is that it is essentially self-contained and can be read independently of the first volume, because although both volumes deal with similar classes of markov control processes the assumptions on the control models are usually different. This volume allows cost functions to take positive or negative values, as needed in some applications. The control model studied is sufficiently general to include virtually all the usual discrete-time stochastic control models that appear in applications to engineering, economics, mathematical population processes, operations research, and management science.