Items related to Markov Decision Processes: Discrete Stochastic Dynamic...

Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley Series in Probability and Statistics) - Hardcover

 
9780471619772: Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley Series in Probability and Statistics)

Synopsis

A Markov chain is a sequence of events where the probability of each event is dependent on the event immediately preceding it, but independent of earlier events. Models and numerical equations are used to describe the patterns. This process is particularly useful in operations research and decision science for plotting the sequence of actions which will cause a system to perform optimally. This study provides a unified treatment of the theory, applications and computational methods for Markov decision processes. Important topics featured include action elimination methods, value iteration in the average reward case and sensitive discount optimality.

"synopsis" may belong to another edition of this title.

From the Author

1995 INFORMS Lanchester Prize Recipient

This book received the 1995 INFORMS Lanchester Prize as the best English language publication in operations research. I have used it in my course several times; a course outline is available on my web site. If you have any questions or comments about it please contact me.

From the Back Cover

The Wiley–Interscience Paperback Series consists of selected books that have been made more accessible to consumers in an effort to increase global appeal and general circulation. With these new unabridged softcover volumes, Wiley hopes to extend the lives of these works by making them available to future generations of statisticians, mathematicians, and scientists.

"This text is unique in bringing together so many results hitherto found only in part in other texts and papers. . . . The text is fairly self–contained, inclusive of some basic mathematical results needed, and provides a rich diet of examples, applications, and exercises. The bibliographical material at the end of each chapter is excellent, not only from a historical perspective, but because it is valuable for researchers in acquiring a good perspective of the MDP research potential."
Zentralblatt fur Mathematik

". . . it is of great value to advanced–level students, researchers, and professional practitioners of this field to have now a complete volume (with more than 600 pages) devoted to this topic. . . . Markov Decision Processes: Discrete Stochastic Dynamic Programming represents an up–to–date, unified, and rigorous treatment of theoretical and computational aspects of discrete–time Markov decision processes."
Journal of the American Statistical Association

"About this title" may belong to another edition of this title.

Buy Used

Condition: As New
mine is newish, yet pre owned;...
View this item

£ 29.27 shipping from U.S.A. to United Kingdom

Destination, rates & speeds

Buy New

View this item

£ 21.95 shipping from U.S.A. to United Kingdom

Destination, rates & speeds

Other Popular Editions of the Same Title

9780471727828: Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley Series in Probability and Statistics)

Featured Edition

ISBN 10:  0471727822 ISBN 13:  9780471727828
Publisher: Wiley-Interscience, 2005
Softcover

Search results for Markov Decision Processes: Discrete Stochastic Dynamic...

Stock Image

Puterman, Martin L.
Published by Wiley-Interscience, 1994
ISBN 10: 0471619779 ISBN 13: 9780471619772
Used Hardcover First Edition

Seller: BooXX in Stock, Dekalb, IL, U.S.A.

Seller rating 5 out of 5 stars 5-star rating, Learn more about seller ratings

Hardcover. Condition: As New. 1st Edition. mine is newish, yet pre owned; shelved, loved; all super clean: no writing no notes; 649 pages, tight; BOLD gilt on cover and on spine; I ship anywhere you like; no jacket; Seller Inventory # 004856

Contact seller

Buy Used

£ 151.48
Convert currency
Shipping: £ 29.27
From U.S.A. to United Kingdom
Destination, rates & speeds

Quantity: 1 available

Add to basket

Stock Image

Puterman, Martin L.
Published by Wiley-Interscience (edition 1), 1994
ISBN 10: 0471619779 ISBN 13: 9780471619772
Used Hardcover

Seller: BooksRun, Philadelphia, PA, U.S.A.

Seller rating 5 out of 5 stars 5-star rating, Learn more about seller ratings

Hardcover. Condition: Good. 1. Ship within 24hrs. Satisfaction 100% guaranteed. APO/FPO addresses supported. Seller Inventory # 0471619779-11-1

Contact seller

Buy Used

£ 238.05
Convert currency
Shipping: £ 4.38
From U.S.A. to United Kingdom
Destination, rates & speeds

Quantity: 1 available

Add to basket

Stock Image

Puterman Martin, L.:
Published by John Wiley & Sons Inc, 1994
ISBN 10: 0471619779 ISBN 13: 9780471619772
Used Hardcover

Seller: Studibuch, Stuttgart, Germany

Seller rating 5 out of 5 stars 5-star rating, Learn more about seller ratings

hardcover. Condition: Gut. 672 Seiten; 9780471619772.3 Gewicht in Gramm: 2. Seller Inventory # 912870

Contact seller

Buy Used

£ 357.24
Convert currency
Shipping: £ 30.92
From Germany to United Kingdom
Destination, rates & speeds

Quantity: 1 available

Add to basket

Stock Image

Puterman, Martin L.
Published by Wiley-Interscience, 1994
ISBN 10: 0471619779 ISBN 13: 9780471619772
Used Hardcover

Seller: dsmbooks, Liverpool, United Kingdom

Seller rating 4 out of 5 stars 4-star rating, Learn more about seller ratings

hardcover. Condition: Good. Good. book. Seller Inventory # D8S0-3-M-0471619779-6

Contact seller

Buy Used

£ 479.25
Convert currency
Shipping: £ 9
Within United Kingdom
Destination, rates & speeds

Quantity: 1 available

Add to basket

Stock Image

Puterman, Martin L.
Published by Wiley-Interscience, 1994
ISBN 10: 0471619779 ISBN 13: 9780471619772
New Hardcover

Seller: Toscana Books, AUSTIN, TX, U.S.A.

Seller rating 5 out of 5 stars 5-star rating, Learn more about seller ratings

Hardcover. Condition: new. Excellent Condition.Excels in customer satisfaction, prompt replies, and quality checks. Seller Inventory # Scanned0471619779

Contact seller

Buy New

£ 668.36
Convert currency
Shipping: £ 21.95
From U.S.A. to United Kingdom
Destination, rates & speeds

Quantity: 1 available

Add to basket