Topic Constructve Thry Markov Chain - Softcover

Fayolle, G.

Softcover

ISBN 10: 0521064473 ISBN 13: 9780521064477

Publisher: Cambridge University Press, 2008

Synopsis

Markov chains are an important idea, related to random walks, which crops up widely in applied stochastic analysis. They are used, for example, in performance modelling and evaluation of computer networks, queuing networks, and telecommunication systems. The main point of the present book is to provide methods, based on the construction of Lyapunov functions, of determining when a Markov chain is ergodic, null recurrent, or transient. These methods can also be extended to the study of questions of stability. Of particular concern are reflected random walks and reflected Brownian motion. The authors provide not only a self-contained introduction to the theory but also details of how the required Lyapunov functions are constructed in various situations.

About this title

Review

Review of the hardback: 'The monograph is an excellent piece of work that gives an original and alternative view on countable Markov chains.' Mededelingen van het Wiskundig Genootschap

Book Description

The main point of the present book is to provide methods of analysing Markov chains based on Lyapunov functions. The authors provide not only a self-contained introduction to the theory but also details of how the required Lyapunov functions are constructed in various situations.

Edition details

• Publisher: Cambridge University Press
• Publication date: 2008
• Language: English
• ISBN 10: 0521064473
• ISBN 13: 9780521064477
• Binding: Paperback
• Edition number: 1
• Number of pages: 180