Discretization and MCMC Convergence Assessment: 135 (Lecture Notes in Statistics, 135) - Softcover

Softcover

ISBN 10: 0387985913 ISBN 13: 9780387985916

Publisher: Springer, 1998

Synopsis

The exponential increase in the use of MCMC methods and the corre­ sponding applications in domains of even higher complexity have caused a growing concern about the available convergence assessment methods and the realization that some of these methods were not reliable enough for all-purpose analyses. Some researchers have mainly focussed on the con­ vergence to stationarity and the estimation of rates of convergence, in rela­ tion with the eigenvalues of the transition kernel. This monograph adopts a different perspective by developing (supposedly) practical devices to assess the mixing behaviour of the chain under study and, more particularly, it proposes methods based on finite (state space) Markov chains which are obtained either through a discretization of the original Markov chain or through a duality principle relating a continuous state space Markov chain to another finite Markov chain, as in missing data or latent variable models. The motivation for the choice of finite state spaces is that, although the resulting control is cruder, in the sense that it can often monitor con­ vergence for the discretized version alone, it is also much stricter than alternative methods, since the tools available for finite Markov chains are universal and the resulting transition matrix can be estimated more accu­ rately. Moreover, while some setups impose a fixed finite state space, other allow for possible refinements in the discretization level and for consecutive improvements in the convergence monitoring.

About this title

Synopsis

This monograph proposes several approaches to convergence monitoring for MCMC algorithms which are centered on the theme of discrete Markov chains. After a short introduction to MCMC methods, including recent developments like perfect simulation and Langevin Metropolis-Hastings algorithms, and to the current convergence diagnostics, the contributors present the theoretical basis for a study of MCMC convergence using discrete Markov chains and their specificities. The contributors stress in particular that this study applies in a wide generality, starting with latent variable models like mixtures, then extending the scope to chains with renewal properties, and concluding with a general Markov chain. They then relate the different connections with discrete or finite Markov chains with practical convergence diagnostics which are either graphical plots (allocation map, divergence graph, variance stabilizing, normality plot), stopping rules (normality, stationarity, stability tests), or confidence bounds (divergence, asymptotic variance, normality). Most of the quantitative tools take advantage of manageable versions of the CLT.

The different methods proposed here are first evaluated on a set of benchmark examples and then studied on three full scale realistic applications, along with the standard convergence diagnostics: A hidden Markov modelling of DNA sequences, including a perfect simulation implementation, a latent stage modelling of the dynamics of HIV infection, and a modelling of hospitalization duration by exponential mixtures. The monograph is the outcome of a monthly research seminar held at CREST, Paris, since 1995. The seminar involved the contributors to this monograph and was led by Christian P. Robert, Head of the Satistics Laboratory at CREST and Professor of Statistics at the University of Rouen since 1992.

Edition details

• Publisher: Springer
• Publication date: 1998
• Language: English
• ISBN 10: 0387985913
• ISBN 13: 9780387985916
• Binding: Paperback
• Number of pages: 203
• Editor: Robert Christian P.