A perturbation theory for ergodic properties of Markov chains

Tony Shardlow, Andrew Stuart

Research output: Contribution to journalArticle

31 Citations (Scopus)
9 Downloads (Pure)

Abstract

Perturbations to Markov chains and Markov processes are considered. The unperturbed problem is assumed to be geometrically ergodic in the sense usually established through the use of Foster--Lyapunov drift conditions. The perturbations are assumed to be uniform, in a weak sense, on bounded time intervals. The long-time behavior of the perturbed chain is studied. Applications are given to numerical approximations of a randomly impulsed ODE, an Itô stochastic differential equation (SDE), and a parabolic stochastic partial differential equation (SPDE) subject to space-time Brownian noise. Existing perturbation theories for geometrically ergodic Markov chains are not readily applicable to these situations since they require very stringent hypotheses on the perturbations.
Original languageEnglish
Pages (from-to)1120-1137
Number of pages18
JournalSIAM Journal on Numerical Analysis (SINUM)
Volume37
Issue number4
DOIs
Publication statusPublished - 1 Jan 2000

Cite this

A perturbation theory for ergodic properties of Markov chains. / Shardlow, Tony; Stuart, Andrew.

In: SIAM Journal on Numerical Analysis (SINUM), Vol. 37, No. 4, 01.01.2000, p. 1120-1137.

Research output: Contribution to journalArticle

@article{bf77e6edf9d1482d88d773f676c13356,
title = "A perturbation theory for ergodic properties of Markov chains",
abstract = "Perturbations to Markov chains and Markov processes are considered. The unperturbed problem is assumed to be geometrically ergodic in the sense usually established through the use of Foster--Lyapunov drift conditions. The perturbations are assumed to be uniform, in a weak sense, on bounded time intervals. The long-time behavior of the perturbed chain is studied. Applications are given to numerical approximations of a randomly impulsed ODE, an It{\^o} stochastic differential equation (SDE), and a parabolic stochastic partial differential equation (SPDE) subject to space-time Brownian noise. Existing perturbation theories for geometrically ergodic Markov chains are not readily applicable to these situations since they require very stringent hypotheses on the perturbations.",
author = "Tony Shardlow and Andrew Stuart",
year = "2000",
month = "1",
day = "1",
doi = "10.1137/S0036142998337235",
language = "English",
volume = "37",
pages = "1120--1137",
journal = "SIAM Journal on Numerical Analysis (SINUM)",
issn = "0036-1429",
publisher = "SIAM",
number = "4",

}

TY - JOUR

T1 - A perturbation theory for ergodic properties of Markov chains

AU - Shardlow, Tony

AU - Stuart, Andrew

PY - 2000/1/1

Y1 - 2000/1/1

N2 - Perturbations to Markov chains and Markov processes are considered. The unperturbed problem is assumed to be geometrically ergodic in the sense usually established through the use of Foster--Lyapunov drift conditions. The perturbations are assumed to be uniform, in a weak sense, on bounded time intervals. The long-time behavior of the perturbed chain is studied. Applications are given to numerical approximations of a randomly impulsed ODE, an Itô stochastic differential equation (SDE), and a parabolic stochastic partial differential equation (SPDE) subject to space-time Brownian noise. Existing perturbation theories for geometrically ergodic Markov chains are not readily applicable to these situations since they require very stringent hypotheses on the perturbations.

AB - Perturbations to Markov chains and Markov processes are considered. The unperturbed problem is assumed to be geometrically ergodic in the sense usually established through the use of Foster--Lyapunov drift conditions. The perturbations are assumed to be uniform, in a weak sense, on bounded time intervals. The long-time behavior of the perturbed chain is studied. Applications are given to numerical approximations of a randomly impulsed ODE, an Itô stochastic differential equation (SDE), and a parabolic stochastic partial differential equation (SPDE) subject to space-time Brownian noise. Existing perturbation theories for geometrically ergodic Markov chains are not readily applicable to these situations since they require very stringent hypotheses on the perturbations.

U2 - 10.1137/S0036142998337235

DO - 10.1137/S0036142998337235

M3 - Article

VL - 37

SP - 1120

EP - 1137

JO - SIAM Journal on Numerical Analysis (SINUM)

JF - SIAM Journal on Numerical Analysis (SINUM)

SN - 0036-1429

IS - 4

ER -