Title
A computational framework for two-dimensional random walks with restarts
Abstract
The treatment of two-dimensional random walks in the quarter plane leads to Markov processes which involve semi-infinite matrices having Toeplitz or block Toeplitz structure plus a low-rank correction. We propose an extension of the framework introduced in [D. A. Bini, S. Massei, and B. Meini, Math. Comp., 87 (2018), pp. 2811-2830] which allows us to deal with more general situations such as processes involving restart events. This is motivated by the need for modeling processes that can incur in unexpected failures like computer system reboots. We present a theoretical analysis of an enriched Banach algebra that, combined with appropriate algorithms, enables the numerical treatment of these problems. The results are applied to the solution of bidimensional quasi-birth-death processes with infinitely many phases which model random walks in the quarter plane, relying on the matrix analytic approach. The reliability of our approach is confirmed by extensive numerical experimentation on several case studies.
Year
DOI
Venue
2020
10.1137/19M1304362
SIAM JOURNAL ON SCIENTIFIC COMPUTING
Keywords
DocType
Volume
random walk,Toeplitz matrix,Markov chains,queueing models,quadratic matrix equations
Journal
42
Issue
ISSN
Citations 
4
1064-8275
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Dario Bini1590108.78
Massei Stefano200.34
Meini Beatrice300.68
Leonardo Robol4307.04