Title
Algorithmic Analysis of Qualitative and Quantitative Termination Problems for Affine Probabilistic Programs
Abstract
In this article, we consider the termination problem of probabilistic programs with real-valued variables. The questions concerned are: qualitative ones that ask (i) whether the program terminates with probability 1 (almost-sure termination) and (ii) whether the expected termination time is finite (finite termination); and quantitative ones that ask (i) to approximate the expected termination time (expectation problem) and (ii) to compute a bound B such that the probability not to terminate after B steps decreases exponentially (concentration problem). To solve these questions, we utilize the notion of ranking supermartingales, which is a powerful approach for proving termination of probabilistic programs. In detail, we focus on algorithmic synthesis of linear ranking-supermartingales over affine probabilistic programs (Apps) with both angelic and demonic non-determinism. An important subclass of Apps is LRApp which is defined as the class of all Apps over which a linear ranking-supermartingale exists.Our main contributions are as follows. Firstly, we show that the membership problem of LRApp (i) can be decided in polynomial time for Apps with at most demonic non-determinism, and (ii) is NP-hard and in PSPACE for Apps with angelic non-determinism. Moreover, the NP-hardness result holds already for Apps without probability and demonic non-determinism. Secondly, we show that the concentration problem over LRApp can be solved in the same complexity as for the membership problem of LRApp. Finally, we show that the expectation problem over LRApp can be solved in 2EXPTIME and is PSPACE-hard even for Apps without probability and non-determinism (i.e., deterministic programs). Our experimental results demonstrate the effectiveness of our approach to answer the qualitative and quantitative questions over Apps with at most demonic non-determinism.
Year
DOI
Venue
2015
10.1145/3174800
ACM Trans. Program. Lang. Syst.
Keywords
Field
DocType
Probabilistic programs,termination,ranking supermartingale,concentration
Affine transformation,Ask price,Ranking,Computer science,Determinism,Theoretical computer science,PSPACE,Probabilistic logic,Membership problem,Time complexity
Journal
Volume
Issue
ISSN
abs/1510.08517
2
0164-0925
Citations 
PageRank 
References 
26
0.70
16
Authors
4
Name
Order
Citations
PageRank
Krishnendu Chatterjee12179162.09
Hongfei Fu2878.32
Petr Novotný3463.35
rouzbeh hasheminezhad4260.70