2013
DOI: 10.1007/978-3-642-39799-8_35
|View full text |Cite
|
Sign up to set email alerts
|

Polynomial-Time Verification of PCTL Properties of MDPs with Convex Uncertainties

Abstract: Abstract. We address the problem of verifying Probabilistic Computation Tree Logic (PCTL) properties of Markov Decision Processes (MDPs) whose state transition probabilities are only known to lie within uncertainty sets. We first introduce the model of Convex-MDPs (CMDPs), i.e., MDPs with convex uncertainty sets. CMDPs generalize Interval-MDPs (IMDPs) by allowing also more expressive (convex) descriptions of uncertainty. Using results on strong duality for convex programs, we then present a PCTL verification a… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

0
22
0

Year Published

2016
2016
2022
2022

Publication Types

Select...
7
2
1

Relationship

0
10

Authors

Journals

citations
Cited by 52 publications
(22 citation statements)
references
References 31 publications
0
22
0
Order By: Relevance
“…Recently, several techniques have been developed [Chatterjee et al 2008;Benedikt et al 2013;Chen et al 2013;Puggelli et al 2013]. Typically, these methods work by determining the extremal values a probabilistic parameter can take.…”
Section: Dealing With Uncertainty In Control Strategies For Adaptationmentioning
confidence: 99%
“…Recently, several techniques have been developed [Chatterjee et al 2008;Benedikt et al 2013;Chen et al 2013;Puggelli et al 2013]. Typically, these methods work by determining the extremal values a probabilistic parameter can take.…”
Section: Dealing With Uncertainty In Control Strategies For Adaptationmentioning
confidence: 99%
“…The once-and-for-all IMC semantics ( [7,19,16]) is alike to the semantics for pMC, as introduced above. The associated satisfaction relation |= o I is defined as follows:…”
Section: Existing MC Abstraction Modelsmentioning
confidence: 99%
“…However, they mostly rely on ordering between intervals which is not needed in our case. Furthermore, Puggelli et al [26] proposed polynomial algorithms for Markov chains with uncertainty based on optimization techniques, but only for reachability and PCTL properties.…”
Section: Related Workmentioning
confidence: 99%