UAI 2019poster10 citations

On the Relationship Between Satisfiability and Markov Decision Processes

Ricardo Salmon, Pascal Poupart

Abstract

Stochastic satisfiability (SSAT) and decision-theoretic planning in finite horizon partially observable Markov decision processes (POMDPs) are both PSPACE-Complete. We describe constructive reductions between SSAT and flat POMDPs that open the door to comparisons and future cross-fertilization between the solution techniques of those problems. We also propose a new SSAT solver called Prime that incorporates recent advances from the SAT and #SAT literature. Using our reduction from POMDP to SSAT, we demonstrate the competitiveness of Prime on finite horizon POMDP problems.

BibTeX
@InProceedings{pmlr-v115-salmon20a,
  title = 	 {On the Relationship Between Satisfiability and Markov Decision Processes},
  author =       {Salmon, Ricardo and Poupart, Pascal},
  booktitle = 	 {Proceedings of The 35th Uncertainty in Artificial Intelligence Conference},
  pages = 	 {1105--1115},
  year = 	 {2020},
  editor = 	 {Adams, Ryan P. and Gogate, Vibhav},
  volume = 	 {115},
  series = 	 {Proceedings of Machine Learning Research},
  month = 	 {22--25 Jul},
  publisher =    {PMLR},
  pdf = 	 {http://proceedings.mlr.press/v115/salmon20a/salmon20a.pdf},
  url = 	 {https://proceedings.mlr.press/v115/salmon20a.html},
  abstract = 	 {Stochastic satisfiability (SSAT) and decision-theoretic planning in finite horizon partially observable Markov decision processes (POMDPs) are both PSPACE-Complete. We describe constructive reductions between SSAT and flat POMDPs that open the door to comparisons and future cross-fertilization between the solution techniques of those problems.  We also propose a new SSAT solver called Prime that incorporates recent advances from the SAT and #SAT literature.  Using our reduction from POMDP to SSAT, we demonstrate the competitiveness of Prime on finite horizon POMDP problems.}
}
On the Relationship Between Satisfiability and Markov Decision Processes · UAI 2019