Abstract: Using Markov decision processes on abstract level, one can compactly and declaratively represent complex Markov decision processes. And one can solve real-world problems that generally have very large state space with regular MDPs. This paper introduces c

Key words: Situation calculus, Factored Markov decision processes, Logical Markov decision processes, Relational Markov decision processes, Bellman equations