Project objective: To develop scalable, theoretically sound methods for constructing and updating hierarchical state representations of complex distributed systems Methods/approach: Criteria for hierarchical state representations: 1) information content for actions is high; 2) Markov property holds; 3) uncertainty is low; 4) … Develop algorithms that enforce/approximate these criteria, based on: MDPs, POMDPs, HPOMDPs, DBNs, Utile Distinction methods
{}