POMDP.org
POMDP Example Domains
Tony's POMDP File Repository Page
This page contains links to download various POMDP parameter files that have appeared in the literature. A description of the format of these files can be found on the POMDP File Format Page, with the corrresponding more formal POMDP File Grammar Page
Problems from the literature
ejs.tar.gz
Examples from Ed Sondik's 1971 thesis and OR papers
cheng-examples.tar.gz
Hsien-Te Cheng's 1988 thesis examples
tiger.aaai.POMDP
Cassandra, Littman and Kaelbling's AAAI-94 Tiger problem
1d.POMDP
Littman's 1D maze
4x3.95.POMDP
Russell and Norvig's 4x3 maze
cheese.95.POMDP
McCallum's cheese maze
shuttle.95.POMDP
Chrisman's shuttle docking problem
mini-hall2.POMDP
Navigation problem from Littman, Cassandra and Kaelbling's ML-95 paper
hallway.POMDP.gz
Navigation problem from Littman, Cassandra and Kaelbling's ML-95 paper
hallway2.POMDP.gz
Navigation problem from Littman, Cassandra and Kaelbling's ML-95 paper
tiger-grid.POMDP.gz
Navigation problem from Littman, Cassandra and Kaelbling's ML-95 paper
parr95.95.POMDP
This example is from Parr and Russell's paper on the SPOVA RL algorithm from IJCAI'95.
paint.95.POMDP
Part painting problem inspired by the Buridan planner paper example
4x4.95.POMDP
Cassandra, Littman and Kaelibling's AAAI-94 4x4 grid
network.POMDP
Littman's network problem
bridge-repair.POMDP.gz
A bridge inspection and repair problem of Hugh Ellis, et al.
cit.POMDP.gz
Hallway navigation problem from Cassandra, Kurien and Kaelbling's IROS-96 paper
mit.POMDP.gz
Hallway navigation problems from Cassandra, Kurien and Kaelbling's IROS-96 paper
sunysb.POMDP.gz
Hallway navigation problem from Cassandra, Kurien and Kaelbling's IROS-96 paper
pentagon.POMDP.gz
Hallway navigation problem from Cassandra, Kurien and Kaelbling's IROS-96 paper
fourth.POMDP.gz
Hallway navigation problem from Cassandra, Kurien and Kaelbling's IROS-96 paper
milos-aaai97.POMDP.gz
20 state maze from Milos Hauskrecht's AAAI-97 paper.
Other Problems
1d.noisy.POMDP
Noisy transition version of Littman's 1D maze
concert.POMDP
Michael Littman's concert problem
tiger.95.POMDP
Version of AAAI-94 Tiger problem with 0.95 discount factor (instead of 0.75)
stand-tiger.95.POMDP
Slight extension of the tiger problem
line4-2goals.POMDP
A line of uniquely appearing states with a goal at both ends
4x5x2.95.POMDP.gz
A 2 floor 4x5 navigation problem
bulkhead.A.POMDP.gz
Non-destructive testing problem of a titanium aircraft engine bulkhead
marking.POMDP
One of two versions of a problem proposed by Tom Dean about a robot that can mark its environment.
marking2.POMDP
One of two versions of a problem proposed by Tom Dean about a robot that can mark its environment.
mcc-example1.POMDP
Variations of an example of choosing advertisements for web pages based on user actions (made for MCC job talk)
mcc-example2.POMDP
Variations of an example of choosing advertisements for web pages based on user actions (made for MCC job talk)
web-ad.POMDP
Variations of an example of choosing advertisements for web pages based on user actions (made for MCC job talk)
web-mall-example1.POMDP
Variations of an example of choosing advertisements for web pages based on user actions (made for MCC job talk)
saci-s12-a6-z5.95.POMDP.gz
Aircraft identification problem with 12 states, 6 actions and 5 observations
saci-s100-a10-z31.POMDP.gz
Aircraft identification problem with 100 states, 10 actions and 31 observations
query.s2.POMDP.gz
Problems for distributed querying decisions with 2 resources
query.s3.POMDP.gz
Problems for distributed querying decisions with 3 4 resources
query.s4.POMDP.gz
Problems for distributed querying decisions with 4 resources
learning.c2.POMDP.gz
Problem of teaching policies for trying to learn 2 concepts
learning.c3.POMDP.gz
Problem of teaching policies for trying to learn 3 concepts
learning.c4.POMDP.gz
Problem of teaching policies for trying to learn 4 concepts
Problems from Anthony Cassandra's Ph. D. Thesis
toy-pomdp-probs.tar.gz
Suite of 9 small problems
hallway.POMDP.gz
Hallway (57 state navigation problem
hallway2.POMDP.gz
Hallway-2 (89 state navigation problem
cit.POMDP.gz
Larger Robot Navigation Problem. A coarse model of the fourth floor of the CIT building, Brown University
mit.POMDP.gz
Larger Robot Navigation Problem. Simplified model of the 8th floor of MIT's Computer Science building
sunysb.POMDP.gz
Larger Robot Navigation Problem. First floor of Computer Science building, SUNY at Stony Brook
pentagon.POMDP.gz
Larger Robot Navigation Problem. Inspired by the Pentagon building with an inner and outer hallway
fourth.POMDP.gz
Larger Robot Navigation Problem. A detailed portion of the four floor, CIT building, Brown University.
iff.POMDP.gz
Approaching aircraft identification problem
machine.POMDP.gz
Model of maintenance for a machine with 4 independently failing components
baseball.POMDP.gz
Simple model of 1 inning of a baseball game
aloha.10.POMDP.gz
Slotted Aloha model with a limit of 10 backlogged messages
aloha.30.POMDP.gz
Slotted Aloha model with a limit of 30 backlogged messages