CS 598, Section EA Decision Making Under Uncertainty University of Illinois, Urbana-Champaign Spring 2005 |

Index: |
Announcements |
Course Information |
Machinery |
Communication |
Textbook |

Announcements |

Course Information |

*
Lecture: 1 unit, TuTh 12:30-1:45PM, 1302 Siebel Center
*

**Professor:** **Eyal Amir**

- Office: Siebel 3314
- Phone: (217) 333-8756
- email: eyal@cs.uiuc.edu
- Office hours: Mon 8:30am-9:30am, Thu 3pm-4pm

**Basic methods:**Fully observed systems: Markov Decision Problems (MDPs), Planning, Reinforcement learning**Basic methods:**Unobserved systems: Unobserved MDPs, Conformant planning, Nondeterministic planning**FOCUS OF CLASS:**Partial observability and sensing actions: Partially Observable MDPs (POMDPs), Planning with sensing, Reinforcement learning in POMDPs**Branch-out topic:**Knowledge in logic (modalities) and probabilities (distributions over distributions)**Branch-out topic:**Adversarial situations: Markov games, Games of partial information

- Familiarity with the basic concepts of logic and probability theory.
- Knowledge of basic computer science principles and skills.
- Knowledge of basic artificial intelligence problems and principles (at least at the level of CS440, and preferably at the level of CS498ea).
- Mathematical ability and the ability to understand and analyze fairly complicated algorithms and data structures. (CS473 is sufficient but not necessary.)
- Independence.

Machinery: Tasks and Coursework |

The course will consist of lectures by the teacher, lectures by
students, and a final project, with the actual consistency depending
on the number of students in the class.
Due dates and recommended projects and papers for presentation
are indicated in the **syllabus**.

The proposals and the final paper must be handed in during the class
on the date indicated in the syllabus. Recognizing that students may
face unusual circumstances and require some flexibility in the course
of the quarter, each student will have a total of **seven** free
late (calendar) days to use as s/he sees fit. Once these late days
are exhausted, any paper or proposal turned in late will be penalized at the
rate of 20% per late day (or fraction thereof). Under no
circumstances will an assignment be accepted more than a week after its
due date. Late days are from noon to noon.

Late assignments should be turned in **at the turn-in box outside my
office**. You **must** write the time and date of submission on
the assignment. Alternatively, you can fax it to the course secretary
(see the fax number above) or email it to
eyal@cs.uiuc.edu.

The final grade will be calculated using the following formula:

0.25*technical paper + 0.25*poster + 0.3*presentation + 0.1*proposal1 + 0.1*proposal2

Up to 3% extra credit may be awarded for class participation.
Bonuses will be given for more ambitious, imaginative, and original work, but standard works that are correct and sufficient will still not be penalized and will receive full credit.

Communication |

I strongly encourage students to come to office hours instead
of emailing questions to me. Also, as explained above, *late*
assignments should be turned in **at the turn-in box outside my
office**. You can also email these assignments to eyal@cs.uiuc.edu.

Please do not e-mail me with grading questions. If you want me to explain why I took points off, you can talk to me after class or during office hours. If you want a regrade, please write an explanation and hand the assignment and the explanation to me during office hours or after class.

Occasionally I may need to broadcast a message to entire class. I will do so over the WebBoard for the class.

Textbooks and Papers Information |

The primary reading materials will be book chapters and papers as described in the syllabus. The main books people can use for this class are (each covers different material)

Useful Links and Resources |

Comments to Eyal Amir |