16.410 | Fall 2010 | Undergraduate

Principles of Autonomy and Decision Making

Syllabus

Learning Objectives and Assessment

Learning Objectives

Be able to: 1) model decision making problems using major modeling formalisms of artificial intelligence and operations research, including propositional logic, constraints, linear programs and Markov processes, 2) evaluate the computational performance of search, satisfaction, optimization and learning algorithms. 3) apply search, satisfaction, optimization and learning algorithms to real world problems.

Measurable Outcomes (Assessment Method)

Upon successful completion of 16.410, students will be able to:

  1. Describe at an intuitive level the process of artificial intelligence and operations research: a real-time cycle of problem understanding, formulation, solution and implementation (homework).
  2. Formulate simple reasoning, learning and optimization problems, in terms of the representations and methods presented (homework, quiz).
  3. Manipulate the basic mathematical structures underlying these methods, such as system state, search trees, plan spaces, model theory, propositional logic, constraint systems, Markov decision processes, decision trees, linear programs and integer programs (homework, quiz).
  4. Demonstrate the hand execution of basic reasoning and optimization algorithms on simple problems (homework, quiz).
  5. Formulate more complex, but still relatively simple problems, and apply implementations of selected algorithms to solve these problems (homework, lab).
  6. Evaluate analytically the limitations of these algorithms, and assess tradeoffs between these algorithms (homework, quiz).

Concepts

Search and Reasoning: uninformed and informed search, game theory, stochastic search, constraint satisfaction, propositional inference, activity and motion planning and model-based diagnosis, Markov decision processes and hidden Markov models (HMM).

Optimization: Linear programming, integer programming, and finite domain constraint optimization,

Learning: reinforcement learning, conflict learning and HMM learning.

Course Info

Learning Resource Types
Problem Sets
Exams
Lecture Notes
Design Assignments
Programming Assignments with Examples