Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6. 111-Introductory Digital Systems Laboratory Project suggestions In past years, a great variety of projects have been successfully completed. The following is a list of some of these completed final project reports

Markov Decision Processes and Reinforcement Learning · Motivation earning policies through reinforcement Q values

Robot Localization using SIR Take sample set X+_11 ll. iterate For each sample xt-1 1) Sample from p(X,1 X+1, a) 2) Attach importance weights

Assignment problem Persons and tasks connected by links Objective: Minimize total task time minutes Carburetor Manny 4 minutes Valves

Integer Programs LP: Maximize 3x1+ 4x2 IP: Maximize 3x1+ 4x2 Subiect to: Subject te

WORLD observations Plant actions P(S sense act Diagnostic Agent Monitors diagnoses AGENT Repairs avoids Probes and tests

Assignment Reading Model-based Diagnosis-Lecture notes Propositional Logic AIMA Chapter 6 Problem set Model-based Diagnosis implementation Propositional Logic 16.413: Hello World implementation Due Monday, November 17th

Histol · Kautz and selman.1992 Inspired by improvements in satisfiabity algorithms Big Idea Encode planning problem as a(very large) logical formula Initial-state all-possible-actions goal Find a satisfying assignment to action-time propositions, and we have a plan

Solving CsPs Solving CSPs involves some combination of 1. Constraint propagation eliminates values that cant be part of any solution 2. Search explores valid assignments Arc Consistency Arc consistency eliminates values of each variable domain that

Out line Propositional Satisfiability Propositional Clauses Backtrack search Unit Propagation DPLL: Unit Propagation Backtrack Search Characteristics of dPLl local search using GSAT Propositional Clauses