Artificial Intelligence (CS 5300/CS 6300)

Artificial Intelligence
CS 5300/CS 6300
Spring 2013

Schedule:	Tue/Thr 12:25-1:45pm
Location:	WEB L110
Instructor:	Jur van den Berg (berg@cs.utah.edu)
Textbook:	S. Russell, P. Norvig. Artificial Intelligence: a Modern Approach, 3rd edition.
Office Hours:	MEB 3126; Tue/Thr 1:45pm-3pm, or by appointment
Mailing list:	cs5300@list.eng.utah.edu -- Subscribe (but don't post)! teach-cs5300@list.eng.utah.edu -- Post (but don't subscribe)!
TA:	Brig Bagley (office hours: Mon/Wed 10:30am-11.30am, MEB 3115) brig.bagley@gmail.com Namrata Dey (office hours: Fri 12:00pm-1.00pm, MEB 3115) namrata@cs.utah.edu

Links: [Course information] [Homework] [Projects] [Slides] [Grades] [FAQ]

This syllabus is subject to change. In the readings, RN refers to Russell and Norvig, SB to Sutton and Barton

Date Topics Readings Due Notes

T 8 Jan Introduction to AI opt: RN 1.1,2

Agents

H 10 Jan Search I
Depth and breadth first search 3.1,3.3,3.4
opt: RN 3.2

T 15 Jan Search II
A* Search and Heuristics 3.5-3.6
opt: RN 4.1-4.2

H 17 Jan Search III
Anytime A* Search ANA* paper P0

T 22 Jan Constraint Satisfaction
Search and iterative algorithms RN 6-6.3 HW01 SOL01

H 24 Jan Game Playing I
Minimax search RN 5-5.3

T 29 Jan Game Playing II
Expectimax search RN 5.4-5.5

H 31 Jan Utility
Consistency and risk 16-16.3
opt: RN 16.4 HW02 SOL02

Reinforcement Learning

T 5 Feb Markov Decision Processes I
Value iteration RN 17.1-2
SB 3, 4.4 P1

H 7 Feb Markov Decision Processes II
Policy iteration RN 17.3
SB 4.1-3 HW03 SOL03

T 12 Feb Reinforcement Learning I
TD-learning RN 21.1-2
SB 6.1-4

H 14 Feb Reinforcement Learning II
Q-learning RN 21.3
SB 6.5 HW04 SOL04

T 19 Feb Reinforcement Learning III
Functional approximation RN 21.4-5
SB 8.1,8.2

H 21 Feb TBA
Spare lecture in case of delay P2

T 26 Feb Midterm review HW05
MT2012 SOL05

H 28 Feb Midterm Exam

Reasoning Under Uncertainty

T 5 Mar Midterm Review
Exams returned and explained.

H 7 Mar Probability
Everything you need to know! RN 13-13.5
opt: RN 13.6

10-17 Mar Spring break

T 19 Mar Bayes' Nets I
Representation RN 14-14.4 P3

H 21 Mar Bayes' Nets II
Independence RN 14.4

T 26 Mar Bayes' Nets III
Inference RN 14.5 HW06 SOL06

H 28 Mar Bayes' Nets IV
Sampling RN 14.5

T 2 Apr Hidden Markov Models I
Bayesian filtering RN 15.1-3

H 4 Apr Hidden Markov Models II
Particle Filtering RN 15.4-5

POMDPs

T 9 Apr Partially-Observable Markov Decision Processes I
Representation, relation to MDPs HW07
P4 SOL07

H 11 Apr Partially-Observable Markov Decision Processes II
Value iteration

T 16 Apr Partially-Observable Markov Decision Processes III
Sampling

H 18 Apr POMDP for Continuous Spaces
Iteration towards a local optimum IJRR paper HW08 SOL08

T 23 Apr Final Exam Review 2012 Final

W 1 May FINAL EXAM
10:30 am - 12:30 pm (WEB L110) P5 due Wednesday night
(Wed 1 May, 11:59pm)

Date	Topics	Readings	Due	Notes
T 8 Jan	Introduction to AI	opt: RN 1.1,2
Agents
H 10 Jan	Search I Depth and breadth first search	3.1,3.3,3.4 opt: RN 3.2
T 15 Jan	Search II A* Search and Heuristics	3.5-3.6 opt: RN 4.1-4.2
H 17 Jan	Search III Anytime A* Search	ANA* paper	P0
T 22 Jan	Constraint Satisfaction Search and iterative algorithms	RN 6-6.3	HW01	SOL01
H 24 Jan	Game Playing I Minimax search	RN 5-5.3
T 29 Jan	Game Playing II Expectimax search	RN 5.4-5.5
H 31 Jan	Utility Consistency and risk	16-16.3 opt: RN 16.4	HW02	SOL02
Reinforcement Learning
T 5 Feb	Markov Decision Processes I Value iteration	RN 17.1-2 SB 3, 4.4	P1
H 7 Feb	Markov Decision Processes II Policy iteration	RN 17.3 SB 4.1-3	HW03	SOL03
T 12 Feb	Reinforcement Learning I TD-learning	RN 21.1-2 SB 6.1-4
H 14 Feb	Reinforcement Learning II Q-learning	RN 21.3 SB 6.5	HW04	SOL04
T 19 Feb	Reinforcement Learning III Functional approximation	RN 21.4-5 SB 8.1,8.2
H 21 Feb	TBA Spare lecture in case of delay		P2
T 26 Feb	Midterm review		HW05 MT2012	SOL05
H 28 Feb	Midterm Exam
Reasoning Under Uncertainty
T 5 Mar	Midterm Review Exams returned and explained.
H 7 Mar	Probability Everything you need to know!	RN 13-13.5 opt: RN 13.6
10-17 Mar	Spring break
T 19 Mar	Bayes' Nets I Representation	RN 14-14.4	P3
H 21 Mar	Bayes' Nets II Independence	RN 14.4
T 26 Mar	Bayes' Nets III Inference	RN 14.5	HW06	SOL06
H 28 Mar	Bayes' Nets IV Sampling	RN 14.5
T 2 Apr	Hidden Markov Models I Bayesian filtering	RN 15.1-3
H 4 Apr	Hidden Markov Models II Particle Filtering	RN 15.4-5
POMDPs
T 9 Apr	Partially-Observable Markov Decision Processes I Representation, relation to MDPs		HW07 P4	SOL07
H 11 Apr	Partially-Observable Markov Decision Processes II Value iteration
T 16 Apr	Partially-Observable Markov Decision Processes III Sampling
H 18 Apr	POMDP for Continuous Spaces Iteration towards a local optimum	IJRR paper	HW08	SOL08
T 23 Apr	Final Exam Review		2012 Final
W 1 May	FINAL EXAM 10:30 am - 12:30 pm (WEB L110)		P5 due Wednesday night (Wed 1 May, 11:59pm)