Computational Statistics CS 5961/6961


Quick Links:   Class Information  Syllabus  Lecture Notes  Resources  Assignments  Rogues' Gallery     Wiki Page

Class Information

Term: Spring 2009
Class Times: TH 14:00 - 15:20 in WEB 1248

Instructor: Rich Riesenfeld  < rfr@cs.utah.edu >

Office: 2897 WEB
Office Hours: After class or by appointment.
Telephone: 801-581-7026

Mailing listcs5961@list.eng.utah.edu

Textbook:

John Freund's Mathematical Statistics with Applications
Irwin Miller and Maryless Miller (2007)
ISBN-13: 978-0131427068

Course Description Press Release

Note:

The University of Utah seeks to provide equal access to its programs, services and activities for people with disabilities. If you will need accommodations in the class, reasonable prior notice needs to be given to the Center for Disability Services, 162 Olpin Union Building, 581-5020 (V/TDD). CDS will work with you and the instructor to make arrangements for accomodations.

All written information in this course can be made available in alternative format with prior notification to the Center for Disability Services.


Syllabus

Wk Date  Topic   Remarks
1.1

13 Jan

Basics: random variable, probability density distributions, cumulative distributions; event space & trials; Fundamental Thm of Calculus
1.2
15
Probability v statistics; continuous v discrete random variables; Bernoulli trials & coin flips
   
2.1
20
Binomial distribution & repeated events; joint distribution; independent and dependent events
2.2
22
Common distribution: uniform, binomial, exponential, normal/gaussian; Pascal's triangle and binomial coefficients
   
3.1
27
Counting principles and methods; probability calculation using event space numeration; combinatorics and probability
3.2
29
Binomial coefficient calculations/identities
4.1
3 Feb
Monty Hall Paradox; linear regression
4.2
5
Principle Component Analysis (PCA)
   
5.1
10
Mean and Expectation in probability and statistics; Law of Large Numbers; (binomial dist)

Hmwk1: Combinatorics

5.2
12
Variance in probability and statistics; Var(binomial dist)
6.1
17
Quiz on Basic Definintions; Go over Quiz
6.2
19
Go over Quiz Problems
 
7.1
24
Quiz on Basic Definintions; Conditional probability  
7.2
26
Risk Analysis and Expected Value
8.1
 3 Mar
Convolution: Joint Distributions, Filters, Data Smoothing
8.2
5
Transformations, Eigenvalues, Eigenvectors; Revisit PCA
Postponed
9.1
10
Demos and discussions of examples of convolutions
9.2
12
Finish Probability; Normal Distribution
   
10.1
24
Convolutions, for discrete and continuous

Hmwk2 due
Wed, 25 Mar

10.2
26

Quiz on Basic Definintions

Hmwk3 due
11.1
31
Statististical Testing; Level of Confidence
   
11.2
 2 Apr
Project Topic Presentatons
   
12.1
7
Examples: Statistical Analysis 
   
12.2
9
Examples: Statistical Analysis 
   
13.1
14
General Methodology: Statistical Analysis
   
13.2
16
Hypothesis Testing
   
14.1
21
Sampling Theory
   
14.2
23
Project Presentations
   
15.1
28
Project Presentations
   
 

Lecture Notes

Selected Textbook Pages:

Textbook pages 1-15       pages 15-21       pages 23-68

Feller Vol 1, Ch 2, pages 52-64, Combinatorics Problems

Selected Basic Definitions:

Probability distribution functions

Convolutions

Conditional Probability:

Clearly Presented Conditional Probability Examples

Simple Conditional Probability Example w Applet

The Monty Hall Problem:

Let's Make a Deal Website (Monty Hall Problem): Background and Applet

Let's Make a Deal (Monty Hall) Applet

Nice Monty Hall Problem Demo Applet

Monty Hall Problem Data Simulator Applet

Monty Hall Problem discussed and analyzed (from the curious incident of the dog in the night-time by mark haddon)

And Behind Door No. 1, a Fatal Flaw (NYT 8 Apr 2008)

 

Expectation of Joint Distribution: 2 Dice:

Expectation for Sum of 2 Dice (rfr)

Notes on Joint Distributions and Convolution (rfr)

 

Binomial Distribution

Derivation Recursive Relationship for Binomial Coefficients

Derivation of E(X) and Var(X) for Binomial Distribution

 

Risk Analysis

Risk Analysis and Expected Value

 

Convolutions

Convolutions: Discrete and Continuous

 

Normal Distribution Illustrations:

Ball Drop

Flexible Normal Curve Shapes and Histogram Relationship

Interactive Normal Curve Shapes (go to bottom of target page)

Interactive Cumulative Area (Probability) Intervals

 

Linear Regression Analysis

Linear Regression (Yale Notes)

Linear Regression (Wikipedia)

Assumptions of Linear Regression

Linear Regression and Excel (Clemson Notes)

 

Statistical Analysis

Investigation Strategy.pdf

Investigation Strategy.doc


Resources

Binomial Distribution Calculator

Calculus Material:

Anti-Derivative

Fundamental Theorem of Calculus (short)

Fundamental Theorem of Calculus (bis; longer development)

Mean Value Theorem

 

Using a Priori Information:

Bayes' Theorem

 

Markov Chain Links:

Definition of Markov Chain

Markov Chain More Markov Chain

Markov Chain and Computer Vision (more adv)

Markov Chain in C

 

Video Clips (PBS): Lecture Series on Statistics

Normal Distribution I: Stat No 4.wmv (25 min)

Normal Distribution II: Stat No 5.wmv (25 min)

Causality: Stat No 11.wmv (25 min)

Binomial Distribution: Stat No 17.wmv (25 min)

 


sp 2009 Assignments

  Assignment Due Date Remarks Handin Dir

# 0

Missing Women.wmv (28 min) 17 Feb Large Video Download Large Video Download
# 1

Combinatorics:<doc>  <pdf>

23 Feb

Notes for: Lecture    Hmwk1

hmwk1:
# 2

Discrete Convolution: <doc>  <pdf>

17 Mar

Lecture Notes 

hmwk2: Submit a single file named login_name.conv.pdf

# 3
Data Smoothing:<doc>  <pdf> 19 Mar

Lecture Notes 

 

hmwk2: Submit a single file named login_name.smooth.pdf

# 4

Final Project: <doc>  <pdf>

 
Last week of Semester

Lecture Notes Investigation Strategy: <doc>  <pdf>

(Paired teams permitted)

project: submit a report in pdf named login_name1.login_name2.project.pdf