ESE 524 Detection and Estimation Theory (Spring 2020)



Semester: Spring 2020
Time: Tuesday and Thursday 4:00PM-5:20PM
Classroom: Wilson / 214

Instructor Information
Name: Arye Nehorai
Email: nehorai@ese.wustl.edu
Office Hour: Thursday 5:30-6:30pm, Green hall 2160c (Zoom meeting by appointment)

TA Information
Name: Eric Cawi
Email: ezcawi@wustl.edu
Office Hour: Friday 5:00-6:00pm, Green hall 1107 Tuesday, 5:30-6:30pm after class, Friday, 5:00-6:00 pm, moving online - as per University Announcement on COVID-19
Current Office Hours Link for Fridays through End of Semester: https://wustl.zoom.us/j/666561332

Online Course Zoom ID

Academic Integrity
Students are required to read and follow WUSTL's academic integrity policy.

Prerequisite
ESE 520 Probability and Stochastic Processes

Course Outline
  • Estimation Theory
    • Estimator Performance
    • Sufficient Statistics
    • Cramér-Rao Lower Bound
    • Linear Models
    • Maximum-Likelihood (ML) estimation
    • Bayesian Inference
      • Noninformative Priors
      • Bayesian Inference for Multiparameter Models
      • Gaussian Linear Models
      • Bayesian Asymptotic
    • Kalman Filter - Tentatively removed this semester due to COVID-19 delays.
  • Detection Theory
    • Bayesian Detection
      • Chernoff Bound
      • Multiple Hypothesis Testing
    • Frequentist Detection
      • Neyman-Person Test for Simple Hypotheses
      • Composite Hypothesis Test

Assignments
First homework set assigned on Tuesday, January 14, is designed to help students assess if they are have sufficient background to take this course, or otherwise may risk failing it. In most cases assigned biweekly on Tuesdays, starting from the second week. Due within two weeks in class. Knowledge in Matlab programming is required. The graded solutions will be returned in one or two weeks. Homework problems, solutions, and grades will be posted on Canvas.

Notes Readings (Required)
Students are required to read the Notes (posted in the link of the Lectures or the link below), in addition to the slides presented in class.
https://sites.google.com/view/detestth/lecture-notes?authuser=0

Exam Schedule
Midterm exam: Thursday March 26th, 4:00pm- 5:30pm
Final exam: Thursday, April 30th, 3:30-5:30pm

Course Grading
Homework 35%
Midterm 25%
Final exam 40%

Grader Information
Bing Xue, xuebing@wustl.edu
Eric Cawi, ezcawi@wustl.edu
Sicheng Wang, sicheng.wang@wustl.edu
Uri Goldsztejn, uri.goldsztejn@wustl.edu
Tianwei Zhou, tianweizhou@wustl.edu
Huifeng Zhu, zhuhuifeng@wustl.edu

Reading List (Suggested)
  1. Steven M. Kay, Fundamentals of Statistical Signal Processing, Volume I: Estimation Theory, Prentice-Hall, 1993, ISBN-13: 978-0133457117
  2. Steven M. Kay, Fundamentals of Statistical Signal Processing, Volume II: Detection Theory, Prentice-Hall, 1998, ISBN-13: 978-0135041352
  3. Peter J. Bickel and Kjell A. Doksum, Mathematical Statistics: Basic Ideas and Selected Topics, Volumes I-II Package, Chapman and Hall/CRC, 2015, BN-13: 978-1498740319
  4. Andrew Gelman, John B. Carlin, Hal S. Stern, David B. Dunson, Aki Vehtari, Donald B. Rubin, Bayesian Data Analysis, 3rd ed. Chapman & Hall, 13, ISBN-13: 978-1439840955
  5. Larry Wasserman, All of Statistics: A Concise Course in Statistical Inference, Springer, 2004, ISBN-13: 978-0387402727. The book listed in the ides was published in 1987
  6. H. Vincent Poor, An Introduction to Signal Detection and Estimation, 2nd ed. Springer-Verlag, 1994, ISBN-13: 9783540941736
  7. Harry L. Van Trees, Detection, Estimation, and Modulation Theory. Part I, Wiley, 1968, ISBN-13: 978-0471899556
  8. Stephen Boyd and Lieven Vandenberghe, Introduction to Applied Linear Algebra - Vectors, Matrices, and Least Squares, available at http://vmls-book.stanford.edu/
  9. Matrix Cookbook, Kaare Brandt Petersen and Michael Syskind Pedersen, 2012, matrixcookbook.pdf