ESE 524 Detection and Estimation Theory (Spring 2021)



Meeting Times
Synchronous online lacture times: Tuesday and Thursday 4:00PM-5:20PM.
Synchronous online recitation times: TBD.

Instructor Information
Name: Arye Nehorai
Email: nehorai@ese.wustl.edu
Office Hour: Submit a request to schedule a zoom meeting within one to two days.

AI Information
Name: Uri Goldsztejn
Email: uri.goldsztejn@wustl.edu
Office Hour: TBD

Prerequisite
ESE 520 Probability and Stochastic Processes

Course Outline
  • Estimation Theory
    • Estimator Performance
    • Sufficient Statistics
    • Cramér-Rao Lower Bound
    • Linear Models
    • Maximum-Likelihood (ML) estimation
    • Bayesian Inference
      • Noninformative Priors
      • Bayesian Inference for Multiparameter Models
      • Gaussian Linear Models
      • Bayesian Asymptotic
    • Kalman Filter
  • Detection Theory
    • Bayesian Detection
      • Chernoff Bound
      • Multiple Hypothesis Testing
    • Frequentist Detection
      • Neyman-Person Test for Simple Hypotheses
      • Composite Hypothesis Test

Homework Assignments
  • First homework set is designed to assess if students have sufficient background to take this course.
  • Five next sets are assigned biweekly on Tuesdays, and due within two weeks.
  • Homework sets have equal weight, with total of 60% of the final grades.
  • Late submissions: -10% for each day after the deadline.
  • Grades will be posted in one to two weeks on Canvas.
  • Knowledge in programming is required.

Solutions Format
  • Prepare your solutions using Latex or Word, submit in pdf.
  • Handwritten solutions will not be accepted.

Required Academic Integrity

Students are required to read and follow WUSTL's academic integrity policy.

Term Project

Students: Individual or groups of two.

Choose one from the following:
  1. Literature review of cutting-edge developments on research topics relevant to this course.
  2. Original research relevant to this course.
  3. A mix of literature review with original research relevant to this course.
Presentations:
  • Final presentation: 30 minutes during last two weeks.
Assignments:
  • Submit the outline of your presentation two weeks before the fist day of presentations, to receive feedback.
  • Submit your draft slides one week before the first day of presentations, to receive feedback.
Course Grading

Homework 60%
Final presentation 40%

Notes Readings (Required)

Students are required to read the Notes (posted in the link of the Lectures or the link below), in addition to the slides presented in class.
https://sites.google.com/view/detestth/lecture-notes?authuser=0

Reading List (Suggested)
  1. Steven M. Kay, Fundamentals of Statistical Signal Processing, Volume I: Estimation Theory, Prentice-Hall, 1993, ISBN-13: 978-0133457117
  2. Steven M. Kay, Fundamentals of Statistical Signal Processing, Volume II: Detection Theory, Prentice-Hall, 1998, ISBN-13: 978-0135041352
  3. Peter J. Bickel and Kjell A. Doksum, Mathematical Statistics: Basic Ideas and Selected Topics, Volumes I-II Package, Chapman and Hall/CRC, 2015, BN-13: 978-1498740319
  4. Andrew Gelman, John B. Carlin, Hal S. Stern, David B. Dunson, Aki Vehtari, Donald B. Rubin, Bayesian Data Analysis, 3rd ed. Chapman & Hall, 13, ISBN-13: 978-1439840955
  5. Gelman et al. Bayesian Data Analysis, 3rd ed. Chapman Hall, 2013.
  6. Larry Wasserman, All of Statistics. New York: Wiley, 1987.
  7. Larry Wasserman, All of Statistics: A Concise Course in Statistical Inference, Springer, 2004, ISBN-13: 978-0387402727. The book listed in the ides was published in 1987
  8. Brian D. Ripley, Stochastic Simulation. New York: Wiley, 1987.
  9. Harry L. Van Trees, Detection, Estimation, and Modulation Theory. Part I, Wiley, 1968, ISBN-13: 978-0471899556
  10. H. Vincent Poor, An Introduction to Signal Detection and Estimation, 2nd ed. Springer-Verlag, 1994, ISBN-13: 9783540941736
  11. Jun S. Liu, Monte Carlo Strategies in Scientific Computing. New York:Springer−Verlag, 2001.
  12. Stephen Boyd and Lieven Vandenberghe, Introduction to Applied Linear Algebra - Vectors, Matrices, and Least Squares, available at http://vmls-book.stanford.edu/
  13. Friedrich Liese and Klaus-J. Mieske, Statistical Decision Theory: Estimation, Testing,and Selection, 2008.
  14. Matrix Cookbook, Kaare Brandt Petersen and Michael Syskind Pedersen, 2012, matrixcookbook.pdf

Useful Links
Canvas 24-hour-student support: 1-844-865-2581 or live chat via the Canvas "Help" icon in Canvas.