Stochastic Systems (3-0-3)

Introduction
     Stochastic dynamic problems in control, communication and signal
         processing
     Review basic probability

Probability and stochastic analysis
     Random walks and Brownian motion
     Stochastic integrals and martingales
     Stochastic differential equations and Ito calculus

Stochastic Systems
     Stochastic stability
     Evolution equation: Kolmogorov and Fokker-Planck

Optimal Estimation
     Static estimation: linear and nonlinear
     Explicit solutions and approximations

Stochastic Control
     Optimal stochastic control: Full information case
     Optimal stochastic control: Partial information case
     Separation principle and LQG-design
     Dynamic programming, value functions, verification theorem

Applications in Communication and Signal Processing
     Cycle slip in phase locked loop
     Propagation in random media
     Simulated annealing and Monte Carlo simulation