Operations Research: Probabilistic Models

APMA 1200 serves as an introduction to stochastic processes and stochastic optimization. After a review of basic probability theory, including conditional probability and conditional expectations, topics covered will include discrete-time Markov chains, exponential distributions, Poisson processes and continuous-time Markov chains, elementary queueing theory, martingales, Markov decision processes and dynamic programming. If time permits topics selected from filtering of hidden Markov chains, renewal processes, and Brownian motion could be included. Prerequisites: Multivariable calculus; Linear algebra; APMA 1655 (or equivalent).