Discrete Probability and Stochastic Processes
Provides an introduction to tools used for probabilistic reasoning in the context of discrete systems and processes. Tools such as the probabilistic method, first and second moment method, martingales, concentration and correlation inequalities, theory of random graphs, weak convergence, random walks and Brownian motion, branching processes, Markov chains, Markov random fields, correlation decay method, isoperimetry, coupling, influences and other basic tools of modern research in probability will be presented. Algorithmic aspects and connections to statistics and machine learning will be emphasized.
Fall 2013 · Advanced Stochastic Processes
This class covers the analysis and modeling of stochastic processes. Topics include measure theoretic probability, martingales, filtration, and stopping theorems, elements of large deviations theory, Brownian motion and reflected Brownian motion, stochastic integration and Ito calculus and functional limit theorems. In addition, the class will go over some applications to finance theory, insurance, queueing and inventory models.
Readings
- LEC #: 1 · TOPICS: Metric spaces and topology · READINGS: [Billingsley]: Appendix M1-M10.
- [Shwartz and Weiss]: Chapter 0. This is non-technical introduction to the field which describes motivation and various applications of the large deviations theory.
- [Dembo and Zeitouni]: Chapter 2.2.
- [Resnick]: Sections 6.1, and 6.4 from chapter 6.
- [Billingsley]: Chapter 8.
- [Resnick]: Sections 6.5, and 6.8 from chapter 6.
- LEC #: 8 · TOPICS: Quadratic variation property of Brownian motion · READINGS: [Resnick]: Sections 6.11, and 6.12 from chapter 6.
- LEC #: 9 · TOPICS: Conditional expectations, filtration and martingales · READINGS: [Durrett]: Section 4.1, and 4.2.
- LEC #: 10 · TOPICS: Martingales and stopping times I · READINGS: [Durrett]: Chapter 4.
- [Durrett]: Chapter 4.
- Grimmett, Geoffrey R., and David R. Stirzaker. Section 7.8 in Probability and Random Processes . 3rd ed. Oxford University Press, 2001. ISBN: 9780198572220.
- LEC #: 14 · TOPICS: Introduction to Ito calculus · READINGS: [Karatzas and Shreve]: Chapter I.
- [Øksendal]: Chapter III.
- LEC #: 18 · TOPICS: Integration with respect to martingales · READINGS: [Øksendal]: Chapters III, IV, and VIII
- LEC #: 20 · TOPICS: Introduction to the theory of weak convergence · READINGS: [Billingsley]: Chapter 1. Section 2.
- LEC #: 21 · TOPICS: Functional law of large numbers Construction of the Wiener measure · READINGS: [Billingsley]: Chapter 2. Section 8.
- Seneta, E. Non-Negative Matrices and Markov Chains . 2nd ed. Springer-Verlag, 2006. ISBN: 9780387905983.
Prerequisites & course information
Same subject as 6.7720J, 18.619[J] Prereq: 6.3702 , 6.7700[J] , 18.100A , 18.100B , or 18.100Q G (Spring) 3-0-9 units
Sources
- Course catalogue ↗2026–2027
- MIT OpenCourseWare ↗Fall 2013
- MIT OCW syllabus ↗
- MIT OCW readings ↗
- Historical MIT OpenCourseWare offering. Named reading entries and schedule topics are automatically extracted from the linked source pages.