Table of contents
6 chapters · 19 sections
Introduction
- 1.1Random processes
- 1.2Examples
Discrete-Time Markov Chains
- 2.1Transition matrices
- 2.2Classification of states
- 2.3Stationary distributions
- 2.4Convergence to equilibrium
- 2.5Random walks
Poisson Process
- 3.1Definition
- 3.2Interarrival times
- 3.3Thinning and superposition
Continuous-Time Markov Chains
- 4.1Generators
- 4.2Birth–death processes
- 4.3Queues
Martingales
- 5.1Conditional expectation
- 5.2Martingales and stopping times
- 5.3Optional stopping theorem
Brownian Motion
- 6.1Definition
- 6.2Reflection principle
- 6.3Towards stochastic calculus