Stochastic Processes

and their probability distributions, relation with distribution functions. Expectations, conditioning with respect to a class of random variables. Stochastic processes, finite dimensional probabilities, independent processes. Discrete Markov chains, transition probabilities, recurrence, long term distributions. Continuous time Markov chains, Jump processes, birth-death processes, Poisson processes, Weiner processes.