An introduction to Stochastic Process

In this course we have learned about random walk, some properties of a continues time and discrete time markov chains and their stationary states.