New posts in Markov Chains

A conditional probability problem where the next day depends on the last 3 days

2 dimensional symmetric random walk

Two different books are giving two different solutions.

Asymptotic behavior of piecewise recursive random variable.

Problem with Gambler's ruin

Gambler's Ruin Problem with Simple Solution - Different Approach

King on reduced chessboard $2\times 2$ moving randomly, what is the probability that it ends up in one of the corners after $1000$ moves?

Race of the wealthy gamblers: How do I get this closed form?

Geometric Proof of Perron-Frobenius

Find stationary distribution for infinite space Markov chain