Fichas
Markov Chains

Fichas del conjunto (47)
- 1Theorem 1.1.1 - Markov Chain

- 2Theorem 1.1.2 - Markov Property

- 3Theorem 1.13

- 4Theorem 1.2.1 - For distinct states i and j, the following are equivalent

- 5Theorem 1.3.2 - The vector of hitting probabilities

- 6Theorem 1.3.5 - The vector of mean hitting times

- 7Theorem 1.4.2 - Strong Markov Property

- 8Lemma 1.5.1

- 9Lemma 1.5.2

- 10Theorem 1.5.3 - The following dichotomy holds (transient or recurrent)

- 11Theorem 1.5.4 - Let C be a communicating class:

- 12Theorem 1.5.5 - Every recurrent class:

- 13Theorem 1.56 - Every finite close class:

- 14Theorem 1.5.7 - Suppose P is irreducible and recurrent:

- 15Theorem 1.7.1 - Let Xn be Markov(Lambda, P) and suppose that lambda is invariant for P, then:

- 16Theorem 1.7.2

- 17Theorem 1.7.5 - Let P be irreducible and recurrent, then:

- 18Theorem 1.7.6 - Let P be irreducible and let lambda be an invariant measure for P with lambdak = 1, then:

- 19Theorem 1.7.7 - Let P be irreducible, then the following are equivalent:

- 20Lemma 1.8.2 - Suppose P is irreducible and has an aperiodic state i, then:

- 21Theorem 1.8.3 - Convergence to equilibrium

- 22Theorem 1.8.4 - Let P be irreducible:

- 23Theorem 1.8.5 - Let P be irreducible of period d and let C0,C1,...Cd-1 be the partition obtained in theorem 1.8.4:

- 24Theorem 1.9.1 - Let P be irreducible and have an invariant distribution pi:

- 25Lemma 1.9.2 - If P and lambda are in detailed balance:

- 26Theorem 1.9.3 - Let P be an irreducible stochastic matrix and let lambda be a distribution. Suppose that Xn is a Markov(lambda,P). Then the following are equivalent:

- 27Theorem 1.10.1 (Strong law of large numbers) - Let Y1,Y2,... be a sequence of iid non-negative random variables with E(Y1) = mu. Then:

- 28Theorem 1.10.2 (Ergodic theorem)

- 29Transition MatrixThis is P
- 30Initial distributionThis is lambda
- 31Pi(A)P(A | X0 = i)
- 32Closed ClassA class which you cannot escape from
- 33AbsorbingA state i is absorbing if {i} is a closed class
- 34IrreducibleA chain where the entire chain is a closed class is irreducible. If you can find a repeating path through all the states in a chain, it is irreducible
- 35Hitting timeMaximum time expected for the Markov chain to travel between any two states

- 36Absorption ProbabiliyWhen A is a closed class, this on the left is called the absorption probability

- 37Notation for hitting time and expected hitting time

- 38Stopping timeLook up proper definition
- 39Recurrent and TransientA recurrent state is one you keep coming back to forever and a transient you eventually leave forever

- 40Passage TimeLook up
- 41InvariantP is invariant if:

- 42Expected time spent between each visit to k

- 43Positive and null recurrentIf the expected return time mi is finite it is positive recurrent and if it fails we call it null recurrent

- 44AperiodicIf pii^(n) >0 for all sufficiently large n
- 45PeriodGreatest common divisor of the set:

- 46Time-reversal

- 47A stochastic matrix P and a measure lambda are said to be in detailed balance if:

Información
- Descripción
- Year 2 Markov Chains Fichas sobre Markov Chains, creado por Alex Carr el 28/11/2022.
- Creado por
- Alex Carr
- Visitas
- 0
- Valoración