(Solved): (b) Compile the transition matrix T and verify that it is stochastic. (c) Suppose Josephine starts ...

(b) Compile the transition matrix T and verify that it is stochastic.

(c) Suppose Josephine starts at vertex 1. Use T to find the probability she will be at vertex 3 after two time steps

Question 4+ Josephine is a random walker on a complete graph K with vertices 1,2,3,4. When she is at vertex i the probability that she chooses to go to vertex j ‡i (in one step) is pij = 1/(10-i). (a) Draw the graph and mark on it the transition probabilities.