Exercise

Let R = Q. The transition matrix A is invertible if and only if s satisfies the following requirement.

no requirement at all.

s(0) = 1.

s(0) 0