“A CTMC is a stochastic process with the property that every time it enters state i, the following hold: 1.   The amount of time the process spends in state i before making a transition is Exponentially distributed with some rate (call it νi). 2.   When the process leaves state i, it will next enter state j with some probability (call it pij) independent of the time spent at state i.”