Markovian decision processes
an iterative representation in the form of a transition probabilities matrix that describes the probabilities of the next state for an entity given its current state, e.g., to represent ecological succession with various kinds of potential disturbanceThis definition last updated 07/14/2008