State Space ($S$)
- Definition: The set of all possible states a Markov chain can occupy.
- Structural Property: The entire state space $S$ can be uniquely partitioned into a set of disjoint Communicating Classes based on the equivalence relation of communication.