| DTMCPack-package | Suite of functions related to discrete-time discrete-state Markov Chains |
| DTMC | Simulation of Discrete-Time/State Markov Chain |
| DTMCPack | Suite of functions related to discrete-time discrete-state Markov Chains |
| FPTime | First Passage Time |
| gr | Example Data Set: Gambler's ruin on 4 states |
| hh | Harry the SemiPro |
| id | Initial distribution |
| MultDTMC | Multiple Discrete time Markov Chains |
| statdistr | Computing Stationary Distribution |