Title: A comprehensive method for solving finite-state semi-Markov processes

Authors: Richard L. Warr; David H. Collins

Addresses: Department of Mathematics and Statistics, Air Force Institute of Technology, Wright-Patterson Air Force Base, OH 45433, USA ' Statistical Sciences Group, Los Alamos National Laboratory, Los Alamos, NM 87545, USA

Abstract: Semi-Markov processes (SMPs) provide a rich framework for many real-world problems. However, owing to difficulty in implementing practical solutions they are rarely used with their full capability. The theory of SMPs is quite mature but was mainly developed at a time when computational resources were not widely available. With the exception of some of the simplest cases, solutions to SMPs are inherently numerical, and SMPs have been underutilised by practitioners because of difficulty in implementing the theory in applications. This paper demonstrates the theory and computational methods needed to implement SMP models in practical settings. Methods are illustrated with an application modelling the movement of coronary patients in a hospital. Our aim is to allow practitioners to use richer SMP models without being burdened with the rigorous mathematical theory.

Keywords: first passage distributions; inverse Laplace transform; Markov renewal process; MRP; queuing theory; statistical flowgraph model; SFGM; Weibull; simulation; process modelling; finite-state SMPs; semi-Markov processes; patient movements; coronary patients; hospitals; healthcare management.

DOI: 10.1504/IJSPM.2015.068522

International Journal of Simulation and Process Modelling, 2015 Vol.10 No.1, pp.89 - 99

Accepted: 19 Jan 2015
Published online: 04 Apr 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article