Optimal maintenance policies for constantly monitored systems

A multistate system is assumed to be constantly monitored; i.e., the state of the system is always known with certainty. Damage to the system accumulates via a continuous-time Markov process. A model of the system including restoration costs and state occupation costs is developed. It is shown that under certain conditions the optimal restoration policy for the system is a control limit rule. A control limit rule is a policy which requires restoration of the system whenever the damage exceeds a certain level. Examples are presented to show that there are several situations in which, perhaps surprisingly, control limit rules are not optimal.