On the reduction of total‐cost and average‐cost MDPs to discounted MDPs

This article provides conditions under which total‐cost and average‐cost Markov decision processes (MDPs) can be reduced to discounted ones. Results are given for transient total‐cost MDPs with transition rates whose values may be greater than one, as well as for average‐cost MDPs with transition probabilities satisfying the condition that there is a state such that the expected time to reach it is uniformly bounded for all initial states and stationary policies. In particular, these reductions imply sufficient conditions for the validity of optimality equations and the existence of stationary optimal policies for MDPs with undiscounted total cost and average‐cost criteria. When the state and action sets are finite, these reductions lead to linear programming formulations and complexity estimates for MDPs under the aforementioned criteria.© 2017 Wiley Periodicals, Inc. Naval Research Logistics 66:38–56, 2019     

Maintaining systems with heterogeneous spare parts

We consider the problem of optimally maintaining a stochastically degrading, single‐unit system using heterogeneous spares of varying quality. The system's failures are unannounced; therefore, it is inspected periodically to determine its status (functioning or failed). The system continues in operation until it is either preventively or correctively maintained. The available maintenance options include perfect repair, which restores the system to an as‐good‐as‐new condition, and replacement with a randomly selected unit from the supply of heterogeneous spares. The objective is to minimize the total expected discounted maintenance costs over an infinite time horizon. We formulate the problem using a mixed observability Markov decision process (MOMDP) model in which the system's age is observable but its quality must be inferred. We show, under suitable conditions, the monotonicity of the optimal value function in the belief about the system quality and establish conditions under which finite preventive maintenance thresholds exist. A detailed computational study reveals that the optimal policy encourages exploration when the system's quality is uncertain; the policy is more exploitive when the quality is highly certain. The study also demonstrates that substantial cost savings are achieved by utilizing our MOMDP‐based method as compared to more naïve methods of accounting for heterogeneous spares.     

Lot sizing with learning and forgetting in setups: Analytical results and insights

This article considers the dynamic lot sizing problem when there is learning and forgetting in setups. Learning in setups takes place with repetition when additional setups are made and forgetting takes place when there is a break between two successive setups. We allow the amount forgotten over a break to depend both on the length of the break and the amount of learning at the beginning of the break. The learning and forgetting functions we use are realistic. We present several analytical results and use these in developing computationally efficient algorithms for solving the problem. Some decision/forecast horizon results are also developed, and finally we present managerial insights based on our computational results. © 2016 Wiley Periodicals, Inc. Naval Research Logistics 63: 93–108, 2016     

装备器材保障资源调度决策模型及算法

装备器材保障资源调度问题是一个非常复杂的问题,根据其优化目标要求,从保障时间最短、保障耗费最低、安全性最高3个方面建立了该问题的多目标优化模型,并通过目标优先度决策将其转化为单目标模型;接着,采用两阶段法进行求解,将其分为最优路径决策、器材分配决策两个阶段进行决策优化,在明确资源点到需求点之间的最优路径后再进行器材资源的分配;并分别采用基于小生境的自适应遗传算法和基于生成树的遗传算法进行求解。通过实例分析,求解结果能够满足装备器材保障的要求,表明所构建的决策模型和算法是有效的。     

兵棋推演：复杂系统管理的创新与实践

复杂系统性质决定了复杂系统管理的特殊性,而兵棋推演可以为复杂系统管理提供更加符合其特性的决策辅助支持。讨论了复杂系统的性质及其影响,研究了兵棋推演用于复杂系统管理的原因和方法,并结合战争兵棋推演,介绍了兵棋工程建设中系统研发、推演组织和工程管理方面的创新与实践问题。最后,给出了未来发展的趋势。     

合成分队火力分配协同决策模型研究

针对合成分队火力分配效率和科学性不高的问题,采用协同决策思想对合成分队火力优化分配方法进行了研究。针对合成分队的作战特点提出了3种模型:建立了攻击力量类型相同的多种准则的火力分配模型,建立了攻击力量类型不同的基于双层规划的火力分配模型,建立了具有上级指定任务的分队内和分队间的火力协同分配模型,并对相关模型进行了实例仿真验证。提出的这3种模型能够解决合成分队在火力分配中的协同决策问题,可提高作战指挥决策的实时性和科学性。     

大数据在信息作战指挥决策中的运用

针对信息作战指挥决策中大数据的运用问题,通过对大数据的海量信息检索能力、交叉复现的分析能力、“全信息”运算能力、智能决策执行能力的研究,提出了大数据为其提供按需订制的情报信息、多元多维的决策视角、动态实时的决策支持、智能自主的决策方式的观点,初步探索了大数据在信息作战指挥决策中的运用,对将大数据引入信息作战指挥决策具有十分重要的指导意义。     

一种基于协调理论的军事决策过程建模方法

在分析协调理论应用的基础上,针对军事决策过程的建模,基于UML2.0的用例图,提出了基于协调理论的军事决策过程建模方法。应用该建模方法,有利于分析军事决策过程中的核心任务活动及其相关依赖,为指挥员实施平行决策,并发地制订和确定作战方案(Course of Action)提供依据,从而提高军事决策过程的适应性。     

大连7·16油罐区爆炸火灾事故成功处置的启示

随着我国石油化工工业的发展以及国家原油战略储备库项目的实施,油罐的大型化已成为发展的必然趋势,现在10万m3的储罐已经屡见不鲜。如此巨大的油罐一旦发生火灾爆炸,其后果是难以想象的。2010年7月16日发生的大连中石油国际储运有限公司保税区油库爆炸火灾的成功处置最大限度的保护了国家财产,最大限度地减少了其对生态环境的破坏,笔者全程参与了此次事故处置指挥,力求通过总结这次作战行动,侧重从特大石化爆炸火灾事故组织指挥层面提供可供借鉴的经验做法。     

基于风险评估的检测与修理决策模型

研究了基于故障风险的检测与维修策略,运用威布尔比例风险模型建立系统故障率与工作时间及所处状态的关系。分析了两类基于间接状态信息维修决策的风险,建立了系统检测及维修策略的决策树,通过比较检测与不检测情况下的期望费用确定最优的检测间隔。算例表明,所提出的方法能够有效控制系统运行风险,降低系统运行费用。