Technical note: A computationally efficient algorithm for undiscounted Markov decision processes with restricted observations

We present a computationally efficient procedure to determine control policies for an infinite horizon Markov Decision process with restricted observations. The optimal policy for the system with restricted observations is a function of the observation process and not the unobservable states of the system. Thus, the policy is stationary with respect to the partitioned state space. The algorithm we propose addresses the undiscounted average cost case. The algorithm combines a local search with a modified version of Howard's (Dynamic programming and Markov processes, MIT Press, Cambridge, MA, 1960) policy iteration method. We demonstrate empirically that the algorithm finds the optimal deterministic policy for over 96% of the problem instances generated. For large scale problem instances, we demonstrate that the average cost associated with the local optimal policy is lower than the average cost associated with an integer rounded policy produced by the algorithm of Serin and Kulkarni Math Methods Oper Res 61 (2005) 311–328. © 2008 Wiley Periodicals, Inc. Naval Research Logistics 2009     

多分辨率建模航空武器装备体系对抗效能评估

根据多分辨率建模的思想,分析航空武器装备体系对抗的特点,提出基于多分辨率建模的航空武器装备体系对抗效能评估模型框架,通过体系对抗过程物理特性的分析提炼数学描述方法,基于主动元建模技术建立从高分辨率实体仿真模型的仿真元模型,探讨了对仿真元模型进行基于马尔科夫链的串联聚合和基于元胞自动机的空间聚合方法,提出效能评估多维矢量空间指标体系,研究结果对我军航空武器装备效能评估以及作战论证都具有一定的指导意义和参考价值.     

炮兵作战决策方案优选的方法

炮兵作战方案的选择,是炮兵作战指挥决策的关键环节,其合理与否,直接关系到炮兵作战效能的发挥和作战的成败.根据炮兵作战的实际,阐述了炮兵作战方案优选的依据,给出了运用层次分析法确定影响作战方案选择的各因素权重的方法步骤,在对优选依据的建模要素进行分析的基础上,构建了每个要素的效用函数计算模型,并给出了评估方案的计算方法,提供了模型应用的一般步骤.     

基于灰色关联法的飞行模拟器方案评估

对三个飞行训练模拟器方案进行灰色关联评估。根据装备效能分析原则,结合飞行训练模拟器组成结构的自身特点,确定了影响飞行训练模拟器效能的主要指标,建立了飞行模拟器效能评估体系,应用层次分析法,计算出各指标的权重,再利用灰色理论原理,对效能体系中主要指标进行了灰色综合评估,然后把灰色综合评估值与费用结合,确定评估矩阵,按照灰色关联法的步骤,计算出各方案与理想方案的关联度。结果是比较符合实际情况的,并且应用到某型飞行模拟器方案论证中。     

Dynamic signatures and their use in comparing the reliability of new and used systems

The signature of a system with independent and identically distributed (i.i.d.) component lifetimes is a vector whose ith element is the probability that the ith component failure is fatal to the system. System signatures have been found to be quite useful tools in the study and comparison of engineered systems. In this article, the theory of system signatures is extended to versions of signatures applicable in dynamic reliability settings. It is shown that, when a working used system is inspected at time t and it is noted that precisely k failures have occurred, the vector s [0,1]^n‐k whose jth element is the probability that the (k + j)th component failure is fatal to the system, for j = 1,2,2026;,n ‐ k, is a distribution‐free measure of the design of the residual system. Next, known representation and preservation theorems for system signatures are generalized to dynamic versions. Two additional applications of dynamic signatures are studied in detail. The well‐known “new better than used” (NBU) property of aging systems is extended to a uniform (UNBU) version, which compares systems when new and when used, conditional on the known number of failures. Sufficient conditions are given for a system to have the UNBU property. The application of dynamic signatures to the engineering practice of “burn‐in” is also treated. Specifically, we consider the comparison of new systems with working used systems burned‐in to a given ordered component failure time. In a reliability economics framework, we illustrate how one might compare a new system to one successfully burned‐in to the kth component failure, and we identify circumstances in which burn‐in is inferior (or is superior) to the fielding of a new system. © 2009 Wiley Periodicals, Inc. Naval Research Logistics, 2009     

多决策目标排序的层次分析与灰色关联法

战争中对打击目标排序是下定作战决心的前提,是战场信息处理的重要内容.随着军事科技的发展和战术运用要求的提高,决定目标排序的因素不断增多,作战环境更加复杂,单一指标已不能满足需求.采用层次分析和灰色关联相结合的方法对多决策目标进行分析,为具有多决策因子目标提供了一种排序方法.灰色数据的白化和精确数据的直接使用提高了数据的效率,使得不同特点的目标具有可比性.实例表明,该方法行之有效.     

基于仿真的飞机战损部位及备件需求确定

飞机战斗损伤部位及战时备件需求的确定对做好战时维修保障工作具有重要意义.提出了作战飞机的战斗损伤部位的确定方法,建立了飞机部件的当量模型和飞机受导弹攻击的仿真模型,确定了飞机的战伤分布规律.在确定飞机战伤分布规律的基础上,建立了飞机战伤备件和故障备件需求模型,为作战飞机的战伤研究及航材储备作了有益的探讨.     

特殊半鞅的强大数定律

利用特殊半鞅的收敛定理和一般形式的Kronecker引理,给出了特殊半鞅和非负特殊半鞅强大数定律的一般形式,推广和完善了已有的结果.     

坦克发动机自行加温过程研究

为改进坦克发动机冷却系统,以12150L型坦克发动机为例,通过建立公式对发动机自行 加温过程进行了计算,得出不同条件下冷却液温度随时间的变化关系;并通过试验验证。由此为改进冷 却系统提供了理论依据。     

积极探索训练规律,加强学员军事基础素质的培养

通过研究“4+1”人才培养模式下学员军事基础素质培养过程,改革军事基础课程教学体系和学员队管理模式,实现军事基础教学与学员队管理的有机衔接,强化学员旅的教学管理职能,形成“三位一体”的学员军事基础素质培养模式,建立学员军事基础素质评价的指标体系。