Maneuvering target tracking of UAV based on MN-DDPG and transfer learning

Tracking maneuvering target in real time autonomously and accurately in an uncertain environment is one of the challenging missions for unmanned aerial vehicles(UAVs).In this paper,aiming to address the control problem of maneuvering target tracking and obstacle avoidance,an online path planning approach for UAV is developed based on deep reinforcement learning.Through end-to-end learning powered by neural networks,the proposed approach can achieve the perception of the environment and continuous motion output control.This proposed approach includes:(1)A deep deterministic policy gradient(DDPG)-based control framework to provide learning and autonomous decision-making capa-bility for UAVs;(2)An improved method named MN-DDPG for introducing a type of mixed noises to assist UAV with exploring stochastic strategies for online optimal planning;and(3)An algorithm of task-decomposition and pre-training for efficient transfer learning to improve the generalization capability of UAV's control model built based on MN-DDPG.The experimental simulation results have verified that the proposed approach can achieve good self-adaptive adjustment of UAV's flight attitude in the tasks of maneuvering target tracking with a significant improvement in generalization capability and training efficiency of UAV tracking controller in uncertain environments.     

模型不可知的联合相互学习

主流的联邦学习(federated learning, FL)方法需要梯度的交互和数据同分布的理想假定,这就带来了额外的通信开销、隐私泄露和数据低效性的问题。因此,提出了一种新的FL框架,称为模型不可知的联合相互学习 (model agnostic federated mutual learning, MAFML)。MAFML仅利用少量低维的信息(例如,图像分类任务中神经网络输出的软标签)共享实现跨机构间的“互学互教”,且MAFML不需要共享一个全局模型,机构用户可以自定制私有模型。同时,MAFML使用简洁的梯度冲突避免方法使每个参与者在不降低自身域数据性能的前提下,能够很好地泛化到其他域的数据。在多个跨域数据集上的实验表明,MAFML可以为面临“竞争与合作”困境的联盟企业提供一种有前景的解决方法。     

空间光通信粗瞄系统的扰动估计与补偿

粗瞄系统以直流力矩电机驱动二维转台为执行机构,通过粗瞄控制器对其进行控制。对系统受到的扰动进行分析,应用了最速跟踪微分器提取速度信号;以二维转台的方位轴为控制对象,在其位置环、速度环采用级联线性自抗扰控制器,通过线性扩张状态观测器主动补偿扰动,达到内外环双重隔离扰动的目的,提高跟踪精度;之后进行了实验分析。分析结果表明:在加入同样的模拟扰动信号,输入2 Hz,5 Hz和8 Hz的正弦信号时,与比例、微分、积分控制器相比,跟踪误差的标准差约降低50%;验证了线性扩张状态观测器具有扰动补偿效果;在输入不同频率正弦信号时,自抗扰控制器对输入信号频率的变化不敏感,仍能保证较高的跟踪精度。     

角度欺骗有源假目标的动力学特性

针对高空高速目标探测过程中可能出现的角度类欺骗有源假目标,从理论上系统地分析了其动力学性质,导出了假目标的动力学方程,并分析了假目标的机械能和动量矩守恒问题。理论分析和仿真试验均表明,具有固定角度欺骗的方位有源假目标其动力学特性和真实目标完全一致,在动力学上是无法鉴别真伪的;除此之外的其他角度类欺骗有源假目标均不满足高空高速目标椭圆轨道特性以及动力学守恒定律,利用这种差异可以在数据处理层对假目标进行鉴别。     

Allocation of quality improvement targets based on investments in learning

Purchased materials often account for more than 50% of a manufacturer's product nonconformance cost. A common strategy for reducing such costs is to allocate periodic quality improvement targets to suppliers of such materials. Improvement target allocations are often accomplished via ad hoc methods such as prescribing a fixed, across‐the‐board percentage improvement for all suppliers, which, however, may not be the most effective or efficient approach for allocating improvement targets. We propose a formal modeling and optimization approach for assessing quality improvement targets for suppliers, based on process variance reduction. In our models, a manufacturer has multiple product performance measures that are linear functions of a common set of design variables (factors), each of which is an output from an independent supplier's process. We assume that a manufacturer's quality improvement is a result of reductions in supplier process variances, obtained through learning and experience, which require appropriate investments by both the manufacturer and suppliers. Three learning investment (cost) models for achieving a given learning rate are used to determine the allocations that minimize expected costs for both the supplier and manufacturer and to assess the sensitivity of investment in learning on the allocation of quality improvement targets. Solutions for determining optimal learning rates, and concomitant quality improvement targets are derived for each learning investment function. We also account for the risk that a supplier may not achieve a targeted learning rate for quality improvements. An extensive computational study is conducted to investigate the differences between optimal variance allocations and a fixed percentage allocation. These differences are examined with respect to (i) variance improvement targets and (ii) total expected cost. For certain types of learning investment models, the results suggest that orders of magnitude differences in variance allocations and expected total costs occur between optimal allocations and those arrived at via the commonly used rule of fixed percentage allocations. However, for learning investments characterized by a quadratic function, there is surprisingly close agreement with an “across‐the‐board” allocation of 20% quality improvement targets. © John Wiley & Sons, Inc. Naval Research Logistics 48: 684–709, 2001     

有源消声技术与应用述评

近十几年来 ,有源消声技术成为噪声控制领域一个多学科交叉、渗透、延伸的研究热点 ,它以其体积小、重量轻、低频消声效果好等优点获得普遍的关注。本文简述有源消声的基本原理 ,对有源消声理论研究、实现技术、产品应用三个方面的国内外研究现状、进展和难点进行了详细的阐述和分析 ,较为完整地展示了当前该研究领域的全貌 ,最后进一步分析了有源消声走向工程化过程中存在的一些主要问题 ,提出了有源消声技术的几个重点发展方向     

基于深度学习的MPSK信号调制识别

为了有效实现信号调制方式的智能识别,提出基于深度学习的多进制相移键控(Multiple Phase Shift Keying, MPSK)信号调制识别方法。分析接收MPSK信号的循环谱,并通过提取MPSK信号循环谱的等高图获得二维特征信息,利用深度学习中的卷积神经网络对二维特征进行训练,使用测试样本对所设计的调制识别方法的有效性进行验证。仿真结果表明,所提方法具有良好的识别性能。     

采用区分性幅相联合字典学习的低截获概率信号分离方法

为解决采用字典学习的信号分离方法存在的相位信息缺失和子字典交叉表示问题,提出一种区分性幅相联合字典学习方法。该方法针对相位信息缺失问题,构建了幅相联合字典模型;针对混合信号在联合字典上投影时存在的交叉表示问题,基于区分性字典学习思想提出在字典学习过程目标函数中加入交叉表示抑制项。仿真结果表明：幅相联合字典能够充分表示典型低截获概率信号的幅相信息,交叉表示抑制项能有效抑制信号间的交叉表示,算法具有良好的分离性能。     

Lot sizing with learning and forgetting in setups: Analytical results and insights

This article considers the dynamic lot sizing problem when there is learning and forgetting in setups. Learning in setups takes place with repetition when additional setups are made and forgetting takes place when there is a break between two successive setups. We allow the amount forgotten over a break to depend both on the length of the break and the amount of learning at the beginning of the break. The learning and forgetting functions we use are realistic. We present several analytical results and use these in developing computationally efficient algorithms for solving the problem. Some decision/forecast horizon results are also developed, and finally we present managerial insights based on our computational results. © 2016 Wiley Periodicals, Inc. Naval Research Logistics 63: 93–108, 2016     

Strategy in the Age of Artificial Intelligence

ABSTRACT

We argue that Artificial Intelligence (AI) will, in the very near future, have a profound impact on the conduct of strategy and will be disruptive of existing power balances. To do so, we review the psychological foundations of strategy and explore the ways in which AI will impact human decision-making. We then review current and evolving capabilities in ‘narrow’, modular AI that is optimised to perform in a particular environment, and explore its military potential. Lastly, we look ahead to the more distant prospect of a general AI.