面向多点交互的多模态振动反馈触觉再现系统

近年来,多点交互和多模态融合的力触觉再现系统由于能够进一步提高人机交互的真实感,已经成为该领域的研究热点.基于Leap Motion的多手指位置检测模块、振动触觉再现模块、NRF51822蓝牙通信模块、视觉再现模块和CHAI3D构建的虚拟环境等,设计实现了多点自然交互的、触觉和视觉相融合多模态触觉再现系统.为了验证系统...

Vibration feedback based multi-modal haptic rendering system for multi-contact interaction

In recent years, multi-modal haptic rendering featured with multi-contact interaction has become a research focus in the human-computer interaction due to its ability to further enhancing the sense of reality. A multi-modal haptic rendering system for multi-contact interaction was presented, which is composed of Leap Motion sensor based multi-finger position detection module, vibration-based tactile rendering module, NRF51822 blue-tooth communication module, visual rendering module, and CHAI3D based virtual environment. To verify the efficacy and effectiveness of the proposed system, the virtual object contour recognition experiments and object pick-and-place experiments were carried out. Experiment results show that the average success rate for distinguishing geometric virtual objects is 87.9%, and the pick-and-place experiment with combined haptic rendering and visual rendering can lead to an average time saving of 47.7%, compared with that of single visual rendering condition. The proposed multi-contact haptic system features the virtues of low cost, small size, and simple control strategy, which lays out a profound foundation for the further development and application of multi-modal human-computer interaction.