| 摘要: |
| 目的 解决传统座舱显控方式信息量大且操控复杂容易造成交互效率低的问题。方法 提出了一种在全息显控界面下融合手势及语音的多通道人机交互系统设计方法， 根据三维数字地图全息展示及交互特性， 进行了任务划分和整体设计。通过构建全息界面多通道交互系统实验台， 完成了基于Kinect的手势及语音模块和交互接口的设计， 实现了三维数字地图全息展示中多通道人机交互的准确控制。结论 工效实验表明， 该交互方法比传统操控方法的效率提高了约17.5%。 |
| 关键词: 多通道交互 数字地图 全息界面 人机工效 |
| DOI： |
| 分类号:TB472 |
| 基金项目:国家自然科学基金 （61472314） |
|
| Multimodal Interaction Technology in the Holographic Display and Control Interfaces |
|
SHI Xiao-long1, LI Xiao-ling2, GAO Hong-ni1, HAN Feng2
|
|
1.Air Force Engineering University， Xi′an 710051， China;2.Xi′an Jiaotong University， Xi′an 710049， China
|
| Abstract: |
| It aims to solve the problems that traditional cockpit display-control system usually have too much complex information， which leads to the operators have to take a long time to be familiar with the interface and often cause the low efficiency.A new method of multimodal interaction system which integrated gesture and speech is proposed under the holographic display control interface.First，according to characteristics of 3D digital map holographic display and interaction， the system framework is designed and the task is allocation.Second， an experiment platform is established which with holographic interface and multimodal interaction， a multimodal interface is designed which can be controlled by gesture and speech based on Kinect.At last， the 3D digital map can be controlled precisely using multimodal interaction with holographic display.The experiment shows that the ergonomics of multimodal interaction increases by about 17.5% than traditional control ways. |
| Key words: multimodal interaction digital map holographic interface ergonomics |
渝公网安备 50010702501716号