| 本文已被：浏览 1720次 下载 1058次 |
码上扫一扫！ |
|
|
| 多通道人机交互中感觉刺激的模拟方法研究综述 |
|
孙凌云1,2,王可幸1,2,陈培1,2,周子洪1,2,杨昌源3,杨光3
|
|
1.浙江大学 计算机科学与技术学院，杭州 310013;2.阿里巴巴-浙江大学前沿技术联合研究中心，杭州 310027;3.阿里巴巴集团，杭州 311121
|
|
| 摘要: |
| 目的 对多通道人机交互中感觉刺激模拟方法的研究现状进行梳理，总结现有研究中的相关技术原理与方法，为后续的相关研究和实践提供参考。方法 利用文献调研和典型案例分析方法，梳理了触觉、嗅觉及味觉三种单通道感觉刺激模拟的相关技术;概述了多通道感觉刺激融合的认知学理论，并以视听触融合、视听嗅融合为例，总结了多通道感觉刺激融合的具体实现方法;介绍了多通道感觉刺激融合在医疗康复、虚拟购物、智能教育等典型场景中的应用。结论 多通道人机交互中感觉刺激的模拟方法研究有望支持低负荷、高效率的新型人机交互方式，甚至带来超越真实的交互体验，具备广泛的应用潜力。 |
| 关键词: 多通道人机交互 感觉刺激模拟 感觉刺激融合 |
| DOI：10.19554/j.cnki.1001-3563.2023.08.008 |
| 分类号:TB472 |
| 基金项目:国家重点研发计划项目(2022YFB3303300);国家自然科学基金(62207024，62107035) |
|
| Review of Sensory Feedback Simulation Methods in Multi-modal Human-computer Interaction |
|
SUN Ling-yun1,2, WANG Ke-xing1,2, CHEN Pei1,2, ZHOU Zi-hong1,2,YANG Chang-yuan3, YANG Guang3
|
|
(1. College of Computer Science and Technology, Zhejiang University, Hangzhou 310013, China;2. Alibaba-Zhejiang University Joint Institute of Frontier Technologies, Hangzhou 310027, China;3. Alibaba Group, Hangzhou 311121, China)
|
| Abstract: |
| The work aims to sort out the research status of sensory feedback simulation methods in multi-modal human-computer interaction and summarize the principles and implementation methods of related techniques in existing research, so as to provide references for the subsequent research and practice. Firstly, the techniques used to simulate haptic, olfactory, and gustatory feedback were summarized respectively by reviewing literature and studying typical cases. Then, the cognitive theories about multi-modal sensory integration were outlined and the specific implementation methods were introduced by taking visual-aural-haptic and visual-aural-olfactory feedback integration as examples. Finally, the application of multi-modal sensory feedback in typical scenarios such as medical rehabilitation, virtual shopping, and intelligent education was expounded. The research of sensory feedback simulation methods in multi-modal human-computer interaction is expected to support a new type of human-computer interaction with low load and high efficiency. It can even deliver an interactive experience that goes beyond reality, representing a wide range of application potential. |
| Key words: s. Portland, Oregon, USA, 2005. |
渝公网安备 50010702501716号