-
摘要: 为提高半虚拟现实座舱中用户视觉真实感与人-座舱交互性能, 提出了一种增强半虚拟现实座舱技术, 将手图像实时融合到虚拟座舱环境中, 使用户能实时看到自己的真实手。通过肤色检测算法实时分割摄像机采集图像, 应用改进的自适应加权立体匹配算法与视图变形算法对图像进行视点校正, 通过虚实匹配与虚实融合将手图像无缝融合到虚拟环境中, 为用户提供增强虚拟环境中的可视化图像。测试结果表明: 增强半虚拟现实座舱技术方案中触觉与视觉反馈真实, 在头盔式虚拟环境中用户交互能点击到的最小方块边长为8 mm。采用增强半虚拟现实技术方案完成座舱内典型交互动作的时间比传统数据手套方案与半虚拟交互方案平均分别降低约50%与18%, 极大提高了人-座舱交互性能, 可有效增强虚拟现实座舱系统实用性, 并降低开发成本。Abstract: In order to enhance the visual sense of users and the interaction performance of human-cockpit system in the semi-virtual reality cockpit system, an augmented semi-virtual reality cockpit technolgy was presented, which incorporated a realistic view of hand into the virtual environments and made user see his own real hand in real time.The captured images by using camera were real-time segmented by skin color detecting algorithm.The segmented foreground images were rectified by using adaptive weighted stereo matching algorithm and view morphing algorithm.Hand images were seamlessly integrated into virtual environment by using virtual-real matching and virtual-real fusion methods, which can provide user with the visual images in augmented virtual environment.Experimental result shows that augmented semi-virtual reality cockpit technology make users feel true for the feedback of touch and vision.The smallest side length of the square clicked by users is 8 mm in head-mounted virtual environment.In augmented semi-virtual reality cockpit system, the average interaction time decreases by about 50% and 18% compared with traditional data glove method and semi-virtual reality method.The technolgy effectively improves the human-cockpit interaction performance of the system, enhances its practicability, and its developed cost decreases.1 tab, 11 figs, 22 refs.
-
表 1 人机交互所需时间
Table 1. Human-computer interaction times
s 方案 点击按钮 拨动拨钮 旋转旋钮 推动油门杆 纯虚拟交互 7.5 7.9 6.4 半虚拟交互 3.7 3.5 3.7 4.2 增强半虚拟交互 3.0 3.3 2.9 3.8 纯实物交互 1.7 1.8 1.9 1.5 
下载: 导出CSV
-
[1] GU Hong-bin, WU Dong-su, LIU Hui. Development of a novel low-cost flight simulator for pilot training[J]. World Academy of Science, Engineering and Technology, 2009(60): 685-689. [2] MCCARTY W D, SHEASBY S, AMBURN P, et al. Avirtual cockpit for a distributed interactive simulation[J]. IEEE Computer Graphics and Applications, 1994, 14(1): 49-54. [3] HOSSEINI M, MALRIC F, GEORGANAS N D. A haptic virtual environment for industrial training[C]//IEEE. IEEE International Workshop on Haptic Virtual Environments and their Applications. Ottawa: IEEE, 2002: 25-30. [4] 任程, 戴树岭. 基于数据手套的逼真虚拟手的实现[J]. 系统仿真学报, 2008, 20(22): 6214-6217. https://www.cnki.com.cn/Article/CJFDTOTAL-XTFZ200822050.htmREN Cheng, DAI Shu-ling. Implementation of cyber-glove based realistic virtual hand[J]. Journal of System Simulation, 2008, 20(22): 6214-6217. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-XTFZ200822050.htm [5] O'HAGAN R G, ZELINSKY A, ROUGEAUX S. Visual gesture interfaces for virtual environments[J]. Interacting with Computers, 2002, 14(3): 231-250. [6] TOSAS M, LI B. Virtual touch screen for mixed reality[C]// HCI/ECCV. Computer Vision in Human-Computer Interaction of Lecture Notes in Computer Science. Prague: Springer-Verlag, 2004: 48-59. [7] FANG Gao-lin, GAO Wen, ZHAO De-bin. Large vocabulary sign language recognition based on fuzzy decision trees[J]. IEEE Transactions on Systems, Man, and Cybernetics, 2004, 34(3): 305-314. [8] GAO Wen, MA Ji-yong, WU Jiang-qin, et al. Sign language recognition based on HMM/ANN/DP[J]. International Journal on Pattern Recognition and Artificial Intelligence, 2000, 14(5): 587-602. [9] 郝爱民, 何兵, 赵沁平. 虚拟现实中的增强虚境技术[J]. 北京航空航天大学学报, 2003, 29(10): 909-913. https://www.cnki.com.cn/Article/CJFDTOTAL-BJHK200310016.htmHAO Ai-min, HE Bing, ZHAO Qin-ping. Review of augmented virtualit ytechnology in virtual reality[J]. Journal of Beijing University of Aeronautics and Astronautics, 2003, 29(10): 909-913. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-BJHK200310016.htm [10] 戴树岭, 雷小永, 梅继红. 虚拟仿真飞机座舱系统[J]. 系统仿真学报, 2002, 14(4): 488-492. https://www.cnki.com.cn/Article/CJFDTOTAL-XTFZ200204025.htmDAI Shu-lin, LEI Xiao-yong, MEI Ji-hong. Virtual cockpit system[J]. Journal of System Simulation, 2002, 14(4): 488-492. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-XTFZ200204025.htm [11] SALZMANN H, FROEHLICH B. The two-user seating buck: enabling face-to-face discussions of novel car interface concepts[C]//IEEE. IEEE Virtual Reality 2008. Keno: IEEE, 2008: 75-82. [12] 周来, 顾宏斌, 孙瑾, 等. 半虚拟现实座舱中基于最大后验概率框架的手姿态估计[J]. 航空学报, 2011, 32(7): 1252-1259. https://www.cnki.com.cn/Article/CJFDTOTAL-HKXB201107012.htmZHOU Lai, GU Hong-bin, SUN Jin, et al. Hand pose estimation based on maximum a posteriori framework in semi-virtual reality cockpit[J]. Acta Aeronautica et Astronautica Sinica, 2011, 32(7): 1252-1259. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-HKXB201107012.htm [13] 罗斌, 姚鹏, 翁冬冬, 等. 基于混合现实的新型轻量级飞行模拟器系统[J]. 系统仿真学报, 2009, 21(17): 5406-5410. https://www.cnki.com.cn/Article/CJFDTOTAL-XTFZ200917033.htmLUO Bin, YAO Peng, WENG Dong-dong, et al. Novel, lightweight flight simulator system based on mixed reality[J]. Journal of System Simulation, 2009, 21(17): 5406-5410. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-XTFZ200917033.htm [14] ZHANG Zheng-you. Flexible camera calibration by viewing a plane from unknown orientations[C]//IEEE. Proceedings of the Seventh IEEE International Conference on Computer Vision. Los Alamitos: IEEE, 1999: 666-673. [15] 徐战武, 朱淼良. 肤色检测最优空间[J]. 计算机辅助设计与图形学学报, 2006, 18(9): 1350-1356. https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF200609011.htmXU Zhan-wu, ZHU Miao-liang. Optimum colorspace for skin-tone detection[J]. Journal of Computer-Aided Design and Computer Graphics, 2006, 18(9): 1350-1356. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF200609011.htm [16] 汤勇, 顾宏斌, 周来. 交互系统中实时手势分割及指尖检测方法[J]. 光电工程, 2010, 37(7): 145-150. https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC201007030.htmTANG Yong, GU Hong-bin, ZHOU Lai. Real-time hand segmentation and fingertip detection for interaction[J]. Opto-Electronic Engineering, 2010, 37(7): 145-150. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC201007030.htm [17] EDWARDS E K, ROLLAND J P, KELLER K P. Video seethrough design for merging of real and virtual environments[C]// IEEE. Proceedings of IEEE Virtual Reality Annual International Symposium. New York: IEEE, 1993: 223-233. [18] ROLLAND J P, BIOCCA F A, BARLOW T, et al. Quantification of adaptation to virtual-eye location in see-thru headmounted displays[C]//IEEE. Proceedings of the Virtual Reality Annual International Symposium. Los Alamitos: IEEE, 1995: 56-66. [19] TANG Yong, GU Hong-bin. Automatic virtual view generation based on view morphing[J]. Journal of Computational Information Systems, 2011, 7(6): 2051-2057. [20] YOON K J, KWEON I S. Locally adaptive support-weight approach for visual correspondence search[C]//IEEE. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington DC: IEEE, 2005: 924-931. [21] ZITNICK C L, KANADE T. A cooperative algorithm for stereo matching and occlusion detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(7): 675-684. [22] SCHIEFELE J, ALBERT O, VAN LIER V, et al. Simple force feedback for small virtual environments[C]//SPIE. Conference of Modeling and Simulating Sensory Response for Real and Virtual Environments. Orlando: SPIE, 1998: 100-110. -
点击查看大图
图(11) / 表(1)
计量
- 文章访问数: 779
- HTML全文浏览量: 130
- PDF下载量: 823
- 被引次数: 0
