基于可穿戴设备和增强现实的数字表演交互式系统
igital Performance Interactive System Based on Wearable Computing and Augmented Reality
本文利用可穿戴设备和增强现实技术,根据传感器采集到的表演者动作数据信息,在增强现实环境中进行实时的(视觉)反馈,以第三视角的方式对表演者动作信息进行捕获和定位,实现自动监测的目的。为了实现沉浸式视觉反馈交互环境,本研究设计开发了数字表演交互式系统和前置双目摄像头的无线头戴显示设备,将视觉场景与目标表演者的动作图像进行自然融合。文中交互式系统还包括排演练习及骨骼标准检测,通过数字化的形式实时反馈给表演者,增强表演排演过程的交互性,提高表演动作的准确度和信息反馈效率。实验结果表明,本研究中的方法基本能够满足表演者动作数据采集和第三视角行为监测的需求,并且通过可穿戴显示设备实现实时的视觉增强反馈,对创建新型的数字表演交互方式具有重要的研究意义和应用推广价值。
his research aims to create real-time visual feedback and enable automatic monitoring in augmented reality environment by obtaining and positioning performer's movement in a third-person view. In order to achieve an immersive visual interactive environment, this research design and develop a digital performance interactive system and a wireless two front camera Head-mounted display (HMD), which combines the target performer's movement and real world scenario. In this paper, the interactive system includes rehearsal and skeleton detection. The system provides digital information as real-time feedbacks, which enhances the interactivity during performance rehearsal, increases the accuracy of exercise and efficiency of feedback. The result shows that this system could meet the require of performer's movement data collection and automatic monitor in a third-person view, it has the important research significance and is valuable to implement and spread.
张龙飞、张睿、闫烁、丁刚毅
电子技术应用计算技术、计算机技术自动化技术、自动化技术设备
数字表演人机交互增强现实舞蹈排演表演评估
igital perormanceHuman-computer interactionAugmented realityDance trainingPerforming evaluation
张龙飞,张睿,闫烁,丁刚毅.基于可穿戴设备和增强现实的数字表演交互式系统[EB/OL].(2016-05-27)[2025-08-11].http://www.paper.edu.cn/releasepaper/content/201605-1396.点此复制
评论