当前位置: X-MOL 学术IEEE Signal Proc. Mag. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
The EXPERIENCE Project: Automatic virtualization of “extended personal reality” through biomedical signal processing and explainable artificial intelligence [Applications Corner]
IEEE Signal Processing Magazine ( IF 14.9 ) Pub Date : 2024-04-16 , DOI: 10.1109/msp.2023.3344430
Gaetano Valenza 1 , Mariano Alcañiz 2 , Vladimir Carli 3 , Gabriela Dudnik 4 , Claudio Gentili 5 , Jaime Guixeres Provinciale 6 , Simone Rossi 7 , Nicola Toschi 8 , Virginie van Wassenhove 9
Affiliation  

The transformation of communication media has revolutionized social interactions, incorporating audio and video into our lives. Despite the recent availability of virtual reality (VR) technology, its widespread adoption faces obstacles. Technological challenges in creating VR environments and scientific confounding concerning interindividual variability in responses to virtual simulations are key factors hindering its broader integration. The EXPERIENCE project makes real the complex interplay among multisensory perception, emotional responses, and extended social interactions by allowing the public-at-large to create their own VR environments automatically through portable devices (e.g., smartphones/tablets) without the need for technical skills. The VR environment augmented by an individual’s physiological responses, psychological and cognitive descriptors, and behavioral outcomes defines the individual’s subjective experience, namely, an individual’s extended personal reality (EPR). The virtualization of a person’s EPR provides a holistic and quantitative environment that can be shared with others to transfer personalized psychological and emotional responses. Additionally, EPR assessment enables subsequent manipulation of the VR through explainable artificial intelligence (AI) routines merging multisensory biofeedback, individualized perception of time-space, and neuromodulation. This technology can be exploited in a plethora of innovative scenarios, including mental healthcare, gaming, e-learning, and neuroeconomics, also leading to the creation of a new market for sharing and selling (virtual) experiences .

中文翻译:

体验项目:通过生物医学信号处理和可解释的人工智能自动虚拟化“扩展的个人现实”[应用角]

通信媒体的变革彻底改变了社交互动,将音频和视频融入我们的生活。尽管虚拟现实(VR)技术最近出现,但其广泛采用仍面临障碍。创建 VR 环境的技术挑战以及虚拟模拟反应中个体间差异的科学混杂是阻碍其更广泛集成的关键因素。 EXPERIENCE 项目允许公众通过便携式设备(例如智能手机/平板电脑)自动创建自己的 VR 环境,无需任何技术技能,从而实现多感官知觉、情绪反应和扩展社交互动之间复杂的相互作用。 。由个人的生理反应、心理和认知描述符以及行为结果增强的 VR 环境定义了个人的主观体验,即个人的扩展个人现实(EPR)。个人 EPR 的虚拟化提供了一个整体的、定量的环境,可以与他人共享,以传递个性化的心理和情绪反应。此外,EPR 评估还可以通过可解释的人工智能 (AI) 例程,结合多感官生物反馈、个性化时空感知和神经调节来对 VR 进行后续操作。该技术可用于多种创新场景,包括心理保健、游戏、电子学习和神经经济学,也可以创建一个新的共享和销售市场(虚拟)经历。
更新日期:2024-04-16
down
wechat
bug