Assistive Magnetic Skin System for Speech Reconstruction: An Empowering Technology for Aphonic Individuals,Advanced Intelligent Systems

当前位置： X-MOL 学术 › Adv. Intell. Syst. › 论文详情

Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)

Assistive Magnetic Skin System for Speech Reconstruction: An Empowering Technology for Aphonic Individuals
Advanced Intelligent Systems ( IF 6.8 ) Pub Date : 2023-11-28 , DOI: 10.1002/aisy.202300452
Montserrat Ramirez-De Angel ₁ , Abdullah S. Almansouri ₂ , Khaled N. Salama ₁

Affiliation

Individuals with a voice disorder or speech sound disorder (SSD) (i.e., aphonic or mute people) can have any combination of difficulties with perception, articulation/motor production, and phonotactics, which may impact their speech intelligibility and acceptability, thus finding challenging to communicate with the public. As a result, many individuals suffer from frustration, isolation, and depression. Natural verbal communication for SSD patients is now more feasible than ever thanks to advancements in wearable artificial skins and machine learning. This article presents an assistive magnetic skin system for speech reconstruction (AM2S-SR), which enables SSD-afflicted people to communicate with their mouths. Using magnetic field sensors integrated into Magnetphones, the system reads the movement of the mouth by tracking the movement of magnetic skin patches attached next to the bottom lip. The measured magnetic field signals data are then processed using a Fine K-Nearest Neighbor machine learning classifier. The classified data are then exported verbally on speakers, or visually on a display. AM2S-SR successfully identifies the full English alphabets with average success rate of 94.96%, thus enabling SSD people to talk using the mouth and have a more natural conversation with others.

中文翻译：

用于言语重建的辅助磁性皮肤系统：一项为失声者提供支持的技术

患有语音障碍或言语声音障碍 (SSD) 的个体（即失音或哑巴的人）可能会出现感知、发音/运动产生和语音定向方面的任何困难，这可能会影响他们的言语清晰度和可接受性，因此发现对他们来说具有挑战性。与公众沟通。结果，许多人遭受挫折、孤立和抑郁。由于可穿戴人造皮肤和机器学习的进步，SSD 患者的自然语言交流现在比以往任何时候都更加可行。本文介绍了一种用于语音重建的辅助磁性皮肤系统 (AM2S-SR)，它使受 SSD 困扰的人能够用嘴进行交流。该系统使用集成到磁性电话中的磁场传感器，通过跟踪附着在下唇旁边的磁性皮肤贴片的运动来读取口腔的运动。然后使用精细 K 最近邻机器学习分类器处理测量的磁场信号数据。然后，分类数据会通过扬声器以口头方式导出，或者以视觉方式在显示器上导出。AM2S-SR成功识别完整英文字母，平均成功率高达94.96%，使SSD人能够用嘴说话，与他人进行更自然的对话。

更新日期：2023-11-28

点击分享查看原文

点击收藏

公开下载

阅读更多本刊新发论文