当前位置: X-MOL 学术Nat. Commun. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Mammalian-brain-inspired neuromorphic motion-cognition nerve achieves cross-modal perceptual enhancement
Nature Communications ( IF 14.7 ) Pub Date : 2023-03-11 , DOI: 10.1038/s41467-023-36935-w
Chengpeng Jiang 1, 2, 3 , Jiaqi Liu 1, 2 , Yao Ni 1, 2 , Shangda Qu 1, 2 , Lu Liu 1, 2 , Yue Li 1, 2 , Lu Yang 1, 2 , Wentao Xu 1, 2
Affiliation  

Perceptual enhancement of neural and behavioral response due to combinations of multisensory stimuli are found in many animal species across different sensory modalities. By mimicking the multisensory integration of ocular-vestibular cues for enhanced spatial perception in macaques, a bioinspired motion-cognition nerve based on a flexible multisensory neuromorphic device is demonstrated. A fast, scalable and solution-processed fabrication strategy is developed to prepare a nanoparticle-doped two-dimensional (2D)-nanoflake thin film, exhibiting superior electrostatic gating capability and charge-carrier mobility. The multi-input neuromorphic device fabricated using this thin film shows history-dependent plasticity, stable linear modulation, and spatiotemporal integration capability. These characteristics ensure parallel, efficient processing of bimodal motion signals encoded as spikes and assigned with different perceptual weights. Motion-cognition function is realized by classifying the motion types using mean firing rates of encoded spikes and postsynaptic current of the device. Demonstrations of recognition of human activity types and drone flight modes reveal that the motion-cognition performance match the bio-plausible principles of perceptual enhancement by multisensory integration. Our system can be potentially applied in sensory robotics and smart wearables.



中文翻译:

哺乳动物大脑启发的神经形态运动认知神经实现跨模态感知增强

由于多感官刺激的组合,神经和行为反应的感知增强存在于许多具有不同感官方式的动物物种中。通过模仿眼前庭线索的多感官整合以增强猕猴的空间感知,展示了一种基于灵活的多感官神经形态装置的仿生运动认知神经。开发了一种快速、可扩展和溶液处理的制造策略来制备纳米粒子掺杂的二维 (2D)-纳米薄片薄膜,表现出优异的静电门控能力和电荷载流子迁移率。使用这种薄膜制造的多输入神经形态设备显示出依赖于历史的可塑性、稳定的线性调制和时空整合能力。这些特性确保平行,有效处理编码为尖峰并分配不同感知权重的双峰运动信号。运动认知功能是通过使用编码尖峰的平均发射率和设备的突触后电流对运动类型进行分类来实现的。人类活动类型和无人机飞行模式识别的演示表明,运动认知性能符合通过多感官整合感知增强的生物合理原理。我们的系统可以潜在地应用于传感机器人和智能可穿戴设备。人类活动类型和无人机飞行模式识别的演示表明,运动认知性能符合通过多感官整合感知增强的生物合理原理。我们的系统可以潜在地应用于传感机器人和智能可穿戴设备。人类活动类型和无人机飞行模式识别的演示表明,运动认知性能符合通过多感官整合感知增强的生物合理原理。我们的系统可以潜在地应用于传感机器人和智能可穿戴设备。

更新日期:2023-03-12
down
wechat
bug