This paper presents a human-centric mixed reality (MR) collaborative training platform that employs a kinesthetic learning technique in industrial robotic training, specifically focusing on robot pick–and–place (RPP) operations. Collaborating with ABB Robotics Vietnam, we conducted a user study to investigate the user experiences and practical perceptions of university students and novice trainees via the human–centric training assessment. The study compares the traditional training (TT) RPP classroom as a conventional method with a new collaborative MR RPP training approach (N = 50). The MR training features a digital twin (DT) of ABB GoFa™ CRB–15000 collaborative robot in an immersive 360° Digital–Objects–Based Augmented Training Environment (360–ATE) using Microsoft HoloLens devices. The research evaluated the impact of MR and DT on human–robot interaction and collaboration, user experience, task performance, knowledge retention, and interpretation, as well as differences in perceptions between the two novice cohorts under each training condition. The primary research question explores “Whether the MR collaborative training platform with DT integration in 360–ATE can serve as an alternative approach for novice students and industrial trainees in RPP operations?”. The findings indicate that MR training is more engaging and effective in enhancing participant safety, confidence, and task performance, which also augments cognitive capabilities. The virtual contents on HoloLens, especially the DT, captured the attention and stimulated active learning abilities. Overall, participants in the MR cohort find the proposed training platform useful and easy to use. The platform has a positive influence on their intention to use similar 360–ATE–assisted training platforms in the future.

中文翻译：

---

在以人为本的工业系统中，通过动觉学习和数字孪生为机器人训练提供支持


本文提出了一个以人为本的混合现实 （MR） 协作训练平台，该平台在工业机器人训练中采用动觉学习技术，特别关注机器人拾取和放置 （RPP） 操作。我们与 ABB 机器人越南合作开展了一项用户研究，通过以人为本的培训评估来调查大学生和新手学员的用户体验和实际感知。该研究将作为传统方法的传统培训 （TT） RPP 课堂与新的协作 MR RPP 培训方法 （N = 50） 进行了比较。MR 培训使用 Microsoft HoloLens 设备，在沉浸式 360° 基于数字对象的增强训练环境 （360-ATE） 中，采用 ABB GoFa™ CRB-15000 协作机器人的数字孪生 （DT）。该研究评估了 MR 和 DT 对人机交互和协作、用户体验、任务绩效、知识保留和解释的影响，以及在每种训练条件下两个新手队列之间的感知差异。主要研究问题探讨了“在 360-ATE 中集成了 DT 的 MR 协作培训平台是否可以作为 RPP 操作中的新手学生和工业实习生的替代方法？研究结果表明，MR 训练在提高参与者的安全、信心和任务表现方面更具吸引力和有效性，这也增强了认知能力。HoloLens 上的虚拟内容，尤其是 DT，吸引了人们的注意力并激发了主动学习能力。总体而言，MR 队列的参与者发现拟议的培训平台有用且易于使用。 该平台对他们未来使用类似的 360 度 ATE 辅助培训平台的意图产生了积极影响。