当前位置:
X-MOL 学术
›
Psychological Methods
›
论文详情
Our official English website, www.x-mol.net, welcomes your
feedback! (Note: you will need to create a separate account there.)
The potential of preregistration in psychology: Assessing preregistration producibility and preregistration-study consistency.
Psychological Methods ( IF 7.6 ) Pub Date : 2024-10-10 , DOI: 10.1037/met0000687 Olmo R van den Akker,Marjan Bakker,Marcel A L M van Assen,Charlotte R Pennington,Leone Verweij,Mahmoud M Elsherif,Aline Claesen,Stefan D M Gaillard,Siu Kit Yeung,Jan-Luca Frankenberger,Kai Krautter,Jamie P Cockcroft,Katharina S Kreuer,Thomas Rhys Evans,Frédérique M Heppel,Sarah F Schoch,Max Korbmacher,Yuki Yamada,Nihan Albayrak-Aydemir,Shilaan Alzahawi,Alexandra Sarafoglou,Maksim M Sitnikov,Filip Děchtěrenko,Sophia Wingen,Sandra Grinschgl,Helena Hartmann,Suzanne L K Stewart,Cátia M F de Oliveira,Sarah Ashcroft-Jones,Bradley J Baker,Jelte M Wicherts
Psychological Methods ( IF 7.6 ) Pub Date : 2024-10-10 , DOI: 10.1037/met0000687 Olmo R van den Akker,Marjan Bakker,Marcel A L M van Assen,Charlotte R Pennington,Leone Verweij,Mahmoud M Elsherif,Aline Claesen,Stefan D M Gaillard,Siu Kit Yeung,Jan-Luca Frankenberger,Kai Krautter,Jamie P Cockcroft,Katharina S Kreuer,Thomas Rhys Evans,Frédérique M Heppel,Sarah F Schoch,Max Korbmacher,Yuki Yamada,Nihan Albayrak-Aydemir,Shilaan Alzahawi,Alexandra Sarafoglou,Maksim M Sitnikov,Filip Děchtěrenko,Sophia Wingen,Sandra Grinschgl,Helena Hartmann,Suzanne L K Stewart,Cátia M F de Oliveira,Sarah Ashcroft-Jones,Bradley J Baker,Jelte M Wicherts
Study preregistration has become increasingly popular in psychology, but its potential to restrict researcher degrees of freedom has not yet been empirically verified. We used an extensive protocol to assess the producibility (i.e., the degree to which a study can be properly conducted based on the available information) of preregistrations and the consistency between preregistrations and their corresponding papers for 300 psychology studies. We found that preregistrations often lack methodological details and that undisclosed deviations from preregistered plans are frequent. These results highlight that biases due to researcher degrees of freedom remain possible in many preregistered studies. More comprehensive registration templates typically yielded more producible preregistrations. We did not find that the producibility and consistency of preregistrations differed over time or between original and replication studies. Furthermore, we found that operationalizations of variables were generally preregistered more producible and consistently than other study parts. Inconsistencies between preregistrations and published studies were mainly encountered for data collection procedures, statistical models, and exclusion criteria. Our results indicate that, to unlock the full potential of preregistration, researchers in psychology should aim to write more producible preregistrations, adhere to these preregistrations more faithfully, and more transparently report any deviations from their preregistrations. This could be facilitated by training and education to improve preregistration skills, as well as the development of more comprehensive templates. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
中文翻译:
心理学预注册的潜力:评估预注册可生产性和预注册-研究一致性。
研究预注册在心理学中越来越受欢迎,但其限制研究人员自由度的潜力尚未得到实证验证。我们使用了一个广泛的方案来评估 300 项心理学研究的预注册的可生产性(即,根据可用信息可以正确进行研究的程度)以及预注册与其相应论文之间的一致性。我们发现,预登记通常缺乏方法细节,并且经常出现与预登记计划未披露的偏差。这些结果强调,在许多预先注册的研究中,由于研究人员的自由度而导致的偏倚仍然存在。更全面的注册模板通常会产生更可生产的预注册。我们没有发现预登记的可重复性和一致性随时间变化或原始研究和复制研究之间存在差异。此外,我们发现变量的操作化通常比其他研究部分更可生产且更一致。预注册和已发表研究之间的不一致主要发生在数据收集程序、统计模型和排除标准方面。我们的结果表明,为了释放预登记的全部潜力,心理学研究人员应该致力于编写更多可生产的预登记,更忠实地遵守这些预登记,并更透明地报告与预登记的任何偏差。这可以通过培训和教育来提高预注册技能,以及开发更全面的模板来促进。(PsycInfo 数据库记录 (c) 2024 APA,保留所有权利)。
更新日期:2024-10-10
中文翻译:
心理学预注册的潜力:评估预注册可生产性和预注册-研究一致性。
研究预注册在心理学中越来越受欢迎,但其限制研究人员自由度的潜力尚未得到实证验证。我们使用了一个广泛的方案来评估 300 项心理学研究的预注册的可生产性(即,根据可用信息可以正确进行研究的程度)以及预注册与其相应论文之间的一致性。我们发现,预登记通常缺乏方法细节,并且经常出现与预登记计划未披露的偏差。这些结果强调,在许多预先注册的研究中,由于研究人员的自由度而导致的偏倚仍然存在。更全面的注册模板通常会产生更可生产的预注册。我们没有发现预登记的可重复性和一致性随时间变化或原始研究和复制研究之间存在差异。此外,我们发现变量的操作化通常比其他研究部分更可生产且更一致。预注册和已发表研究之间的不一致主要发生在数据收集程序、统计模型和排除标准方面。我们的结果表明,为了释放预登记的全部潜力,心理学研究人员应该致力于编写更多可生产的预登记,更忠实地遵守这些预登记,并更透明地报告与预登记的任何偏差。这可以通过培训和教育来提高预注册技能,以及开发更全面的模板来促进。(PsycInfo 数据库记录 (c) 2024 APA,保留所有权利)。