Communication Methods and Measures ( IF 6.3 ) Pub Date : 2022-06-27 , DOI: 10.1080/19312458.2022.2088713 Stephanie K. Van Stee 1 , Qinghua Yang 2 , Stephen A. Rains 3
ABSTRACT
Insufficient statistical reporting practices (ISRPs) involve failure to report effect sizes or the information necessary to compute them in quantitative research. ISRPs can present problems for advancing knowledge in the field of Communication. Because, among other issues, studies containing ISRPs cannot be included in meta-analytic reviews, this practice undermines our ability to quantitatively summarize the findings from communication research with precision. We examine the prevalence and consequences of ISRPs among 50 meta-analyses published in four flagship communication journals. Our findings indicate that 80% of meta-analyses excluded at least one otherwise qualified primary study due to ISRPs, with a median of 6.5% of studies (k = 2) excluded per meta-analysis. The amount of inaccuracy introduced by ISRPs in the results of meta-analyses was small. Implications of the findings for communication research are discussed.
中文翻译:
通信元分析中不充分统计报告实践的实证调查及其后果
摘要
不充分的统计报告实践 (ISRP) 涉及未能报告效应大小或在定量研究中计算它们所需的信息。ISRP 可能会为传播领域的知识进步带来问题。因为,除其他问题外,包含 ISRP 的研究不能包含在元分析评论中,这种做法削弱了我们精确地定量总结传播研究结果的能力。我们在四家旗舰通讯期刊上发表的 50 项荟萃分析中检查了 ISRP 的流行程度和后果。我们的研究结果表明,80% 的荟萃分析因 ISRP 而排除了至少一项其他方面合格的初步研究,中位数为 6.5% 的研究(k= 2) 根据荟萃分析排除。ISRP 在荟萃分析结果中引入的不准确性很小。讨论了研究结果对传播研究的影响。