Objectives

This systematic review examined the reporting practices of propensity score modeling (PSM) in criminology and criminal justice studies.

Methods

There were 229 articles (with 527 individual sets of PSM analyses) published between 2000 and 2022 in the top 19 ranked criminology and criminal justice journals that were identified for study inclusion. These articles were systematically coded to assess the presence of key PSM reporting elements, including covariates, estimation methods, balancing strategy, matching type, sample size, balance assessment, sensitivity analysis, and post-PSM analyses.

Results

The use of PSM has increased dramatically over the last two decades. Study findings suggest that while there are many areas where the discipline has improved reporting over the last 22 years, there are still others that are sorely lacking. Our review reveals that only 28.9% of studies reported the propensity score technique used, 21.8% did not report pre- or post-PSM sample information, and 26.6% of all studies examined either did not report a balance assessment or reported using only one assessment which were largely null hypothesis significance testing.

Conclusions

Our findings provide a baseline assessment of PSM reporting and provide some guidance for conducting, reviewing, and publishing PSM research in criminology and criminal justice journals.

中文翻译：

---

更高的期望：刑事司法研究中倾向评分建模科学的系统评价

 目标

本系统综述检查了犯罪学和刑事司法研究中倾向评分建模 （PSM） 的报告实践。

 方法

2000 年至 2022 年间，在排名前 19 的犯罪学和刑事司法期刊上发表了 229 篇文章（包括 527 组单独的 PSM 分析），这些文章被确定纳入研究。这些文章经过系统编码，以评估关键 PSM 报告要素的存在，包括协变量、估计方法、平衡策略、匹配类型、样本量、平衡评估、敏感性分析和 PSM 后分析。

 结果

在过去的二十年里，PSM 的使用急剧增加。研究结果表明，虽然该学科在过去 22 年中在许多领域改进了报告，但仍有其他领域严重缺乏。我们的综述显示，只有 28.9% 的研究报告了所使用的倾向评分技术，21.8% 的研究没有报告 PSM 前后的样本信息，26.6% 的研究没有报告平衡评估或仅使用一项评估报告，这些评估主要是零假设显着性检验。

 结论

我们的研究结果提供了对 PSM 报告的基线评估，并为在犯罪学和刑事司法期刊上开展、审查和发表 PSM 研究提供了一些指导。