While a great deal of thought, planning, and money goes into the design of multisite randomized control trials (RCTs) that are used to evaluate the effectiveness of interventions in fields like education and psychology, relatively little thought is often paid to the measurement choices made in such evaluations. In this study, we conduct a series of simulation studies that consider a wide range of options for producing scores from multiple administration of assessments in the context of multisite RCTs. The scoring models considered range from the simple (sum scores) to highly complex (multilevel two-tier item response theory [IRT] models with latent regression). We find that the true treatment effect is attenuated when sum scores or scores from IRT models that do not account for treatment assignment are used. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

中文翻译：

---

多中心随机对照试验中的评分评估：检查治疗效果估计对测量选择的敏感性。


虽然在设计用于评估教育和心理学等领域干预措施有效性的多中心随机对照试验 (RCT) 时投入了大量的思考、计划和资金，但人们通常很少考虑所做出的测量选择在这样的评价中。在这项研究中，我们进行了一系列模拟研究，考虑了在多中心随机对照试验的背景下通过多次评估管理产生分数的多种选择。考虑的评分模型范围从简单（总分）到高度复杂（具有潜在回归的多级两层项目反应理论 [IRT] 模型）。我们发现，当使用不考虑治疗分配的 IRT 模型的总分或分数时，真实的治疗效果会减弱。 （PsycInfo 数据库记录 (c) 2023 APA，保留所有权利）。