当前位置:
X-MOL 学术
›
Organ. Res. Methods
›
论文详情
Our official English website, www.x-mol.net, welcomes your
feedback! (Note: you will need to create a separate account there.)
Mixed-Keying or Desirability-Matching in the Construction of Forced-Choice Measures? An Empirical Investigation and Practical Recommendations
Organizational Research Methods ( IF 8.9 ) Pub Date : 2024-02-15 , DOI: 10.1177/10944281241229784 Mengtong Li 1 , Bo Zhang 1, 2 , Lingyue Li 1 , Tianjun Sun 3 , Anna Brown 4
Organizational Research Methods ( IF 8.9 ) Pub Date : 2024-02-15 , DOI: 10.1177/10944281241229784 Mengtong Li 1 , Bo Zhang 1, 2 , Lingyue Li 1 , Tianjun Sun 3 , Anna Brown 4
Affiliation
Forced-choice (FC) measures are becoming increasingly popular as an alternative to single-statement (SS) measures. However, to ensure the practical usefulness of an FC measure, it is crucial to address the tension between psychometric properties and faking resistance by balancing mixed keying and social desirability matching. It is currently unknown from an empirical perspective whether the two design criteria can be reconciled, and how they impact respondent reactions. By conducting a two-wave experimental design, we constructed four FC measures with varying degrees of mixed-keying and social desirability matching from the same statement pool and investigated their differences in terms of psychometric properties, faking resistance, and respondent reactions. Results showed that all FC measures demonstrated comparable reliability and induced similar respondent reactions. Forced-choice measures with stricter social desirability matching were more faking resistant, while FC measures with more mixed keyed blocks had higher convergent validity with the SS measure and displayed similar discriminant and criterion-related validity profiles as the SS benchmark. More importantly, we found that it is possible to strike a balance between social desirability matching and mixed keying, such that FC measures can have adequate psychometric properties and faking resistance. A seven-step recommendation and a tutorial based on the autoFC R package were provided to help readers construct their own FC measures.
中文翻译:
强制选择措施构建中的混合键控还是意愿匹配?实证研究和实用建议
强制选择 (FC) 措施作为单语句 (SS) 措施的替代方案变得越来越流行。然而,为了确保FC措施的实际有用性,通过平衡混合键控和社会愿望匹配来解决心理测量属性和假装抵抗之间的紧张关系至关重要。目前从实证角度尚不清楚这两个设计标准是否可以协调,以及它们如何影响受访者的反应。通过进行两波实验设计,我们从同一陈述池中构建了四种具有不同程度的混合键控和社会期望匹配的 FC 测量,并研究了它们在心理测量特性、伪造阻力和受访者反应方面的差异。结果表明,所有 FC 测量都表现出相当的可靠性并引起类似的受访者反应。具有更严格的社会愿望匹配的强制选择措施更能抵抗伪造,而具有更多混合键块的 FC 措施与 SS 措施具有更高的收敛有效性,并显示出与 SS 基准相似的判别性和标准相关的有效性概况。更重要的是,我们发现可以在社会意愿匹配和混合密钥之间取得平衡,从而使 FC 测量能够具有足够的心理测量特性和抗造假性。提供了七步建议和基于 autoFC R 包的教程,以帮助读者构建自己的 FC 措施。
更新日期:2024-02-15
中文翻译:
强制选择措施构建中的混合键控还是意愿匹配?实证研究和实用建议
强制选择 (FC) 措施作为单语句 (SS) 措施的替代方案变得越来越流行。然而,为了确保FC措施的实际有用性,通过平衡混合键控和社会愿望匹配来解决心理测量属性和假装抵抗之间的紧张关系至关重要。目前从实证角度尚不清楚这两个设计标准是否可以协调,以及它们如何影响受访者的反应。通过进行两波实验设计,我们从同一陈述池中构建了四种具有不同程度的混合键控和社会期望匹配的 FC 测量,并研究了它们在心理测量特性、伪造阻力和受访者反应方面的差异。结果表明,所有 FC 测量都表现出相当的可靠性并引起类似的受访者反应。具有更严格的社会愿望匹配的强制选择措施更能抵抗伪造,而具有更多混合键块的 FC 措施与 SS 措施具有更高的收敛有效性,并显示出与 SS 基准相似的判别性和标准相关的有效性概况。更重要的是,我们发现可以在社会意愿匹配和混合密钥之间取得平衡,从而使 FC 测量能够具有足够的心理测量特性和抗造假性。提供了七步建议和基于 autoFC R 包的教程,以帮助读者构建自己的 FC 措施。