-
Manipulation in Organizational Research: On Executing and Interpreting Designs from Treatments to Primes Organ. Res. Methods (IF 8.9) Pub Date : 2024-12-17 Kira F. Schabram, Christopher G. Myers, Ashley E. Hardin
While other applied sciences systematically distinguish between manipulation designs, organizational research does not. Herein, we disentangle distinct applications that differ in how the manipulation is deployed, analyzed, and interpreted in support of hypotheses. First, we define two archetypes: treatments, experimental designs that expose participants to different levels/types of a manipulation
-
Measuring Personality When Stakes Are High: Are Graded Paired Comparisons a More Reliable Alternative to Traditional Forced-Choice Methods? Organ. Res. Methods (IF 8.9) Pub Date : 2024-12-13 Harriet Lingel, Paul-Christian Bürkner, Klaus G. Melchers, Niklas Schulte
In graded paired comparisons (GPCs), two items are compared using a multipoint rating scale. GPCs are expected to reduce faking compared with Likert-type scales and to produce more reliable, less ipsative trait scores than traditional binary forced-choice formats. To investigate the statistical properties of GPCs, we simulated 960 conditions in which we varied six independent factors and additionally
-
The Internet Never Forgets: A Four-Step Scraping Tutorial, Codebase, and Database for Longitudinal Organizational Website Data Organ. Res. Methods (IF 8.9) Pub Date : 2024-11-04 Richard F.J. Haans, Marc J. Mertens
Websites represent a crucial avenue for organizations to reach customers, attract talent, and disseminate information to stakeholders. Despite their importance, strikingly little work in the domain of organization and management research has tapped into this source of longitudinal big data. In this paper, we highlight the unique nature and profound potential of longitudinal website data and present
-
One Size Does Not Fit All: Unraveling Item Response Process Heterogeneity Using the Mixture Dominance-Unfolding Model (MixDUM) Organ. Res. Methods (IF 8.9) Pub Date : 2024-09-14 Bo Zhang, R. Philip Chalmers, Lingyue Li, Tianjun Sun, Louis Tay
When modeling responses to items measuring non-cognitive constructs that require introspection (e.g., personality, attitude), most studies have assumed that respondents follow the same item response process—either a dominance or an unfolding one. Nevertheless, the results are not equivocal, as some preliminary evidence suggests that some people use an unfolding response process, whereas others use
-
Taking It Easy: Off-the-Shelf Versus Fine-Tuned Supervised Modeling of Performance Appraisal Text Organ. Res. Methods (IF 8.9) Pub Date : 2024-08-28 Andrew B. Speer, James Perrotta, Tobias L. Kordsmeyer
When assessing text, supervised natural language processing (NLP) models have traditionally been used to measure targeted constructs in the organizational sciences. However, these models require significant resources to develop. Emerging “off-the-shelf” large language models (LLM) offer a way to evaluate organizational constructs without building customized models. However, it is unclear whether off-the-shelf
-
The Effects of the Training Sample Size, Ground Truth Reliability, and NLP Method on Language-Based Automatic Interview Scores’ Psychometric Properties Organ. Res. Methods (IF 8.9) Pub Date : 2024-07-25 Louis Hickman, Josh Liff, Caleb Rottman, Charles Calderwood
While machine learning (ML) can validly score psychological constructs from behavior, several conditions often change across studies, making it difficult to understand why the psychometric properties of ML models differ across studies. We address this gap in the context of automatically scored interviews. Across multiple datasets, for interview- or question-level scoring of self-reported, tested, and
-
Hello World! Building Computational Models to Represent Social and Organizational Theory Organ. Res. Methods (IF 8.9) Pub Date : 2024-07-25 James A. Grand, Michael T. Braun, Goran Kuljanin
Computational modeling holds significant promise as a tool for improving how theory is developed, expressed, and used to inform empirical research and evaluation efforts. However, the knowledge and skillsets needed to build computational models are rarely developed in the training received by social and organizational scientists. The purpose of this manuscript is to provide an accessible introduction
-
Enhancing Causal Pursuits in Organizational Science: Targeting the Effect of Treatment on the Treated in Research on Vulnerable Populations Organ. Res. Methods (IF 8.9) Pub Date : 2024-05-02 Wen Wei Loh, Dongning Ren
Understanding the experiences of vulnerable workers is an important scientific pursuit. For example, research interest is often in quantifying the impacts of adverse exposures such as discrimination, exclusion, harassment, or job insecurity, among others. However, routine approaches have only focused on the average treatment effect, which encapsulates the impact of an exposure (e.g., discrimination)
-
Analyzing Social Interaction in Organizations: A Roadmap for Reflexive Choice Organ. Res. Methods (IF 8.9) Pub Date : 2024-04-22 Linda Jakob Sadeh, Avital Baikovich, Tammar B. Zilber
This article proposes a framework for reflexive choice in qualitative research, centering on social interaction. Interaction, fundamental to social and organizational life, has been studied extensively. Yet, researchers can get lost in the plethora of methodological tools, hampering reflexive choice. Our proposed framework consists of four dimensions of interaction (content, communication patterns
-
Simulating Virtual Organizations for Research: A Comparative Empirical Evaluation of Text-Based, Video, and Virtual Reality Video Vignettes Organ. Res. Methods (IF 8.9) Pub Date : 2024-04-17 Anand P. A. van Zelderen, Theodore C. Masters-Waage, Nicky Dries, Jochen I. Menges, Diana R. Sanchez
Due to recent technological developments, vignette studies that have traditionally been done in text or video formats can now be done in immersive formats using virtual reality—but are such virtual reality video vignettes superior to traditional vignettes? To address this question, we examine participants’ experiences within a fictitious organization by comparing their responses to a relevant and particularly
-
Advancing Qualitative Meta-Studies (QMS): Current Practices and Reflective Guidelines for Synthesizing Qualitative Research Organ. Res. Methods (IF 8.9) Pub Date : 2024-04-17 Stefanie Habersang, Markus Reihlen
Qualitative meta-studies (QMS) have emerged as a promising methodology for synthesizing qualitative research within organization and management studies. However, despite considerable progress, increasingly fragmented applications of QMS impede the advancement of the methodology. To address this issue, we review and analyze the expanding body of QMS in organization and management studies. We propose
-
A Framework for Detecting Both Main Effect and Interactive DIF in Multidimensional Forced-Choice Assessments Organ. Res. Methods (IF 8.9) Pub Date : 2024-04-13 Kai Liu, Yi Zheng, Daxun Wang, Yan Cai, Yuanyuan Shi, Chongqin Xi, Dongbo Tu
In recent decades, multidimensional forced-choice (MFC) tests have gained widespread popularity in organizational settings due to their effectiveness in reducing response biases. Detecting differential item functioning (DIF) is crucial in developing MFC tests, as it relates to test fairness and validity. However, existing methods appear insufficient for detecting DIF induced by the interaction between
-
Mixed-Keying or Desirability-Matching in the Construction of Forced-Choice Measures? An Empirical Investigation and Practical Recommendations Organ. Res. Methods (IF 8.9) Pub Date : 2024-02-15 Mengtong Li, Bo Zhang, Lingyue Li, Tianjun Sun, Anna Brown
Forced-choice (FC) measures are becoming increasingly popular as an alternative to single-statement (SS) measures. However, to ensure the practical usefulness of an FC measure, it is crucial to address the tension between psychometric properties and faking resistance by balancing mixed keying and social desirability matching. It is currently unknown from an empirical perspective whether the two design
-
Building a Bigger Toolbox: The Construct Validity of Existing and Proposed Measures of Careless Responding to Cognitive Ability Tests Organ. Res. Methods (IF 8.9) Pub Date : 2024-02-14 Mark C. Ramsey, Nathan A. Bowling
Employers commonly use cognitive ability tests in the personnel selection process. Although ability tests are excellent predictors of job performance, their validity may be compromised when test takers engage in careless responding. It is thus important for researchers to have access to effective careless responding measures, which allow researchers to screen for careless responding and to evaluate
-
From Textual Data to Theoretical Insights: Introducing and Applying the Word-Text-Topic Extraction Approach Organ. Res. Methods (IF 8.9) Pub Date : 2024-01-31 Jaewoo Jung, Wenjun Zhou, Anne D. Smith
Text analysis, particularly custom dictionaries and topic modeling, has helped advance management and organization theory. Custom dictionaries involve creating word lists to quantify patterns and infer constructs, while topic modeling extracts themes from textual documents to help understand a theoretical domain. Building on these two approaches, we propose another text analysis approach called word-text-topic
-
Confounding Effects of Insufficient Effort Responding Across Survey Sources: The Case of Personality Predicting Performance Organ. Res. Methods (IF 8.9) Pub Date : 2024-01-23 Jason L. Huang, Nathan A. Bowling, Benjamin D. McLarty, Donald H. Kluemper, Zhonghao Wang
Insufficient effort responding (IER) to surveys, which occurs when participants provide responses in a haphazard, careless, or random fashion, has been identified as a threat to data quality in survey research because it can inflate observed relationships between self-reported measures. Building on this discovery, we propose two mechanisms that lead to IER exerting an unexpected confounding effect
-
Five Is the Brightest Star. But by how Much? Testing the Equidistance of Star Ratings in Online Reviews Organ. Res. Methods (IF 8.9) Pub Date : 2024-01-09 Balázs Kovács
Organizational research increasingly relies on online review data to gauge perceived valuation and reputation of organizations and products. Online review platforms typically collect ordinal ratings (e.g., 1 to 5 stars); however, researchers often treat them as a cardinal data, calculating aggregate statistics such as the average, the median, or the variance of ratings. In calculating these statistics
-
Assessing Common-Metric Effect Sizes to Refine Mediation Models Organ. Res. Methods (IF 8.9) Pub Date : 2023-05-08 Juan I. Sanchez, Chen Wang, Ajay R. Ponnapalli, Hock-Peng Sin, Le Xu, Maria Lapeira, Mohan Song
Mediation analysis tests X → M → Y processes in which an independent variable (X) exerts an indirect effect on a dependent variable (Y) through its influence on an intervening or mediator variable ...
-
Out of Shape: The Implications of (Extremely) Nonnormal Dependent Variables Organ. Res. Methods (IF 8.9) Pub Date : 2023-05-07 S. Trevis Certo, Kristen Raney, Latifa Albader, John R. Busenbark
Organizational researchers have increasingly noted the problems associated with nonnormal dependent variable distributions. Most of this scholarship focuses on variables with positive values and lo...
-
Team Composition Revisited: Expanding the Team Member Attribute Alignment Approach to Consider Patterns of More Than Two Attributes Organ. Res. Methods (IF 8.9) Pub Date : 2023-05-03 Kyle J. Emich, Michael McCourt, Li Lu, Amanda Ferguson, Randall Peterson
The attribute alignment approach to team composition allows researchers to assess variation in team member attributes, which occurs simultaneously within and across individual team members. This ap...
-
Macro-iterativity: A Qualitative Multi-arc Design for Studying Complex Issues and Big Questions Organ. Res. Methods (IF 8.9) Pub Date : 2023-04-17 Christina Hoon, Alina M. Baluch
The impact and relevance of our discipline's research is determined by its ability to engage the big questions of the grand challenges we face today. Our central argument is that we need innovative...
-
“Transforming” Personality Scale Development: Illustrating the Potential of State-of-the-Art Natural Language Processing Organ. Res. Methods (IF 8.9) Pub Date : 2023-03-06 Shea Fyffe, Philseok Lee, Seth Kaplan
Natural language processing (NLP) techniques are becoming increasingly popular in industrial and organizational psychology. One promising area for NLP-based applications is scale development; yet, ...
-
Supervised Construct Scoring to Reduce Personality Assessment Length: A Field Study and Introduction to the Short 10 Organ. Res. Methods (IF 8.9) Pub Date : 2023-01-03 Andrew B. Speer, James Perrotta, Rick R. Jacobs
Personality assessments help identify qualified job applicants when making hiring decisions and are used broadly in the organizational sciences. However, many existing personality measures are quit...
-
Review Research as Scientific Inquiry Organ. Res. Methods (IF 8.9) Pub Date : 2022-12-26 Sven Kunisch, David Denyer, Jean M. Bartunek, Markus Menz, Laura B. Cardinal
This article and the related Feature Topic at Organizational Research Methods upcoming were motivated by the concern that despite the bourgeoning number and diversity of review articles, there was ...
-
SRM_R: A Web-Based Shiny App for Social Relations Analyses Organ. Res. Methods (IF 8.9) Pub Date : 2022-11-20 Man-Nok Wong, David A. Kenny, Andrew P. Knight
Many topics in organizational research involve examining the interpersonal perceptions and behaviors of group members. The resulting data can be analyzed using the social relations model (SRM). Thi...
-
Sensitizing Social Interaction with a Mode-Enhanced Transcribing Process Organ. Res. Methods (IF 8.9) Pub Date : 2022-10-31 Qian Li
Qualitative researchers often work with texts transcribed from social interactions such as interviews, meetings, and presentations. However, how we make sense of such data to generate promising cue...
-
Assessment of Path Model Fit: Evidence of Effectiveness and Recommendations for use of the RMSEA-P Organ. Res. Methods (IF 8.9) Pub Date : 2022-10-17 Larry J. Williams, Aaron R. Williams, Ernest H. O’Boyle
We review the development of path model fit measures for latent variable models and highlight how they are different from global fit measures. Next, we consider findings from two published simulati...
-
Should Moderated Regressions Include or Exclude Quadratic Terms? Present Both! Then Apply Our Linear Algebraic Analysis to Identify the Preferable Specification Organ. Res. Methods (IF 8.9) Pub Date : 2022-10-11 Arturs Kalnins
Organizational research increasingly tests moderated relationships using multiple regression with interaction terms. Most research does so with little concern regarding curvilinear relationships. B...
-
Measuring What Matters: Assessing how Executives Reference Firm Performance in Corporate Filings Organ. Res. Methods (IF 8.9) Pub Date : 2022-10-11 S. Trevis Certo, Chunhu Jeon, Kristen Raney, Wookyung Lee
We know very little about the performance measures executives use to make decisions. To fill this void, we investigate the performance variables that executives reference in corporate filings with ...
-
Advancing Reproducibility and Accountability of Unsupervised Machine Learning in Text Mining: Importance of Transparency in Reporting Preprocessing and Algorithm Selection Organ. Res. Methods (IF 8.9) Pub Date : 2022-09-21 L. Valtonen, Saku J. Mäkinen, Johanna Kirjavainen
Machine learning (ML) enables the analysis of large datasets for pattern discovery. ML methods and the standards for their use have recently attracted increasing attention in organizational researc...
-
Reviewer Resources: Confirmatory Factor Analysis Organ. Res. Methods (IF 8.9) Pub Date : 2022-08-31 Christopher D. Nye
Confirmatory factor analyses (CFA) are widely used in the organizational literature. As a result, understanding how to properly conduct these analyses, report the results, and interpret their impli...
-
Corrigendum to Using CATA and Machine Learning to Operationalize Old Constructs in New Ways: An Illustration Using U.S. Governors’ COVID-19 Press Briefings Organ. Res. Methods (IF 8.9) Pub Date : 2022-08-21
Marshall, J. D., Yammarino, F. J., Parameswaran, S., & Cheong, M. (2022). Using CATA and machine learning to operationalize old constructs in new ways: An illustration using U.S. governors’ COVID-19 press briefings. Organizational Research Methods. Advance Online Publication. https://doi.org/10.1177/10944281221098607
-
Construct Development and Validation in Three Practical Steps: Recommendations for Reviewers, Editors, and Authors* Organ. Res. Methods (IF 8.9) Pub Date : 2022-08-15 Lisa Schurer Lambert, Daniel A. Newman
We review contemporary best practice for developing and validating measures of constructs in the organizational sciences. The three basic steps in scale development are: (a) construct definition, (...
-
Entwined Positionality and Interpretive Frames of Reference: An Autoethnographic Account Organ. Res. Methods (IF 8.9) Pub Date : 2022-06-30 Yemisi Bolade-Ogunfodun, Lebene Richmond Soga, Benjamin Laker
This paper investigates the ethnographic researcher's positionality and its role in sensemaking within the research process. Using autoethnographic data of the first author - a black female West Af...
-
Using CATA and Machine Learning to Operationalize Old Constructs in New Ways: An Illustration Using U.S. Governors’ COVID-19 Press Briefings Organ. Res. Methods (IF 8.9) Pub Date : 2022-05-12 Jason D. Marshall, Francis J. Yammarino, Srikanth Parameswaran, Minyoung Cheong
Increased computing power and greater access to online data have led to rapid growth in the use of computer-aided text analysis (CATA) and machine learning methods. Using “big data”, researchers ha...
-
From Ties to Events in the Analysis of Interorganizational Exchange Relations Organ. Res. Methods (IF 8.9) Pub Date : 2022-03-16 Federica Bianchi, Alessandro Lomi
Relational event models expand the analytical possibilities of existing statistical models for interorganizational networks by: (i) making efficient use of information contained in the sequential o...
-
How Rare Is Rare? How Common Is Common? Empirical Issues Associated With Binary Dependent Variables With Rare Or Common Event Rates Organ. Res. Methods (IF 8.9) Pub Date : 2022-03-01 Hyun-Soo Woo, John P. Berns, Pol Solanelles
The use of logit and probit models when examining binary dependent variables including those in the form 0/1 (i.e., dummy variables), yes/no, and true/false (hereafter binary DVs) is commonplace. Y...
-
Evaluating Interdependence in Workgroups: A Network-Based Method Organ. Res. Methods (IF 8.9) Pub Date : 2022-02-11 Daniel J. Griffin, Ajay V. Somaraju, Christopher Dishop, Richard P. DeShon
Interdependence is a defining characteristic of groups and teams. However, a vast range of constructs and conceptualizations for interdependence has left researchers with a dizzying array of framew...
-
Attitude Toward the Color Blue: An Ideal Marker Variable Organ. Res. Methods (IF 8.9) Pub Date : 2022-02-01 Brian K. Miller, Marcia J. Simmering
Researchers often turn to post hoc statistical techniques to identify common method variance (CMV) in same source data and one viable option is to use a marker variable. The choice of marker variab...
-
Immersion in Organizational Ethnography: Four Methodological Requirements to Immerse Oneself in the Field Organ. Res. Methods (IF 8.9) Pub Date : 2022-01-25 Guillaume Dumont
This article addresses the question of how to achieve immersion in organizational ethnography. Working through a broad set of ethnographies in organization studies, sociology, and anthropology, I develop a multi-faceted conceptualization of immersion and offer a framework that integrates four methodological principles—involvement, engagement, duration, and sites—to help organizational ethnographers
-
Endogenous Moderator Models: What They are, What They Aren’t, and Why it Matters Organ. Res. Methods (IF 8.9) Pub Date : 2022-01-06 Jose M. Cortina, Christian Dormann, Hannah M. Markell, Sheila K. Keener
Models that combine moderation and mediation are increasingly common. One such model is that in which one variable causes another variable that, in turn, moderates the relationship between two other variables. There are many recent examples of these Endogenous Moderator Models (EMMs). They bear little superficial resemblance to second-stage moderation models, and they are almost never conceptualized
-
Conducting and Evaluating Multilevel Studies: Recommendations, Resources, and a Checklist Organ. Res. Methods (IF 8.9) Pub Date : 2022-01-05 Vicente González-Romá, Ana Hernández
Multilevel methods allow researchers to investigate relationships that expand across levels (e.g., individuals, teams, and organizations). The popularity of these methods for studying organizational phenomena has increased in recent decades. Methodologists have examined how these methods work under different conditions, providing an empirical base for making sound decisions when using these methods
-
A Review of Measurement Equivalence in Organizational Research: What's Old, What's New, What's Next? Organ. Res. Methods (IF 8.9) Pub Date : 2021-12-17 Ajay V. Somaraju, Christopher D. Nye, Jeffrey Olenick
The study of measurement equivalence has important implications for organizational research. Nonequivalence across groups or over time can affect the results of a study and the conclusions that are drawn from it. As a result, the review paper by Vandenberg & Lance (2000) has been highly cited and has played an important role in understanding the measurement of organizational constructs. However, that
-
Templates in Qualitative Research Methods: Origins, Limitations, and New Directions Organ. Res. Methods (IF 8.9) Pub Date : 2021-12-16 Tine Köhler, Anne Smith, Vikram Bhakoo
In this feature topic, we explore the burgeoning trend to employ templates in qualitative research. To understand authors’ motivations to use templates and perceptions regarding template use in the scholarly community, we conducted an interview study with 21 interviewees who had published qualitative research in one of nine premier management journals between 2014 and 2018. Our analysis identified
-
The Quick and the Careless: The Construct Validity of Page Time as a Measure of Insufficient Effort Responding to Surveys Organ. Res. Methods (IF 8.9) Pub Date : 2021-12-06 Nathan A. Bowling, Jason L. Huang, Cheyna K. Brower, Caleb B. Bragg
Several recent studies have examined the prevention, causes, and consequences of insufficient effort responding (IER) to surveys. Scientific progress in this area, however, rests on the availability of construct-valid IER measures. In the current paper we describe the potential merits of the page time index, which is computed by counting the number of questionnaire pages to which a participant has
-
Erratum to Interaction Effects in Cross-Lagged Panel Models: SEM with Latent Interactions Applied to Work-Family Conflict, Job Satisfaction, and Gender Organ. Res. Methods (IF 8.9) Pub Date : 2021-12-04
Ozkok, O., Vaulont, M. J., Zyphur, M. J., Zhang, Z., Preacher, K. J., Koval, P., & Zheng, Y. (2021). Interaction effects in cross-lagged panel models: SEM with latent interactions applied to work-family conflict, job satisfaction, and gender. Organizational Research Methods. Advance online publication. https://doi.org/10.1177/10944281211043733
-
Inflection Points, Kinks, and Jumps: A Statistical Approach to Detecting Nonlinearities Organ. Res. Methods (IF 8.9) Pub Date : 2021-12-03 Peren Arin, Maria Minniti, Samuele Murtinu, Nicola Spagnolo
Inflection points, kinks, and jumps identify places where the relationship between dependent and independent variables switches in some important way. Although these switch points are often mentioned in management research, their presence in the data is either ignored, or postulated ad hoc by testing arbitrarily specified functional forms (e.g., U or inverted U-shaped relationships). This is problematic
-
The Use and Misuse of Organizational Research Methods ‘Best Practice’ Articles Organ. Res. Methods (IF 8.9) Pub Date : 2021-12-03 Liana M. Kreamer, Betsy H. Albritton, Scott Tonidandel, Steven G. Rogelberg
This study explores how researchers in the organizational sciences use and/or cite methodological ‘best practice’ (BP) articles. Namely, are scholars adhering fully to the prescribed practices they cite, or are they cherry picking from recommended practices without disclosing? Or worse yet, are scholars inaccurately following the methodological best practices they cite? To answer these questions, we
-
Making the Invisible Visible: Guidelines for the Coding Process in Meta-Analyses Organ. Res. Methods (IF 8.9) Pub Date : 2021-12-02 Jessica Villiger, Simone A. Schweiger, Artur Baldauf
This article contributes to the practice of coding in meta-analyses by offering direction and advice for experienced and novice meta-analysts on the “how” of coding. The coding process, the invisible architecture of any meta-analysis, has received comparably little attention in methodological resources, leaving the research community with insufficient guidance on “how” it should be rigorously planned
-
Interaction Effects in Cross-Lagged Panel Models: SEM with Latent Interactions Applied to Work-Family Conflict, Job Satisfaction, and Gender Organ. Res. Methods (IF 8.9) Pub Date : 2021-11-29 Ozlem Ozkok, Manuel J. Vaulont, Michael J. Zyphur, Zhen Zhang, Kristopher J. Preacher, Peter Koval, Yixia Zheng
Researchers often combine longitudinal panel data analysis with tests of interactions (i.e., moderation). A popular example is the cross-lagged panel model (CLPM). However, interaction tests in CLPMs and related models require caution because stable (i.e., between-level, B) and dynamic (i.e., within-level, W) sources of variation are present in longitudinal data, which can conflate estimates of interaction
-
Inaugural Editorial Organ. Res. Methods (IF 8.9) Pub Date : 2021-11-13 Tine Köhler, Lisa Schurer Lambert
We are honored to be the next co-Editors of ORM. Under the previous editorial teams, led by Larry Williams, Herman Aguinis, Bob Vandenberg, José Cortina, James LeBreton, and Paul Bliese, ORM has been succeeding by every available metric. ORM is widely recognized as the premier outlet for methodological scholarship in the organizational sciences, and this success is due to the collaboration between
-
Team Composition Revisited: A Team Member Attribute Alignment Approach Organ. Res. Methods (IF 8.9) Pub Date : 2021-10-18 Kyle J. Emich, Li Lu, Amanda Ferguson, Randall S. Peterson, Michael McCourt
Research methods for studying team composition tend to employ either a variable-centered or person-centered approach. The variable-centered approach allows scholars to consider how patterns of attributes between team members influence teams, while the person-centered approach allows scholars to consider how variation in multiple attributes within team members influences subgroup formation and its effects
-
Assessing Dimensionality of the Ideal Point Item Response Theory Model Using Posterior Predictive Model Checking Organ. Res. Methods (IF 8.9) Pub Date : 2021-10-18 Seang-Hwane Joo, Philseok Lee, Jung Yeon Park, Stephen Stark
Although the use of ideal point item response theory (IRT) models for organizational research has increased over the last decade, the assessment of construct dimensionality of ideal point scales has been overlooked in previous research. In this study, we developed and evaluated dimensionality assessment methods for an ideal point IRT model under the Bayesian framework. We applied the posterior predictive
-
Guest Editorial: ORM-CARMA Virtual Feature Topics for Advanced Reviewer Development Organ. Res. Methods (IF 8.9) Pub Date : 2021-08-11 Larry J. Williams, George C. Banks, Robert J. Vandenberg
Providing developmental peer reviewers is one of the most critical services performed by researchers in the organizational sciences (Bedeian, 2003). Yet, completing helpful and constructive reviews is not easy (Epstein, 1995; Feldman, 2005). This challenge may be due, in part, to the fact that our field provides only limited formal reviewer training in graduate programs and through professional development
-
Planned Missingness: How to and How Much? Organ. Res. Methods (IF 8.9) Pub Date : 2021-05-28 Charlene Zhang, Martin C. Yu
Planned missingness (PM) can be implemented for survey studies to reduce study length and respondent fatigue. Based on a large sample of Big Five personality data, the present study simulates how factors including PM design (three-form and random percentage [RP]), amount of missingness, and sample size affect the ability of full-information maximum likelihood (FIML) estimation to treat missing data
-
A Test-Retest Reliability Generalization Meta-Analysis of Judgments Via the Policy-Capturing Technique Organ. Res. Methods (IF 8.9) Pub Date : 2021-05-12 Ze Zhu, Alan J. Tomassetti, Reeshad S. Dalal, Shannon W. Schrader, Kevin Loo, Isaac E. Sabat, Balca Alaybek, You Zhou, Chelsea Jones, Shea Fyffe
Policy capturing is a widely used technique, but the temporal stability of policy-capturing judgments has long been a cause for concern. This article emphasizes the importance of reporting reliability, and in particular test-retest reliability, estimates in policy-capturing studies. We found that only 164 of 955 policy-capturing studies (i.e., 17.17%) reported a test-retest reliability estimate. We
-
Systematicity in Organizational Research Literature Reviews: A Framework and Assessment Organ. Res. Methods (IF 8.9) Pub Date : 2021-05-04 Zeki Simsek, Brian Fox, Ciaran Heavey
In this study, we first develop a framework that presents systematicity as an encompassing orientation toward the application of explicit methods in the practice of literature reviews, informed by the principles of transparency, coverage, saturation, connectedness, universalism, and coherence. We then supplement that conceptual development with empirical insights into the reported practices of systematicity
-
Corrigendum to From Nuisance to Novel Research Questions: Using Multilevel Models to Predict Heterogeneous Variances Organ. Res. Methods (IF 8.9) Pub Date : 2021-04-21
Lester, H. F., Cullen-Lester, K. L., & Walters, R. W. (2019). From nuisance to novel research questions: Using multilevel models to predict heterogeneous variances. Organizational Research Methods, 24(2), 342-388.
-
New Network Models for the Analysis of Social Contagion in Organizations: An Introduction to Autologistic Actor Attribute Models Organ. Res. Methods (IF 8.9) Pub Date : 2021-04-20 Andrew Parker, Francesca Pallotti, Alessandro Lomi
Autologistic actor attribute models (ALAAMs) provide new analytical opportunities to advance research on how individual attitudes, cognitions, behaviors, and outcomes diffuse through networks of social relations in which individuals in organizations are embedded. ALAAMs add to available statistical models of social contagion the possibility of formulating and testing competing hypotheses about the
-
Faking Detection Improved: Adopting a Likert Item Response Process Tree Model Organ. Res. Methods (IF 8.9) Pub Date : 2021-04-15 Tianjun Sun, Bo Zhang, Mengyang Cao, Fritz Drasgow
With the increasing popularity of noncognitive inventories in personnel selection, organizations typically wish to be able to tell when a job applicant purposefully manufactures a favorable impression. Past faking research has primarily focused on how to reduce faking via instrument design, warnings, and statistical corrections for faking. This article took a new approach by examining the effects of