This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Web of Science (18) Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Woehr, D. J. Articles by Arthur, W. Search for Related Content Social Bookmarking                         What's this?

The Construct-Related Validity of Assessment Center Ratings: A Review and Meta-Analysis of the Role of Methodological Factors

Department of Management, The University of Tennessee, 419 Stokely Management Center, Knoxville, TN 37796, USAdjw{at}utk.edu

Winfred Arthur, Jr.

Department of Psychology, Texas A & M University, College Station, TX 77843-4235, USAwea{at}psyc.tamu.edu

In the present study, we provide a systematic review of the assessment center literature with respect to specific design and methodological characteristics that potentially moderate the construct-related validity of assessment center ratings. We also conducted a meta-analysis of the relationship between these characteristics and construct-related validity outcomes. Results for rating approach, assessor occupation, assessor training, and length of assessor training were in the predicted direction such that a higher level of convergent, and lower level of discriminant validity were obtained for the across-exercise compared to the within-exercise rating method; psychologists compared to managers/supervisors as assessors; assessor training compared no assessor training; and longer compared to shorter assessor training. Partial support was also obtained for the effects of the number of dimensions and assessment center purpose. Our review also indicated that relatively few studies have examined both construct-related and criterion-related validity simultaneously. Furthermore, these studies provided little, if any support for the view that assessment center ratings lack construct-related validity while at the same time demonstrating criterion-related validity. The implications of these findings for assessment center construct-related validity are discussed.

Journal of Management, Vol. 29, No. 2, 231-258 (2003)
DOI: 10.1177/014920630302900206


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				C. E. Lance, D. J. Woehr, and A. W. Meade Case Study: A Monte Carlo Investigation of Assessment Center Construct Validity Models Organizational Research Methods, July 1, 2007; 10(3): 430 - 448. [Abstract] [PDF]

				R. E. Ployhart Staffing in the 21st Century: New Challenges and Strategic Opportunities Journal of Management, December 1, 2006; 32(6): 868 - 897. [Abstract] [PDF]

				H.-C. Chen Assessment Center: A Critical Mechanism for Assessing HRD Effectiveness and Accountability Advances in Developing Human Resources, May 1, 2006; 8(2): 247 - 264. [Abstract] [PDF]

				H.-C. Chen and S. S. Naquin An Integrative Model of Competency Development, Training Design, Assessment Center, and Multi-Rater Assessment Advances in Developing Human Resources, May 1, 2006; 8(2): 265 - 282. [Abstract] [PDF]

				S. C. Melancon and M. S. Williams Competency-Based Assessment Center Design: A Case Study Advances in Developing Human Resources, May 1, 2006; 8(2): 283 - 314. [Abstract] [PDF]