Research on the validity of CBTIs tends to utilize three types of studies: external criterion studies (comparing the CBTI report to some external criterion measure of the construct, such as a self-report or behavioral measure), consumer satisfaction studies (asking clients whether the reports are accurate representations of themselves), and comparison with clinical conclusions (comparing CBTI reports to clinician interpretations). Comprehensive reviews of CBTI validity can be found elsewhere (e.g.,Moreland, K. L. (1987). Computer-based test interpretations: Advice to the consumer. Applied Psychology: An International Review, 36, 385-399.Butcher, J. N., Perry, J. N., & Atlis, M. M. (2000). Validity and utility of computer-based interpretation. Psychological Assessment, 12, 6-18.). In general, the validity of CBTIs has not been demonstrated,Adams, K. M., & Heaton, R. K. (1985). Automated interpretation of the neuropsychological test data. Journal of Consulting and Clinical Psychology, 53, 790-802.Matarazzo, J. D. (1986). Computerized clinical psychological test interpretations: Unvalidated plus all mean and no sigma. American Psychologist, 41, 14-24. and the validity of individual CBTI systems has been found to vary. However, many validity studies are flawed due to small samples, criterion contamination, the Barnum effect, inadequate input data to generate powerful statistical prediction rules, unreliability of measures and the practice of generalizing across testing situations and populations without considering potential moderators.Lanyon, R. I. (1987). The validity of computer-based personality assessment products: Recommendations for the future. Computers in Human Behavior, 3, 225-238.
