Grouped versus randomized format: An investigation of scale convergent and discriminant validity using LISREL confirmatory factor analysis

Abstract

LISREL maximum likelihood confirmatory factor analyses (Jöreskog & Sörbom, 1984) were conducted to explore the effects of two questionnaire formats (grouping versus randomizing items) on the convergent and discriminant validity of two sets of questionnaire measures. The first set of measures consisted of satisfaction scales that had demonstrated acceptable psychometric properties in earlier studies; the second set of scales were job characteristics measures that had shown discriminant validity problems in previous research. Correlational data were collected from two groups of employed business administration students (N = 80 in each group) concurrently (Study 1) and at two points in time (Study 2). The results of the analyses showed that the grouped format was superior to the random format, particularly with respect to the weaker measures (the job characteristics scales). The results also illustrated and supported the usefulness of LISREL confirmatory factor analysis in studies of convergent and discriminant validity. Index terms: confirmatory factor analysis, convergent validity, discriminant validity, LISREL analysis, questionnaire formats, scale validity.