Browsing by Author "Schmitt, Neal"

Now showing 1 - 6 of 6
  • Thumbnail Image
    Item
    Appropriateness fit and criterion-related validity
    (1993) Schmitt, Neal; Cortina, José M.; Whitney, David J.
    Unmotivated or suspicious test takers in concurrent validation studies can cause numerous problems for test users. The effects of these problems, however, have not been carefully examined. This study used item response theory-based appropriateness fit indexes to identify and remove from a validation sample those examinees whose response patterns did not match their trait levels (e.g., examinees with low trait levels who answered difficult items correctly). The person-fit index lzm described in Drasgow, Levine, & Williams (1985) had little effect on validities. The multitest index lzm described by Drasgow & Hulin (1990) was more promising. Implications for selection research and practice are discussed. Index terms: aberrant response patterns, appropriateness fit, concurrent validity, distorted responses, item response theory, person fit.
  • Thumbnail Image
    Item
    Comparison of three techniques to assess group-level beta and gamma change
    (1984) Schmitt, Neal; Pulakos, Elaine D.; Lieblein, Amy
    Alpha, beta, and gamma change concerning student attitudes toward a college course were assessed before and after the first examination in that course for an experimental and control group. Three methodologies were used to assess change. Those proposed by Terborg, Howard, and Maxwell (1980) and Schmitt (1982) produced reasonably similar conclusions concerning change, while the methodology suggested by Zmud and Armenakis (1978) produced relatively different conclusions. The relative advantages and limitations of the procedures are discussed. The major conclusion is that much additional use and comparison of these methodologies for assessing change is necessary before researchers or practitioners can interpret the practical significance of beta and gamma change or the relative utility of various approaches to the measurement of beta and gamma change.
  • Thumbnail Image
    Item
    Factors defined by negatively keyed items: The result of careless respondents?
    (1985) Schmitt, Neal; Stults, Daniel M.
    A frequently occurring phenomenon in factor and cluster analysis of personality or attitude scale items is that all or nearly all questionnaire items that are negatively keyed will define a single factor. Although substantive interpretations of these negative factors are usually attempted, this study demonstrates that the negative factor could be produced by a relatively small portion of the respondents who fail to attend to the negative-positive wording of the items. Data were generated using three different correlation matrices, which demonstrated that regardless of data source, when only 10% of the respondents are careless in this fashion, a clearly definable negative factor is generated. Recommendations for instrument development and data editing are presented.
  • Thumbnail Image
    Item
    Methodology review: Analysis of multitrait-multimethod matrices
    (1986) Schmitt, Neal; Stults, Daniel M.
    Procedures for analyzing multitrait-multimethod (MTMM) matrices are reviewed. Confirmatory factor analysis (Jöreskog, 1974) is presented as a general model allowing evaluation of the discriminant and convergent validity of MTMM matrices, both as a whole and in individual trait-method units. However, it is noted that this model is deficient with regard to analysis of trait-method interactions of the type described by Campbell and O’Connell (1967, 1982). Composite direct product models described by Browne (1984) are one possible solution to this problem. Further, more systematic use of hypothesis testing regarding convergent and discriminant validity in nested hierarchical models is recommended (Widaman, 1985), as well as the use of a procedure to cross-validate models of MTMM matrices described by Cudeck and Browne (1983).
  • Thumbnail Image
    Item
    Path analysis of multitrait-multimethod matrices
    (1978) Schmitt, Neal
    Path analyses of two multitrait-multimethod matrices are used as examples of the kind of information afforded by application of the technique. Discussed are tests of various possible models of the matrix, the reproduction of several correlations, and various reduced models. It is concluded that the technique should be of considerable aid to researchers who want to evaluate the convergent and discriminant validity of their measures.
  • Thumbnail Image
    Item
    Rasch analysis of the Central Life Interest measure
    (1981) Schmitt, Neal
    Rasch item analyses were conducted and estimates of item residuals correlated with various demographic or person variables to investigate item bias in an attitude scale. Analysis revealed that the model fit the data well and that none of the demographic variables accounted for greater than 7% of the residual variance. Similar analyses of other attitude scales as well as aptitude tests should be useful.