Browsing by Subject "Measurement invariance"

Now showing 1 - 2 of 2
  • Thumbnail Image
    Item
    An Automated Test Assembly Approach Using Item Response Theory to Enhance Evidence of Measurement Invariance
    (2022-06) Cooperman, Allison
    When creating a new test to measure a latent trait, test developers must select items that together demonstrate desirable psychometric properties. Automated test assembly (ATA) algorithms allow test developers to systematically compare possible item combinations based on the test’s goals. ATA algorithms afford flexibility to incorporate various psychometric criteria for evaluating a new test. However, few algorithms have integrated analyses for item- and test-level bias, particularly within the item response theory framework. This dissertation proposes an approach that balances common indices of test score precision and model fit while simultaneously accounting for differing measurement models between two groups. Three Monte Carlo studies were designed to evaluate the proposed method (termed “Unbiased-ATA”). The first study found that in many testing scenarios, Unbiased-ATA appropriately constructed tests with evidence of measurement invariance (MI), item fit, and test information function alignment. Importantly, Unbiased-ATA’s performance depended on the accuracy of both the DIF detection method and item parameter estimation. The second study revealed that differentially weighting the Unbiased-ATA objective function criteria did not substantially affect the method’s performance. The final study found that Unbiased-ATA produced tests with stronger psychometric properties than an objective function based solely on test score precision. Yet adding a criterion for item-level MI did not noticeably improve tests’ psychometric strength above and beyond a criterion for test-level MI. Future directions for integrating ATA, test bias, and test fairness more broadly in psychological and educational measurement are discussed.
  • Thumbnail Image
    Item
    Measurement properties and invariance of negotiation with outdoor recreation constraints -- a cross-culture study between United States and Chinese University students
    (2012-09) Guo, Tian
    Leisure constraints negotiation research investigates the resources, strategies, and processes people use to deal with leisure constraints. This study examined the measurement of negotiation, including its latent structure, measurement invariance, and cross-cultural applicability, using data from US and Chinese university student samples. A modified second-order negotiation measurement model fit the data acceptably and tau-equivalence was found with most negotiation factors, except cognitive strategies. Equal form emerged across the US and the Chinese samples; however, equal indicator loadings were not found across the two groups. Findings and implications are discussed with future studies suggested. Key word: negotiation; cross culture; second-order model; tau-equivalence; measurement invariance