Empirical item keying versus a rational approach to analyzing a psychological climate questionnaire

Abstract

The present study compared two approaches to scoring a Psychological Climate Questionnaire-an empirical keying of items using item analysis and a rational approach which focused on identifying the underlying constructs measured by the questionnaire. The approaches were compared with respect to prediction of performance criteria and the ability to ascertain the theoretical underpinnings of the instrument. Questionnaires were completed by 398 male firemen in a large metropolitan area. Results demonstrated that a summation of item scores to reflect carefully designed a priori constructs did not necessarily result in weaker prediction of performance criteria. Similarities of the present study with previous work are discussed.