Reliability of measurement and power of significance tests based on differences
Loading...
View/Download File
Persistent link to this item
Statistics
View StatisticsJournal Title
Journal ISSN
Volume Title
Title
Reliability of measurement and power of significance tests based on differences
Published Date
1993
Publisher
Type
Article
Abstract
The power of significance tests based on difference
scores is indirectly influenced by the reliability
of the measures from which differences are obtained.
Reliability depends on the relative magnitude of
true score and error score variance, but statistical
power is a function of the absolute magnitude of
these components. Explicit power calculations
reaffirm the paradox put forward by Overall &
Woodward (1975, 1976)-that significance tests of
differences can be powerful even if the reliability
of the difference scores is 0. This anomaly arises
because power is a function of observed score
variance but is not a function of reliability unless
either true score variance or error score variance is
constant. Provided that sample size, significance
level, directionality, and the alternative hypothesis
associated with a significance test remain the same,
power always increases when population variance
decreases, independently of reliability. Index
terms: difference scores, error of measurement, power,
significance tests, t test, test reliability, true scores.
Keywords
Description
Related to
Replaces
License
Series/Report Number
Funding information
Isbn identifier
Doi identifier
Previously Published Citation
Zimmerman, Donald W, Williams, Richard H & Zumbo, Bruno D. (1993). Reliability of measurement and power of significance tests based on differences. Applied Psychological Measurement, 17, 1-9. doi:10.1177/014662169301700101
Suggested citation
Zimmerman, Donald W.; Williams, Richard H.; Zumbo, Bruno D.. (1993). Reliability of measurement and power of significance tests based on differences. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/116219.
Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.