Statistical Comparisons of Multiple Classifiers
2001-06-15
Loading...
View/Download File
Persistent link to this item
Statistics
View StatisticsJournal Title
Journal ISSN
Volume Title
Title
Statistical Comparisons of Multiple Classifiers
Authors
Published Date
2001-06-15
Publisher
Type
Report
Abstract
This paper discusses the issue of comparing multiple classifiers, applied to the same test dataset of a classification problem. Assume that the output is 0 if a classifier correctly classifies a test feature point and the output is 1 otherwise.Then all the outputs from a given classifier constitute a sample of 0 and 1, and all the samples are correlated. From these dependent samples, we use Cochran's Q statistic, as an overall test statistic, to detect whether or not the error rates of the classifiersare significantly different. When the null hypothesis that the error rates are equal is rejected, a thorough analysis of the nature of the error rates, such as the ranking of the error rates, is undertaken. For this purpose, we employ the Scheffe and Bonferroni multiple comparison procedures, based on dependent samples. We also use examples to demonstrate how to make these statistical comparisons.
Keywords
Description
Related to
Replaces
License
Series/Report Number
Funding information
Isbn identifier
Doi identifier
Previously Published Citation
Suggested citation
Cheng, Xiuzhen; Chen, Dechang. (2001). Statistical Comparisons of Multiple Classifiers. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/215473.
Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.