A Novel Error-Tolerant Frequent Itemset Model for Binary and Real-Valued Data
2009-10-12
Loading...
View/Download File
Persistent link to this item
Statistics
View StatisticsJournal Title
Journal ISSN
Volume Title
Title
A Novel Error-Tolerant Frequent Itemset Model for Binary and Real-Valued Data
Authors
Published Date
2009-10-12
Publisher
Type
Report
Abstract
Frequent pattern mining has been successfully applied to a broad range of applications, however, it has two major drawbacks, which limits its applicability to several domains. First, as the traditional 'exact' model of frequent pattern mining uses a strict definition of support, it limits the recovery of frequent itemset patterns in real-life data sets where the patterns may be fragmented due to random noise/errors. Second, as traditional frequent pattern mining algorithms works with only binary or boolean attributes, it requires transformation of real-valued attributes to binary attributes, which often results in loss of information. As many of the real-life data sets are both noisy and real-valued in nature, past approaches have tried to independently address these issues and there is no systematic approach that addresses both of these issues together. In this paper, we propose a novel Error-Tolerant Frequent Itemset (ETFI) model for binary as well as real-valued data. We also propose a bottom-up pattern mining algorithm to sequentially discover all ETFIs from both types of data sets. To illustrate the efficacy of our proposed ETFI approach, we use two real-valued S.Cerevisiae microarray gene-expression data sets and evaluate the patterns obtained in terms of their functional coherence as evaluated using the GO-based functional enrichment analysis. Our results clearly demonstrate the importance of directly accounting for errors/noise in the data. Finally, the statistical significance of the discovered ETFIs as estimated by using two randomization tests, reveal that discovered ETFIs are indeed biologically meaningful and are neither obtained by random chance nor capture random structure in the data.
Keywords
Description
Related to
Replaces
License
Series/Report Number
Funding information
Isbn identifier
Doi identifier
Previously Published Citation
Suggested citation
Gupta, Rohit; Rao, Navneet; Kumar, Vipin. (2009). A Novel Error-Tolerant Frequent Itemset Model for Binary and Real-Valued Data. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/215813.
Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.