Source Aware Modulation for leveraging limited data from heterogeneous sources

Loading...
Thumbnail Image

View/Download File

Persistent link to this item

Statistics
View Statistics

Journal Title

Journal ISSN

Volume Title

Title

Source Aware Modulation for leveraging limited data from heterogeneous sources

Published Date

2021

Publisher

Type

Report

Abstract

In many personalized prediction applications, sharing information between entities/tasks/sources is critical to address data scarcity. Furthermore, inherent characteristics of sources distinguish relationships between input drivers and response variables across entities. For example, for the same amount of rainfall (input driver), two different basins will have very different streamflow (response variable) values depending on the basin characteristics (e.g., soil porosity, slope, …). Given such heterogeneity, a trivial merging of data without source characteristics would lead to poor personalized predictions. In recent years, meta-learning has become a very popular framework to learn generalized global models that can be easily adapted (fine-tuned) for individual sources. In this talk, we present an exhaustive analysis of the source-aware modulation based meta-learning approach. Source-aware modulation adjusts the shared hidden features based on source characteristics. The adjusted hidden features are then used to calculate the response variable for individual sources. Although this strategy shows promising prediction improvement, its applicability is limited in certain applications where source characteristics might not be available (especially due to privacy concerns). In this work, we show that robust personalized predictions can be achieved even in the absence of explicit source characteristics. We investigated the performance of different modulation strategies under various data sparsity settings on two datasets. We demonstrate that source-aware modulation is a very viable solution (with or without known characteristics) compared to traditional meta-learning methods such as model agnostic meta-learning.

Keywords

Description

Related to

Replaces

License

Series/Report Number

Technical Report;21-001

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Other identifiers

Suggested citation

Li, Xiang; Khandelwal, Ankush; Ghosh, Rahul; Renganathan, Arvind; Willard, Jared; Xu, Shaoming; Jia, Xiaowei; Shu, Lele; Teng, Victor; Steinbach, Michael; Nieber, John; Duffy, Christopher; Kumar, Vipin. (2021). Source Aware Modulation for leveraging limited data from heterogeneous sources. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/223062.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.