AI Insight
This paper introduces Projection Transfer Learning (ProjectionTL), a framework for combining data from multiple sources to improve predictions when target data is limited. The method uses a two-stage approach: first aggregating information across sources with adaptive weighting, then selectively filtering features that align with the target domain. This dual-level selection process addresses the problem of negative transfer, where incorporating irrelevant source data degrades model performance.
Why it matters
The framework provides a practical solution for biomedical and other data-scarce applications where related information exists across domains but direct combination risks introducing spurious patterns. By maintaining interpretability while performing both source and feature selection, it enables more trustworthy machine learning in high-stakes domains requiring transparent decision-making.
Understand the Science
Abstract: Modern data-driven applications increasingly involve learning from multiple heterogeneous sources, where a target dataset is limited but related information is available across domains. Naively combining these sources can degrade performance when relevance varies or spurious signals are present, posing a fundamental challenge for trustworthy cross-domain learning. We propose Projection Transfer Learning (ProjectionTL), a unified framework that integrates hierarchical Bayesian modeling with adaptive projection for selective knowledge transfer. The key idea is to decouple transfer at two levels: first, we construct a source-guided hierarchical prior that aggregates information across sources using data-driven weights, capturing global alignment between each source and the target; second, we refine this borrowing through a posterior-projection step that operates at the feature level, selectively retaining coordinates that exhibit local agreement with the target signal. This two-stage design enables the method to simultaneously perform source selection and feature selection, thereby mitigating negative transfer while preserving interpretability. ProjectionTL provides a principled approach to integrating heterogeneous data across domains, bridging statistical modeling and modern machine learning paradigms for robust and interpretable transfer. Through simulations and real-world biomedical applications, we demonstrate improved accuracy, stability, and interpretability compared to existing methods. Our framework offers a scalable and generalizable strategy for trustworthy cross-domain learning in high-dimensional settings.
Source: Hierarchical Projection for Adaptive Knowledge Transfer