Cooperative learning for multiview analysis.

Proc Natl Acad Sci U S A

Department of Biomedical Data Science, Stanford University, Stanford, CA 94305.

Published: September 2022

We propose a method for supervised learning with multiple sets of features ("views"). The multiview problem is especially important in biology and medicine, where "-omics" data, such as genomics, proteomics, and radiomics, are measured on a common set of samples. "Cooperative learning" combines the usual squared-error loss of predictions with an "agreement" penalty to encourage the predictions from different data views to agree. By varying the weight of the agreement penalty, we get a continuum of solutions that include the well-known early and late fusion approaches. Cooperative learning chooses the degree of agreement (or fusion) in an adaptive manner, using a validation set or cross-validation to estimate test set prediction error. One version of our fitting procedure is modular, where one can choose different fitting mechanisms (e.g., lasso, random forests, boosting, or neural networks) appropriate for different data views. In the setting of cooperative regularized linear regression, the method combines the lasso penalty with the agreement penalty, yielding feature sparsity. The method can be especially powerful when the different data views share some underlying relationship in their signals that can be exploited to boost the signals. We show that cooperative learning achieves higher predictive accuracy on simulated data and real multiomics examples of labor-onset prediction. By leveraging aligned signals and allowing flexible fitting mechanisms for different modalities, cooperative learning offers a powerful approach to multiomics data fusion.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9499553PMC
http://dx.doi.org/10.1073/pnas.2202113119DOI Listing

Publication Analysis

Top Keywords

cooperative learning
16
data views
12
agreement penalty
8
fitting mechanisms
8
data
6
cooperative
5
learning multiview
4
multiview analysis
4
analysis propose
4
propose method
4

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!