Adaptive Estimation with Partially Overlapping Models.

Stat Sin

Department of Statistics and Operations Research, Department of Biostatistics, Carolina Center for Genome Sciences, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, U.S.A.

Published: January 2016

In many problems, one has several models of interest that capture key parameters describing the distribution of the data. Partially overlapping models are taken as models in which at least one covariate effect is common to the models. A priori knowledge of such structure enables efficient estimation of all model parameters. However, in practice, this structure may be unknown. We propose adaptive composite M-estimation (ACME) for partially overlapping models using a composite loss function, which is a linear combination of loss functions defining the individual models. Penalization is applied to pairwise differences of parameters across models, resulting in data driven identification of the overlap structure. Further penalization is imposed on the individual parameters, enabling sparse estimation in the regression setting. The recovery of the overlap structure enables more efficient parameter estimation. An oracle result is established. Simulation studies illustrate the advantages of ACME over existing methods that fit individual models separately or make strong a priori assumption about the overlap structure.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4762277PMC
http://dx.doi.org/10.5705/ss.2014.233DOI Listing

Publication Analysis

Top Keywords

partially overlapping
12
overlapping models
12
overlap structure
12
models
9
structure enables
8
enables efficient
8
individual models
8
structure
5
adaptive estimation
4
estimation partially
4

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!