Title | A Confidence Region Approach to Tuning for Variable Selection. |
Publication Type | Journal Article |
Year of Publication | 2012 |
Authors | Gunes, Funda, and Howard D. Bondell |
Journal | J Comput Graph Stat |
Volume | 21 |
Issue | 2 |
Pagination | 295-314 |
Date Published | 2012 |
ISSN | 1061-8600 |
Abstract | We develop an approach to tuning of penalized regression variable selection methods by calculating the sparsest estimator contained in a confidence region of a specified level. Because confidence intervals/regions are generally understood, tuning penalized regression methods in this way is intuitive and more easily understood by scientists and practitioners. More importantly, our work shows that tuning to a fixed confidence level often performs better than tuning via the common methods based on AIC, BIC, or cross-validation (CV) over a wide range of sample sizes and levels of sparsity. Additionally, we prove that by tuning with a sequence of confidence levels converging to one, asymptotic selection consistency is obtained; and with a simple two-stage procedure, an oracle property is achieved. The confidence region based tuning parameter is easily calculated using output from existing penalized regression computer packages.Our work also shows how to map any penalty parameter to a corresponding confidence coefficient. This mapping facilitates comparisons of tuning parameter selection methods such as AIC, BIC and CV, and reveals that the resulting tuning parameters correspond to confidence levels that are extremely low, and can vary greatly across data sets. Supplemental materials for the article are available online. |
DOI | 10.1080/10618600.2012.679890 |
Alternate Journal | J Comput Graph Stat |
Original Publication | A confidence region approach to tuning for variable selection. |
PubMed ID | 23407768 |
PubMed Central ID | PMC3568666 |
Grant List | P01 CA142538 / CA / NCI NIH HHS / United States R01 MH084022 / MH / NIMH NIH HHS / United States |
A Confidence Region Approach to Tuning for Variable Selection.
Project: