Online citations, reference lists, and bibliographies.
← Back to Search

Regularization And Variable Selection Via The Elastic Net

H. Zou, T. Hastie
Published 2005 · Mathematics

Cite This
Download PDF
Analyze on Scholarcy
Share
Summary. We propose the elastic net, a new regularization and variable selection method. Real world data and a simulation study show that the elastic net often outperforms the lasso, while enjoying a similar sparsity of representation. In addition, the elastic net encourages a grouping effect, where strongly correlated predictors tend to be in or out of the model together.The elastic net is particularly useful when the number of predictors (p) is much bigger than the number of observations (n). By contrast, the lasso is not a very satisfactory variable selection method in the
This paper references
10.1214/009053604000000067
Least angle regression
B. Efron (2004)
10.1198/106186006X113430
Sparse Principal Component Analysis
H. Zou (2006)
Prostate specific
T. 961–980. Stamey (1989)
Supervised harvesting of expression
T. Hastie (2003)
10.1080/00401706.1993.10485033
A Statistical View of Some Chemometrics Regression Tools
lldiko E. Frank (1993)
10.1214/AOS/1032181158
Heuristics of instability and stabilization in model selection
L. Breiman (1996)
10.1073/pnas.091062498
Significance analysis of microarrays applied to the ionizing radiation response
V. G. Tusher (2001)
Simulation A: Example 4
10.1007/BF02985802
The elements of statistical learning: data mining, inference and prediction
J. Franklin (2005)
10.1198/jasa.2004.s339
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
D. Ruppert (2004)
10.1080/01621459.1989.10478763
Bivariate Sign Tests
H. Oja (1989)
10.1093/IMANUM/20.3.389
A new approach to variable selection in least squares problems
M. R. Osborne (2000)
10.1093/BIOSTATISTICS/KXG046
Classification of gene microarrays by penalized logistic regression.
J. Zhu (2004)
10.1016/S0022-5347(17)41175-X
Prostate specific antigen in the diagnosis and treatment of adenocarcinoma of the prostate. II. Radical prostatectomy treated patients.
T. Stamey (1989)
10.1186/gb-2001-2-1-research0003
Supervised harvesting of expression trees
T. Hastie (2000)
Wavelet shrinkage : asymptopia ( with discussion ) ?
D. L. Donoho (1995)
10.1198/016214501753382273
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
J. Fan (2001)
10.1073/pnas.201162998
Predicting the clinical status of human breast cancer by using gene expression profiles
M. West (2001)
Discussion of Boosting Papers
P. Bartlett (2003)
Regression approach for microarray data analysis
Learn. Res (2003)
10.1126/SCIENCE.286.5439.531
Molecular classification of cancer: class discovery and class prediction by gene expression monitoring.
T. Golub (1999)
10.1111/J.2517-6161.1995.TB02032.X
Wavelet Shrinkage: Asymptopia?
D. Donoho (1995)
A simple method for finding molecular signatures from gene expression data
Ramón Díaz-Uriarte (2004)
10.1080/10618600.1998.10474784
Penalized Regressions: The Bridge versus the Lasso
W. J. Fu (1998)
10.1111/J.1467-9868.2005.00527.X
Addendum: Regularization and variable selection via the elastic net
H. Zou (2005)
10.1073/pnas.082099299
Diagnosis of multiple cancer types by shrunken centroids of gene expression
R. Tibshirani (2002)
10.1080/01621459.1989.10478752
Regularized Discriminant Analysis
J. Friedman (1989)
10.1186/gb-2000-1-2-research0003
'Gene shaving' as a method for identifying distinct sets of genes with similar expression patterns
T. Hastie (2000)
10.1111/J.2517-6161.1996.TB02080.X
Regression Shrinkage and Selection via the Lasso
R. Tibshirani (1996)
10.2307/1269659
[A Statistical View of Some Chemometrics Regression Tools]: Response
I. Frank (1993)
Significance analysis of microarrays applied to transcriptional responses to ionizing radiation
V. Tusher (2001)
10.1016/J.JMVA.2004.02.012
Finding predictive gene groups from microarray data
M. Dettling (2004)
Boosting as a Regularized Path to a Maximum Margin Classifier
S. Rosset (2004)
10.1214/AOS/1079120130
Statistical behavior and consistency of classification methods based on convex risk minimization
T. Zhang (2003)
50 data sets, 100/100/400, 40 predictors, β = {10x0,10x2,10x0,10x2}, σ = 15 Pairwise correlation between x i and x j corr(i,j)=0
10.1089/106652703322756177
Regression Approaches for Microarray Data Analysis
M. Segal (2003)



This paper is referenced by
Split Bregman Method for Sparse Inverse Covariance Estimation with Matrix Iteration Acceleration
G. Ye (2010)
Polygenic risk prediction models for Alzheimer ' s disease
S. Seo (2008)
Grouped Orthogonal Matching Pursuit for Variable Selection and Prediction
A. Lozano (2009)
An Application of Variable Selection Methods to Identify Influential Factors of ADHD Diagnosis in Children
M. Dragan (2017)
10.1515/sagmb-2014-0004
Regularization method for predicting an ordinal response using longitudinal high-dimensional genomic data
Jiayi Hou (2015)
Supplement to " An Iterative Smoothing Algorithm for Regression with Structured Sparsity "
F. Hadj-Selem (2016)
Modified Hard Thresholding Pursuit with Regularization Assisted Support Identification
Samrat Mukhopadhyay (2020)
10.1121/1.4964506
Drive-by large-region acoustic noise-source mapping via sparse beamforming tomography.
Cagdas Tuna (2016)
10.1088/1742-5468/2016/12/123302
Evaluation of Generalized Degrees of Freedom for Sparse Estimation by Replica Method
A. Sakata (2016)
Sparse activity and sparse connectivity in supervised learning
M. Thom (2013)
10.1016/J.FORECO.2020.118557
Use of advanced modelling methods to estimate radiata pine productivity indices
M. S. Watt (2021)
Time-varying sparsity in expected returns
Daniele Bianchi (2020)
Recursive bootstrap L 1-type regularized regression modeling based on parametric statistical test
H. Park (2015)
10.1002/WICS.1282
Some recent statistical learning methods for longitudinal high-dimensional data: Recent statistical learning methods
S. Chen (2014)
10.1155/2013/176272
Nonnegative Mixed-Norm Convex Optimization for Mitotic Cell Detection in Phase Contrast Microscopy
Anan Liu (2013)
Sequence analysis DNA sequence 1 shape kernel enables alignment-free modeling of transcription factor binding
Wenxiu Ma (2017)
10.1007/978-3-319-02267-3_5
Sparse Classification with MRI Based Markers for Neuromuscular Disease Categorization
Katerina Gkirtzou (2013)
10.1177/1529100612459637
About the Authors
I. Shmulevich (2012)
10.1186/1471-2105-11-552
Bayesian inference of the number of factors in gene-expression analysis: application to human virus challenge studies
Bo Chen (2009)
10.1080/02664763.2014.888541
Sparse group variable selection based on quantile hierarchical Lasso
Weihua Zhao (2014)
10.1109/TCBB.2015.2474407
Mem-mEN: Predicting Multi-Functional Types of Membrane Proteins by Interpretable Elastic Nets
Shibiao Wan (2016)
Schmid Evaluation of association mapping and genomic prediction in diverse barley and cauliflower breeding material
K. Schmid (2018)
POST GWAS ANALYSIS : FRAMEWORK , METHODS AND APPLICATIONS TO BLOOD PRESSURE SENSITIVITY STUDY ON WEIGHT AND SODIUM CHANGE
J. Liu (2015)
Sparsity by Worst-Case Quadratic Penalties
Yves Grandvalet (2012)
Penalized Small Area Models for the Combination of Unit ‐ and Area ‐ level Data
J. Krause (2019)
Improving Long QT Syndrome diagnosis using machine learningon ECG characteristics
J. Stoks (2018)
Image Coding using Generalized Predictors based on Sparsity and Geometric Transformations Luı́s
F. Lucas (2016)
10.1109/MSP.2018.2856632
Utility Metrics for Assessment and Subset Selection of Input Variables for Linear Estimation [Tips & Tricks]
A. Bertrand (2018)
Improving Group Orthogonal Matching Pursuit Performance with Iterative Feedback
H. Schepker (2013)
Bivariate Negative Binomial Hurdle with Random Spatial Effects
R. Mcnutt (2016)
10.1080/15427528.2011.558767
Genomic Selection and Prediction in Plant Breeding
J. Crossa (2011)
Lasso Degrees of Freedom when p > n
R. Tibshirani (2011)
See more
Semantic Scholar Logo Some data provided by SemanticScholar