LASSO, Iterative Feature Selection and the Correlation Selector: Oracle Inequalities and Numerical Performances - Archive ouverte HAL Access content directly
Journal Articles Electronic Journal of Statistics Year : 2008

LASSO, Iterative Feature Selection and the Correlation Selector: Oracle Inequalities and Numerical Performances

Abstract

We propose a general family of algorithms for regression estimation with quadratic loss. Our algorithms are able to select relevant functions into a large dictionary. We prove that a lot of algorithms that have already been studied for this task (LASSO and Group LASSO, Dantzig selector, Iterative Feature Selection, among others) belong to our family, and exhibit another particular member of this family that we call Correlation Selector in this paper. Using general properties of our family of algorithm we prove oracle inequalities for IFS, for the LASSO and for the Correlation Selector, and compare numerical performances of these estimators on a toy example.
Fichier principal
Vignette du fichier
ejs_2008_288.pdf (317.44 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00181784 , version 1 (24-10-2007)
hal-00181784 , version 2 (05-12-2007)
hal-00181784 , version 3 (01-02-2008)
hal-00181784 , version 4 (25-11-2008)

Identifiers

Cite

Pierre Alquier. LASSO, Iterative Feature Selection and the Correlation Selector: Oracle Inequalities and Numerical Performances. Electronic Journal of Statistics , 2008, 2, pp. 1129-1152. ⟨10.1214/08-EJS299⟩. ⟨hal-00181784v4⟩
346 View
221 Download

Altmetric

Share

Gmail Facebook X LinkedIn More