Optimal rates and adaptation in the single-index model using aggregation - Archive ouverte HAL Access content directly
Journal Articles Electronic Journal of Statistics Year : 2007

Optimal rates and adaptation in the single-index model using aggregation

Abstract

We want to recover the regression function in the single-index model. Using an aggregation algorithm with local polynomial estimators, we answer in particular to the second part of Question~2 from Stone (1982) on the optimal convergence rate. The procedure constructed here has strong adaptation properties: it adapts both to the smoothness of the link function and to the unknown index. Moreover, the procedure locally adapts to the distribution of the design. We propose new upper bounds for the local polynomial estimator (which are results of independent interest) that allows a fairly general design. The behavior of this algorithm is studied through numerical simulations. In particular, we show empirically that it improves strongly over empirical risk minimization.
Fichier principal
Vignette du fichier
ejs_2007_77.pdf (1.34 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00138211 , version 1 (23-03-2007)
hal-00138211 , version 2 (03-12-2007)

Identifiers

Cite

Stéphane Gaïffas, Guillaume Lecué. Optimal rates and adaptation in the single-index model using aggregation. Electronic Journal of Statistics , 2007, 1, pp.538-573. ⟨10.1214/07-EJS077⟩. ⟨hal-00138211v2⟩
152 View
111 Download

Altmetric

Share

Gmail Facebook X LinkedIn More