Inference on derivatives of high dimensional regression function with deep neural network

EI seminar
Speaker
Weining Wang
Date
Thursday 4 Apr 2024, 12:00 - 13:00
Type
Seminar
Room
ET-14
Building
E Building
Location
Campus Woudestein
Add to calendar
Students standing

We study the estimation of the partial derivatives of nonparametric regression functions with many predictors, with a view to conducting a significance test for the said derivatives.  Our derivative estimator is based on the convolution of a regression function estimator and the derivative of a smoothing kernel, where the regression function estimator is a deep neural network whose structure could scale up as the sample size grows.  

We demonstrate that in the context of modelling with neural networks, derivative estimation is in fact quite different from estimating the regression function itself, and hence the smoothing operation becomes beneficial and even necessary.  Our subsequent test is based on the moment generating function of the aforementioned derivative estimator.}  This test finds applications in model specification and variable screening for high-dimensional data. 

To render our test effective in the context of predictors with high or even diverging dimension, we assume that first, the observed high-dimensional predictors can effectively serve as the proxies for certain latent, lower-dimensional factors and that second, only the latent factors and a subset of the coordinates of the observed high-dimensional predictors drive the regression function.  Moreover, we finely adjust the regression function estimator, enabling us to achieve the desired asymptotic normality under the null hypothesis that the partial derivative is zero, as well as consistency for any fixed scenarios and certain local alternatives.

We demonstrate the excellent performance of our test in simulation studies.  We present two applications that highlight the robustness and effectiveness of our inference methods.

Registration

You can sign up for this seminar by sending an email to eb-secr@ese.eur.nl. The lunch will be provided (vegetarian option included).

Organiser

See also

Linear convergence and error bounds are equivalent for optimisation algorithms

Juan Vera Lizcano (Tilburg University)
Campus Woudestein

The perception of object shape in humans and machines

Juan Vera Lizcano (Tilburg University)
Brown human eye

FinEML Conference 2024 at USI Lugano

Financial Econometrics meets Machine Learning
University USI Lugano
More information

Do you want to know more about the event? Contact the secretariat Econometrics at eb-secr@ese.eur.nl.

Compare @count study programme

  • @title

    • Duration: @duration
Compare study programmes