Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators
The class of doubly-robust (DR) functionals studied by Rotnitzky et al. (2021) is of central importance in economics and biostatistics. It strictly includes both (i) the class of mean-square continuous functionals that can be written as an expectation of an affine functional of a conditional expecta...
Main Authors: | , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2023
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2306.10590 |
id |
ftarxivpreprints:oai:arXiv.org:2306.10590 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2306.10590 2023-10-01T03:55:40+02:00 Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators Liu, Lin Mukherjee, Rajarshi Robins, James M. 2023-06-18 http://arxiv.org/abs/2306.10590 unknown http://arxiv.org/abs/2306.10590 Statistics - Methodology Economics - Econometrics Mathematics - Statistics Theory Statistics - Machine Learning text 2023 ftarxivpreprints 2023-09-03T01:06:06Z The class of doubly-robust (DR) functionals studied by Rotnitzky et al. (2021) is of central importance in economics and biostatistics. It strictly includes both (i) the class of mean-square continuous functionals that can be written as an expectation of an affine functional of a conditional expectation studied by Chernozhukov et al. (2022b) and (ii) the class of functionals studied by Robins et al. (2008). The present state-of-the-art estimators for DR functionals $\psi$ are double-machine-learning (DML) estimators (Chernozhukov et al., 2018). A DML estimator $\widehat{\psi}_{1}$ of $\psi$ depends on estimates $\widehat{p} (x)$ and $\widehat{b} (x)$ of a pair of nuisance functions $p(x)$ and $b(x)$, and is said to satisfy "rate double-robustness" if the Cauchy--Schwarz upper bound of its bias is $o (n^{- 1/2})$. Were it achievable, our scientific goal would have been to construct valid, assumption-lean (i.e. no complexity-reducing assumptions on $b$ or $p$) tests of the validity of a nominal $(1 - \alpha)$ Wald confidence interval (CI) centered at $\widehat{\psi}_{1}$. But this would require a test of the bias to be $o (n^{-1/2})$, which can be shown not to exist. We therefore adopt the less ambitious goal of falsifying, when possible, an analyst's justification for her claim that the reported $(1 - \alpha)$ Wald CI is valid. In many instances, an analyst justifies her claim by imposing complexity-reducing assumptions on $b$ and $p$ to ensure "rate double-robustness". Here we exhibit valid, assumption-lean tests of $H_{0}$: "rate double-robustness holds", with non-trivial power against certain alternatives. If $H_{0}$ is rejected, we will have falsified her justification. However, no assumption-lean test of $H_{0}$, including ours, can be a consistent test. Thus, the failure of our test to reject is not meaningful evidence in favor of $H_{0}$. Comment: corrected several extra typos and references Text DML ArXiv.org (Cornell University Library) Psi ENVELOPE(-63.000,-63.000,-64.300,-64.300) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Statistics - Methodology Economics - Econometrics Mathematics - Statistics Theory Statistics - Machine Learning |
spellingShingle |
Statistics - Methodology Economics - Econometrics Mathematics - Statistics Theory Statistics - Machine Learning Liu, Lin Mukherjee, Rajarshi Robins, James M. Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators |
topic_facet |
Statistics - Methodology Economics - Econometrics Mathematics - Statistics Theory Statistics - Machine Learning |
description |
The class of doubly-robust (DR) functionals studied by Rotnitzky et al. (2021) is of central importance in economics and biostatistics. It strictly includes both (i) the class of mean-square continuous functionals that can be written as an expectation of an affine functional of a conditional expectation studied by Chernozhukov et al. (2022b) and (ii) the class of functionals studied by Robins et al. (2008). The present state-of-the-art estimators for DR functionals $\psi$ are double-machine-learning (DML) estimators (Chernozhukov et al., 2018). A DML estimator $\widehat{\psi}_{1}$ of $\psi$ depends on estimates $\widehat{p} (x)$ and $\widehat{b} (x)$ of a pair of nuisance functions $p(x)$ and $b(x)$, and is said to satisfy "rate double-robustness" if the Cauchy--Schwarz upper bound of its bias is $o (n^{- 1/2})$. Were it achievable, our scientific goal would have been to construct valid, assumption-lean (i.e. no complexity-reducing assumptions on $b$ or $p$) tests of the validity of a nominal $(1 - \alpha)$ Wald confidence interval (CI) centered at $\widehat{\psi}_{1}$. But this would require a test of the bias to be $o (n^{-1/2})$, which can be shown not to exist. We therefore adopt the less ambitious goal of falsifying, when possible, an analyst's justification for her claim that the reported $(1 - \alpha)$ Wald CI is valid. In many instances, an analyst justifies her claim by imposing complexity-reducing assumptions on $b$ and $p$ to ensure "rate double-robustness". Here we exhibit valid, assumption-lean tests of $H_{0}$: "rate double-robustness holds", with non-trivial power against certain alternatives. If $H_{0}$ is rejected, we will have falsified her justification. However, no assumption-lean test of $H_{0}$, including ours, can be a consistent test. Thus, the failure of our test to reject is not meaningful evidence in favor of $H_{0}$. Comment: corrected several extra typos and references |
format |
Text |
author |
Liu, Lin Mukherjee, Rajarshi Robins, James M. |
author_facet |
Liu, Lin Mukherjee, Rajarshi Robins, James M. |
author_sort |
Liu, Lin |
title |
Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators |
title_short |
Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators |
title_full |
Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators |
title_fullStr |
Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators |
title_full_unstemmed |
Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators |
title_sort |
assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators |
publishDate |
2023 |
url |
http://arxiv.org/abs/2306.10590 |
long_lat |
ENVELOPE(-63.000,-63.000,-64.300,-64.300) |
geographic |
Psi |
geographic_facet |
Psi |
genre |
DML |
genre_facet |
DML |
op_relation |
http://arxiv.org/abs/2306.10590 |
_version_ |
1778524282046906368 |