Uplift modeling optimizes intervention-based campaigns by identifying customers whose behavior changes exclusively due to specific treatments, moving beyond standard baseline risk predictions. However, in real-world deployments, algorithms that maximize traditional causal ranking metrics (e.g., the Qini coefficient) often fail to be optimal in practice. The inherent variance of Conditional Average Treatment Effect (CATE) estimators exposes critical trade-offs between expected economic value, algorithmic stability, and policy interpretability. To address this gap, this study proposes a stability-aware, value-driven computational framework for selecting an uplift policy. The pipeline evaluates multiple causal and non-causal algorithmic families, including traditional baselines, multimodel approaches, and transformed-outcome variants, within a repeated-run validation protocol. Candidate policies are assessed primarily through incremental revenue and target-set stability, whereas a post hoc surrogate tree distillation step is used to translate the selected policy into interpretable rule-based customer segments. An empirical evaluation of the publicly available Telco Customer Churn dataset under two distinct regimes (a causally controlled semisynthetic scenario and an observational proxy scenario) reveals that the highest-yielding causal policy frequently suffers from severe targeting instability, inducing a clear risk–return trade-off. Furthermore, uplift models outperform traditional baselines in the causally controlled regime, whereas traditional baselines remain economically superior in the confounded proxy settings. Overall, this study establishes that jointly assessing economic utility, algorithmic stability, and transparent segmentation is essential for deploying robust and defensible causal machine learning in production environments.

Stability-Aware Uplift Policy Selection for Customer Retention: From Predictive Scores to Actionable Segments

Pacella M.
Primo
;
Papadia G.
Secondo
;
2026-01-01

Abstract

Uplift modeling optimizes intervention-based campaigns by identifying customers whose behavior changes exclusively due to specific treatments, moving beyond standard baseline risk predictions. However, in real-world deployments, algorithms that maximize traditional causal ranking metrics (e.g., the Qini coefficient) often fail to be optimal in practice. The inherent variance of Conditional Average Treatment Effect (CATE) estimators exposes critical trade-offs between expected economic value, algorithmic stability, and policy interpretability. To address this gap, this study proposes a stability-aware, value-driven computational framework for selecting an uplift policy. The pipeline evaluates multiple causal and non-causal algorithmic families, including traditional baselines, multimodel approaches, and transformed-outcome variants, within a repeated-run validation protocol. Candidate policies are assessed primarily through incremental revenue and target-set stability, whereas a post hoc surrogate tree distillation step is used to translate the selected policy into interpretable rule-based customer segments. An empirical evaluation of the publicly available Telco Customer Churn dataset under two distinct regimes (a causally controlled semisynthetic scenario and an observational proxy scenario) reveals that the highest-yielding causal policy frequently suffers from severe targeting instability, inducing a clear risk–return trade-off. Furthermore, uplift models outperform traditional baselines in the causally controlled regime, whereas traditional baselines remain economically superior in the confounded proxy settings. Overall, this study establishes that jointly assessing economic utility, algorithmic stability, and transparent segmentation is essential for deploying robust and defensible causal machine learning in production environments.
File in questo prodotto:
File Dimensione Formato  
applsci-16-04918-with-cover.pdf

accesso aperto

Tipologia: Versione editoriale
Licenza: Creative commons
Dimensione 1.33 MB
Formato Adobe PDF
1.33 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11587/578106
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact