The selection of statistical methods that can operate even on ill-conditioned problems, providing accurate estimation and supporting general inference tasks, is a central need in several applications in different domains. In this setting, two major approaches are the methods from the bridge estimation family, such as ridge regression, and the entropy-based methods, such as generalized maximum entropy estimation. Regarding these two methods, on the one hand, the appropriate choice of the shrinkage parameter in ridge regression is not always an easy task, and, on the other hand, the choice of supports for the parameters of the model is a usual difficulty with the generalized maximum entropy estimator. The RidGME estimator proposed in this work, using generalized maximum entropy with supports defined with information from the ridge trace, mitigates the weaknesses of both methodologies, revealing itself as an alternative to ridge regression on ill-conditioned models. The results from an empirical application reveal that the RidGME estimator is competitive with the best optimal choice of ridge estimators and outperforms the ordinary least squares estimator in a cross-validation root mean squared error sense. Its implementation is illustrated, and computational codes are made available to practitioners.

RidGME Estimation and Inference in Ill-Conditioned Models

Angelelli, Mario
2025-01-01

Abstract

The selection of statistical methods that can operate even on ill-conditioned problems, providing accurate estimation and supporting general inference tasks, is a central need in several applications in different domains. In this setting, two major approaches are the methods from the bridge estimation family, such as ridge regression, and the entropy-based methods, such as generalized maximum entropy estimation. Regarding these two methods, on the one hand, the appropriate choice of the shrinkage parameter in ridge regression is not always an easy task, and, on the other hand, the choice of supports for the parameters of the model is a usual difficulty with the generalized maximum entropy estimator. The RidGME estimator proposed in this work, using generalized maximum entropy with supports defined with information from the ridge trace, mitigates the weaknesses of both methodologies, revealing itself as an alternative to ridge regression on ill-conditioned models. The results from an empirical application reveal that the RidGME estimator is competitive with the best optimal choice of ridge estimators and outperforms the ordinary least squares estimator in a cross-validation root mean squared error sense. Its implementation is illustrated, and computational codes are made available to practitioners.
2025
9783031975882
9783031975899
File in questo prodotto:
File Dimensione Formato  
RidGME_Estimation_and_Inference_in_Ill-Conditioned_Models.pdf

non disponibili

Tipologia: Versione editoriale
Licenza: Copyright dell'editore
Dimensione 700.08 kB
Formato Adobe PDF
700.08 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11587/559848
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact