Regularized regression outperforms trees for predicting cognitive function in the Health and Retirement Study

Year of Publication
2025
Author
Journal
Machine Learning with Applications
Volume
21
Number of Pages
100694
ISSN Number
2666-8270
Abstract

{Background Generalized linear models have been favored in healthcare research due to their interpretability. In contrast, tree-based models, such as random forest or boosted trees, are often preferred in machine learning (ML) and commercial settings due to their strong predictive performance. However, for clinical applications, model interpretability remains essential for actionable results and patient understanding. This study used ML to detect cognitive decline for the purpose of timely screening and uncovering associations with psychosocial determinants. All models were interpreted to enhance transparency and understanding of their predictions. Methods Data from the 2018 to 2020 Health and Retirement Study was used to create three linear regression models and three tree-based models. Ten percent of the sample was withheld for estimating performance, and model tuning used five-fold cross validation with two repeats. Survey frequency weights were applied during tuning, training, and final evaluation. Model performance was evaluated using RMSE and R2 and interpretability was assessed via coefficients, variable importance, and decision trees. Results The elastic net model had the best performance (RMSE = 3.520

DOI
https://doi.org/10.1016/j.mlwa.2025.100694
PMID
41311820
Download citation