Regularized regression outperforms trees for predicting cognitive function in the Health and Retirement Study
| Year of Publication |
2025
|
|---|---|
| Author | |
| Journal |
Machine Learning with Applications
|
| Volume |
21
|
| Number of Pages |
100694
|
| ISSN Number |
2666-8270
|
| Abstract |
{Background Generalized linear models have been favored in healthcare research due to their interpretability. In contrast, tree-based models, such as random forest or boosted trees, are often preferred in machine learning (ML) and commercial settings due to their strong predictive performance. However, for clinical applications, model interpretability remains essential for actionable results and patient understanding. This study used ML to detect cognitive decline for the purpose of timely screening and uncovering associations with psychosocial determinants. All models were interpreted to enhance transparency and understanding of their predictions. Methods Data from the 2018 to 2020 Health and Retirement Study was used to create three linear regression models and three tree-based models. Ten percent of the sample was withheld for estimating performance, and model tuning used five-fold cross validation with two repeats. Survey frequency weights were applied during tuning, training, and final evaluation. Model performance was evaluated using RMSE and R2 and interpretability was assessed via coefficients, variable importance, and decision trees. Results The elastic net model had the best performance (RMSE = 3.520 |
| DOI |
https://doi.org/10.1016/j.mlwa.2025.100694
|
| PMID |
41311820
|
| Download citation |