Finding Needles in Haystacks: Multiple-Imputation Record Linkage Using Machine Learning

TitleFinding Needles in Haystacks: Multiple-Imputation Record Linkage Using Machine Learning
Publication TypeReport
Year of Publication2021
AuthorsAbowd, JM, Abramowitz, J, Levenstein, MC, McCue, K, Patiki, D, Raghunathan, TE, Rodgers, A, Shapiro, MD, Wasi, N, Zinsser, D
Series TitleWorking Paper
Document NumberCES-21-35
InstitutionUnited State Census Bureau
KeywordsMachine learning, record linkage
Abstract

This paper considers the problem of record linkage between a household-level survey and an establishment-level frame in the absence of unique identifiers. Linkage between frames in this setting is challenging because the distribution of employment across establishments is highly skewed. To address these difficulties, this paper develops a probabilistic record linkage methodology that combines machine learning (ML) with multiple imputation (MI). This ML-MI methodology is applied to link survey respondents in the Health and Retirement Study to their workplaces in the Census Business Register. The linked data reveal new evidence that non sampling errors in household survey data are correlated with respondents’ workplace characteristics.

URLhttps://www.census.gov/library/working-papers/2021/adrm/CES-WP-21-35.html
Citation Key11990