Data fusion with international large scale assessments: a case study using the OECD PISA and TALIS surveys

Abstract Background In the context of international large scale assessments, it is often not feasible to implement a complete survey of all relevant populations. For example, the OECD Program for International Student Assessment surveys both students and schools, but does not obtain information from...

Full description

Bibliographic Details
Main Authors: Kaplan, David, McCarty, Alyn
Format: Other/Unknown Material
Language:English
Published: BioMed Central Ltd. 2013
Subjects:
Online Access:http://www.largescaleassessmentsineducation.com/content/1/1/6
id ftbiomed:oai:biomedcentral.com:2196-0739-1-6
record_format openpolar
spelling ftbiomed:oai:biomedcentral.com:2196-0739-1-6 2023-05-15T16:50:11+02:00 Data fusion with international large scale assessments: a case study using the OECD PISA and TALIS surveys Kaplan, David McCarty, Alyn 2013-09-16 http://www.largescaleassessmentsineducation.com/content/1/1/6 en eng BioMed Central Ltd. http://www.largescaleassessmentsineducation.com/content/1/1/6 Copyright 2013 Kaplan and McCarty; licensee Springer. Research 2013 ftbiomed 2013-09-22T00:17:46Z Abstract Background In the context of international large scale assessments, it is often not feasible to implement a complete survey of all relevant populations. For example, the OECD Program for International Student Assessment surveys both students and schools, but does not obtain information from teachers. In contrast the OECD Teaching and Learning International Survey assesses teachers and schools but does not assess students. Clearly, important information is missing from both assessments. One approach to obtaining information from both surveys is through data fusion – a variety of methods that can be used to create a synthetic data set containing information from both surveys. Methods This paper presents an experimental evaluation of a representative group of data fusion methods using data from Iceland – the only OECD country that implemented both PISA and TALIS to all members of the relevant populations. Results On the basis of a set of validity criterion we find that Bayesian bootstrap predictive mean matching and the EM‐bootstrap methods perform best with respect to creating a usable synthetic data file for research purposes. Other/Unknown Material Iceland BioMed Central
institution Open Polar
collection BioMed Central
op_collection_id ftbiomed
language English
description Abstract Background In the context of international large scale assessments, it is often not feasible to implement a complete survey of all relevant populations. For example, the OECD Program for International Student Assessment surveys both students and schools, but does not obtain information from teachers. In contrast the OECD Teaching and Learning International Survey assesses teachers and schools but does not assess students. Clearly, important information is missing from both assessments. One approach to obtaining information from both surveys is through data fusion – a variety of methods that can be used to create a synthetic data set containing information from both surveys. Methods This paper presents an experimental evaluation of a representative group of data fusion methods using data from Iceland – the only OECD country that implemented both PISA and TALIS to all members of the relevant populations. Results On the basis of a set of validity criterion we find that Bayesian bootstrap predictive mean matching and the EM‐bootstrap methods perform best with respect to creating a usable synthetic data file for research purposes.
format Other/Unknown Material
author Kaplan, David
McCarty, Alyn
spellingShingle Kaplan, David
McCarty, Alyn
Data fusion with international large scale assessments: a case study using the OECD PISA and TALIS surveys
author_facet Kaplan, David
McCarty, Alyn
author_sort Kaplan, David
title Data fusion with international large scale assessments: a case study using the OECD PISA and TALIS surveys
title_short Data fusion with international large scale assessments: a case study using the OECD PISA and TALIS surveys
title_full Data fusion with international large scale assessments: a case study using the OECD PISA and TALIS surveys
title_fullStr Data fusion with international large scale assessments: a case study using the OECD PISA and TALIS surveys
title_full_unstemmed Data fusion with international large scale assessments: a case study using the OECD PISA and TALIS surveys
title_sort data fusion with international large scale assessments: a case study using the oecd pisa and talis surveys
publisher BioMed Central Ltd.
publishDate 2013
url http://www.largescaleassessmentsineducation.com/content/1/1/6
genre Iceland
genre_facet Iceland
op_relation http://www.largescaleassessmentsineducation.com/content/1/1/6
op_rights Copyright 2013 Kaplan and McCarty; licensee Springer.
_version_ 1766040368128720896