ORBIS SCHOLAE
ORBIS SCHOLAE

Orbis scholae is an academic journal published by Charles University, Prague. It features articles on school education in the wider socio-cultural context. It aims to contribute to our understanding and the development of school education, and to the reflection of teaching practice and educational policy.

ORBIS SCHOLAE, Vol 10 No 1 (2016), 97–120

Možnosti praktické práce s daty z mezinárodních vzdělávacích studií: problémy a jejich praktická řešení

[Possibilities of Practical Work with Data from International Large Scale Educational Assessments: Problems and Practical Solutions]

Petr Soukup

DOI: https://doi.org/10.14712/23363177.2016.15
published online: 24. 10. 2016

abstract

The Czech Republic participated in the last 20 years in several international large scale educational assessment, especially TIMSS, PIRLS, PISA, ICCS, PIAAC and ICILS. Data for all these surveys are always publicly available after completion of each cycle (Soukup, 2012). However, Czech educational researchers used data very rarely (mostly only commented published results), although this data is very rich, and allow the use of complex statistical approaches. Problems when working with these data arise mainly from the following factors: (a) The data include weights, which take into account unequal probabilities of selection for individual respondents, and these weights should be used to correct estimates of population parameters; (b) the data come from a multistage sampling, and it is necessary to modify the standard error estimates for the calculation of statistical tests or confidence intervals (the use replication approaches, e.g. Jackknife); (c) the multiple data files at national and international level (i.e. there are actually dozens of datasets and their merge are not entirely trivial); (d) some variables not measured directly (typically results in cognitive tests) and should be considered a measurement error of these latent variables (IRT methodology and plausible values can be used). The aim of the text will be to serve several examples of analytical procedures to demonstrate the proper procedures for working with data from an international large scale educational assessment and also to provide an overview of available software for processing such data so that Czech educational researchers can routinely use.

keywords: international large scale assessment; data merge; sampling weights; replication weights; jackknife; latent variable; plausible value

references (11)

1. Basl, J. (2014). Statistika ve školství: Eurostat, OECD, PISA, IEA. In J. Hendl et al., Statistika v aplikacích (s. 287−304). Praha: Portál.

2. Foy, P., Arora, A., & Stanco, G. M. (Eds.). (2013). TIMSS 2011 user guide for the international database. Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College.

3. Hendl, J. (2012). Přehled statistických metod: analýza a metaanalýza dat. Praha: Portál.

4. Mareš, P., Rabušic, L., & Soukup, P. (2015). Analýza sociálněvědních dat (nejen) v SPSS. Brno: Masarykova universita.

5. Muthen, L. K., & Muthen, B. (2010; 6th Ed.). Mplus user's guide. Los Angeles, CA: Muthen & Muthen.

6. Petrúšek, I. (2015). Analýza chybějících hodnot. Praha: Sociologický ústav AV ČR.

7. Rutkowski, L., Gonzalez, E., Joncas, M., & Davier, M. von. (2010). International large-scale assessment data: Issues in secondary analysis and reporting. Educational Researcher, 39(2), 142−151. CrossRef

8. Soukup, P. (2006). Proč užívat hierarchické lineární modely? Sociologický časopis / Czech Sociological Review, 42(5), 987−1012.

9. Soukup, P. (2012). Mezinárodní výzkumy v oblasti vzdělávání. In J. Krejčí & J. Leontiyeva (Eds.), Cesty k datům: zdroje a management sociálněvědních dat v České republice (s. 287−304). Praha: Sociologické nakladatelství (SLON) a Sociologický ústav AV ČR.

10. Urbánek, T., & Šimeček, M. (2001). Teorie odpovědí na položku. Československá psychologie45(5), 428−440.

11. Venables, W. N., Smith, D. M., & R Development Core Team (2013). An introduction to R. Vienna: R Foundation for Statistical Computing.

Creative Commons License
Možnosti praktické práce s daty z mezinárodních vzdělávacích studií: problémy a jejich praktická řešení is licensed under a Creative Commons Attribution 4.0 International License.

230 x 157 mm
periodicity: 3 x per year
print price: 150 czk
ISSN: 1802-4637
E-ISSN: 2336-3177

Download