Možnosti praktické práce s daty z mezinárodních vzdělávacích studií: problémy a jejich praktická řešení

The Czech Republic participated in the last 20 years in several international large scale educational assessment, especially TIMSS, PIRLS, PISA, ICCS, PIAAC and ICILS. Data for all these surveys are always publicly available after completion of each cycle (Soukup, 2012). However, Czech educational researchers used data very rarely (mostly only commented published results), although this data is very rich, and allow the use of complex statistical approaches. Problems when working with these data arise mainly from the following factors: (a) The data include weights, which take into account unequal probabilities of selection for individual respondents, and these weights should be used to correct estimates of population parameters; (b) the data come from a multistage sampling, and it is necessary to modify the standard error estimates for the calculation of statistical tests or confidence intervals (the use replication approaches, e.g. Jackknife); (c) the multiple data files at national and international level (i.e. there are actually dozens of datasets and their merge are not entirely trivial); (d) some variables not measured directly (typically results in cognitive tests) and should be considered a measurement error of these latent variables (IRT methodology and plausible values can be used). The aim of the text will be to serve several examples of analytical procedures to demonstrate the proper procedures for working with data from an international large scale educational assessment and also to provide an overview of available software for processing such data so that Czech educational researchers can routinely use.

1. Basl, J. (2014). Statistika ve školství: Eurostat, OECD, PISA, IEA. In J. Hendl et al., Statistika v aplikacích (s. 287−304). Praha: Portál.

2. Foy, P., Arora, A., & Stanco, G. M. (Eds.). (2013). TIMSS 2011 user guide for the international database. Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College.

3. Hendl, J. (2012). Přehled statistických metod: analýza a metaanalýza dat. Praha: Portál.

4. Mareš, P., Rabušic, L., & Soukup, P. (2015). Analýza sociálněvědních dat (nejen) v SPSS. Brno: Masarykova universita.

5. Muthen, L. K., & Muthen, B. (2010; 6th Ed.). Mplus user's guide. Los Angeles, CA: Muthen & Muthen.

6. Petrúšek, I. (2015). Analýza chybějících hodnot. Praha: Sociologický ústav AV ČR.

7. Rutkowski, L., Gonzalez, E., Joncas, M., & Davier, M. von. (2010). International large-scale assessment data: Issues in secondary analysis and reporting. Educational Researcher, 39(2), 142−151. CrossRef

8. Soukup, P. (2006). Proč užívat hierarchické lineární modely? Sociologický časopis / Czech Sociological Review, 42(5), 987−1012.

9. Soukup, P. (2012). Mezinárodní výzkumy v oblasti vzdělávání. In J. Krejčí & J. Leontiyeva (Eds.), Cesty k datům: zdroje a management sociálněvědních dat v České republice (s. 287−304). Praha: Sociologické nakladatelství (SLON) a Sociologický ústav AV ČR.

10. Urbánek, T., & Šimeček, M. (2001). Teorie odpovědí na položku. Československá psychologie45(5), 428−440.

11. Venables, W. N., Smith, D. M., & R Development Core Team (2013). An introduction to R. Vienna: R Foundation for Statistical Computing.