AUC GEOGRAPHICA

The aim of this study is to identify changes in geographic literacy over time by comparing the success rates of geography applicants when solving identical tasks used in the geography entrance exam test in 2016 and 2024 at the Faculty of Science of Charles University. We summarize the results of a comparison of the success rates in selected test tasks and we look at the shift in geographic literacy between two groups of respondents with similar characteristics (age, interest in studying geography at the same university) in different time periods. Through our study, we aim to open up the possibility of using geography entrance exam tests as one of the possible sources for studying the evolution of geographic literacy over time. Longitudinal studies focusing on changes in geographic literacy are still very rare, which we consider to be a research gap. The tasks used in the entrance tests in 2016 and 2024 were compared in order to determine which types of test tasks experienced the greatest change in success rate. The comparison included answers to a total of 25 test tasks, which were intentionally set identically in both years to make such a comparison possible. Answers were available from 269 respondents in 2016 and from 132 respondents in 2024. When evaluating the results, the tasks were divided according to various criteria (thematic focus, category of educational objectives, use of mathematical skills, inclusion of a visual element, etc.). The results indicate a relatively high rate of change in success in solving certain types and groups of test tasks. The results also show changes in the level of geographical literacy of students who come to university from secondary schools. This information could be helpful not only for universities themselves (who will get better information about changes in the level of applicants from secondary school level), but also for secondary school educators and experts engaged in curriculum development (who will get feedback on secondary education results). The results underline the importance of systematically monitoring changes in geographical literacy and call for further research on a larger dataset and across more time points.

1. Amer, A. (2006): Reflections on Bloom's Revised Taxonomy. Electronic Journal of Research in Educational Psychology 4(1), 213-230.

2. Anderson, L. W., Krathwohl, D. R. (Eds.) (2001): A Taxonomy for Learning, Teaching and Assessing. New York: Longman.

3. Ateiku, J. N., Segbefia, S. K., Gyampoh, A. O. (2023): Effect of Audio-visual Aids on Students Understanding: A Comparative Analysis of JHS Students in the Ho Municipality. Integrated Journal for Research in Arts and Humanities 3(5). CrossRef

4. Bartáková, I., Chvál, M., Martinková, P. (2018): Predikční validita zkoušek zakončujících středoškolské vzdělávání a přijímacích testů na vysoké školy. Pedagogika 68(1), 66-85. CrossRef

5. Bendl, T., Krajňáková, L., Marada, M., Řezníčková, D. (2024): Geographical thinking in geography education: a systematic review. International Research in Geographical and Environmental Education, 1-19. CrossRef

6. Binimelis Sebastián, J., Gómez Gonçalves, A., Gómez Trigueros, I. M., Muntaner Guasp, J. J. (2024): Geographic literacy in third-year compulsory secondary education students. Journal of Baltic Science Education 23(6), 1119-1133. CrossRef

7. Bláha, J. D., Trahorsch, P., Bartůněk, M., Hladík, P. (2024): Critical issues in undergraduate cartographic education: Analysis of final tests and oral examinations. AUC Geographica 60(1), 61-74. CrossRef

8. Brožová, H., Rydval, J. (2014): Analysis of exam results of the Subject. Applied Mathematics for IT. Journal on Efficiency and Responsibility in Education and Science 7(3-4), 59-65. CrossRef

9. Byčkovský, P., Kotásek, J. (2004): Nová teorie klasifikování kognitivních cílů ve vzdělávání: revize Bloomovy taxonomie. Pedagogika 54(3), 227-242 (in Czech).

10. Camara, W., Kimmel, E. W. (Eds.) (2005): Choosing Students: Higher Education Admissions Tools for the 21st Century (1st ed.). Routledge.

11. Cortina, J. M. (1993): What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology 78(1), 98-104. CrossRef

12. Cloke, P., Crang, P., Goodwin, M. (2005): Introducing Human Geographies. London: Hodder Education. CrossRef

13. Dikmenli, Y. (2014): Geographic literacy perception scale (GLPS) validity and reliability study. Mevlana International Journal of Education 4(1), 1-15. CrossRef

14. Frey, M. C., Detterman, D. K. (2004): Scholastic Assessment or g? The Relationship Between the Scholastic Assessment Test and General Cognitive Ability. Psychological Science 15(6), 373-378. CrossRef PubMed

15. Hampl, M. (2000): Sociální geografie: hledání předmětu studia. Geografický časopis 52(1), 33-40 (in Czech).

16. Chráska, M. (1999): Didaktické testy: příručka pro učitele a studenty učitelství. Brno: Paido, ISBN 80-85931-68-0 (in Czech).

17. Kalhous, Z., Obst, O. (2009): Školní didaktika. Praha: Kosmas, ISBN 978-80-7367-571-4 (in Czech).

18. Kjærnsli, M., Lie, S. (2004): PISA and scientific literacy: Similarities and differences between the Nordic countries. Scandinavian Journal of Educational Research 48(3), 271-286. CrossRef

19. Krumrei-Mancuso, E. J., Newton, F. B., Kim, E., Wilcox, D. (2013): Psychosocial factors predicting first-year college student success. Journal of College Student Development 54(3), 247-266. CrossRef

20. Logayah, D. S., Ruhimat, M., Arrasyid, R., Islamy, M. R. F. (2024): Item analysis of National Geography Olympiad multiple choice questions (MCQs) in Indonesia. Cogent Social Sciences 10(1): 2354971. CrossRef

21. Lucky, A., Janštová, V., Novotný, P., Mourek, J. (2025): Quantifying ento-literacy: development and validation of an international insect-focused attitude and knowledge survey instrument. International Journal of STEM Education 12: 11. CrossRef

22. McFarlane, D. A. (2024): Critical Review of Geographic Illiteracy in the United States: A Multifaceted Analysis. Journal of Geography, Environment and Earth Science International 28(1), 11-25. CrossRef

23. National Center for Education Statistics (2020): The Nation's Report Card: 2018 U.S. History, Geography, and Civics at Grade 8 - Highlights Reports (NCES 2020017). U.S. Department of Education. Available online: https://nces.ed.gov/use-work/resource-library/report/statistical-analysis-report/nations-report-card-2018-u-s-history-geography-and-civics-grade-8-highlights-reports/ (accessed on 25 March 2025).

24. Niemierko, B. (1979): Taksonomie celów wychowania. Kwartalnik pedagogiczny 24(2), 66-67 (in Polish).

25. Ørberg, J. W. (2018): Uncomfortable encounters between elite and "shadow education" in India - Indian Institutes of Technology and the Joint Entrance Examination coaching industry. Higher Education 76, 129-144. CrossRef

26. Pérez-Benedito, J. L., Aragón, E. Q., Alriols, J. A., Medic, L. (2014): Optical Mark Recognition in Student Continuous Assessment. IEEE Revista Iberoamericana de Tecnologías del Aprendizaje 9(4), 133-138. CrossRef

27. Průcha, J. (2009): Pedagogická encyklopedie. Praha: Portál, EAN 9788073675462 (in Czech).

28. Robbins, S. B., Lauver, K., Le, H., Davis, D., Langley, R., Carlstrom, A. (2004): Do Psychosocial and Study Skill Factors Predict College Outcomes? A Meta-Analysis. Psychological Bulletin 130(2), 261-288. CrossRef PubMed

29. Řezníčková, D. (2003): Geografické dovednosti, jejich specifikace a kategorizace. Geografie 108(2), 146-163 (in Czech). CrossRef

30. Schindler, R., Brož, F., Hulešová, M., Chvál, M., Kovařík, Š., Matoušek, J., Mičienka, M., Smetáčková, I. (2006): Rukověť autora testových úloh. Praha: Centrum pro zjišťování výsledků vzdělávání, ISBN 80-239-7111-5 (in Czech).

31. Setyani, W. A., Jumadi, J., Darmawan, A. S. (2021): The Implementation of Audio Visual Media in Problem Based Learning Model to Improve the Problem Solving Skills. CrossRef

32. Proceedings of the 6th International Seminar on Science Education (ISSE 2020). Advances in Social Science, Education and Humanities Research 541, 563-568.

33. Shi, W.-Z., He, X., Wang, Y., Fan, Z. G., Guo, L. (2016): PISA and TIMSS Science Score, Which Clock is More Accurate to Indicate National Science and Technology Competitiveness? Eurasia Journal of Mathematics, Science and Technology Education 12(4), 965-974. CrossRef

34. Soleh, T. A., Ruhimat, M., Yani, A. (2022): Factor analysis: geographic literacy level of high school students in North Bandung area. International Journal of Research and Review 9(12), 519-528. CrossRef

35. Solem, M., Vaughan, P., Savage, C., De Nadai, A. S. (2021): Student- and School-Level Predictors of Geography Achievement in the United States, 1994-2018. Journal of Geography 120(6), 201-211. CrossRef

36. Silva, P., Nunes, L. C., Seabra, C., Balcao Reis, A., Alves, M. (2020): Student selection and performance in higher education: admission exams vs. high school scores. Education Economics, 28(5), 437-454. CrossRef

37. Šrámek, M., Teplá, M. (2021): The Qualities of Tasks in General Chemistry Based on the Analysis of Entrance Procedure at the Faculty of Science, Charles University. Scientia in Educatione 12(2), 32-40. CrossRef

38. Šrámek, M., Teplá, M. (2022): The qualities of tasks in organic chemistry and biochemistry based on the analysis of entrance procedure at the Faculty of Science, Charles University. Scientia in Educatione 13(2), 51-63. CrossRef

39. Štuka, Č., Vejražka, M. (2022): Testování a hodnocení studentů na VŠ. Praha: Univerzita Karlova (in Czech). CrossRef PubMed

40. Tavakol, M., Dennick, R. (2011): Making sense of Cronbach's alpha. International Journal of Medical Education 2, 53-55. CrossRef PubMed PubMed Central

41. Teig, N., Scherer, R., Olsen, R. V. (2022): A systematic review of studies investigating science teaching and learning: over two decades of TIMSS and PISA. International Journal of Science Education 44(12), 2035-2058. CrossRef

42. Tollingerová, D. (1971): Úvod do teorie a praxe programované výuky a výcviku. Odborná výchova 21(5), 143-146 (in Czech).

43. Trahorsch, P., Korvasová, V. (2023): Jaké je postavení geografie v probíhající kurikulární reformě? Diskuze klíčových témat geografického vzdělávání v rámci revize Rámcového vzdělávacího programu pro základní vzdělávání. Informace ČGS 42(1), 1−11 (in Czech).

44. Vašková, M. (2013): Přijímací řízení na vysoké školy. Diplomová práce. Masarykova univerzita, Právnická fakulta, Brno. Available online: https://theses.cz/id/fsffjy/ (accessed on 10 March 2025, in Czech).

45. Viktorová, L., Charvát, M. (2014): K problematice validity testů studijních předpokladů. Testfórum 3, 3-15 (in Czech). CrossRef

46. Weissberg, N. C., Owen, D. R. (2005): Do Psychosocial and Study Skill Factors Predict College Outcomes? Comment on Robbins et al. (2004). Psychological Bulletin 131(3), 407-409. CrossRef PubMed

47. Wu, M. (2010): Comparing the Similarities and Differences of PISA 2003 and TIMSS. OECD Education Working Papers 32. Paris: OECD Publishing.

48. Zhang, H. (2023): A Comparative Analysis of the 2018-2021 College Entrance Examination Mathematics National Paper (Science) questions. International Journal of Education and Humanities 8(1), 122-130. CrossRef

49. Zhang, L., Liu, X., Feng, H. (2023): Development and validation of an instrument for assessing scientific literacy from junior to senior high school. Disciplinary and Interdisciplinary Science Education Research 5: 21. CrossRef