Technique for Diagnosing Cognitive Flexibility in Preschoolers: Comparison of Blank and Digital Forms

Cover Page

Cite item


Cognitive flexibility is considered a trait of human cognition that helps people adapt to new and changing environments by activating cognitive resources; it develops mainly at preschool age, being a predictor of children's future social and academic successes, which emphasizes the importance of diagnosing its formation. The present study is intended to assess the diagnostic capabilities of the digital version of the Dimensional Change Card Sort technique by P.D. Zelazo aimed at diagnosing the cognitive flexibility of preschoolers, compared with the traditional blank version. The digital version of the technique was tested on a sample of 55 children attending two senior kindergarten groups (57.1% of boys) aged 5 to 6 years (M = 64.03, SD = 2.14). An intra-individual scheme with the division of the subjects into two groups was applied. The first group was initially tested using the blank technique, and a month later using the digital one. The second group, on the contrary, was first tested using the digital technique and, a month later, using the blank one. Thus, the transfer effect was controlled. Sufficient indicators of reliability and consistency of the results of both measurements were obtained for the blank and digital versions of technique. No statistically significant differences were found between the mean values of the same indicators measured by digital and blank techniques different methods (Student’s t -test for paired samples). The results of the study show that the digital version of the Dimensional Change Card Sort technique has high indicators of validity and reliability and can be used in diagnostic work. However, these results indicate that the digitalization of techniques cannot always be reduced to a simple translation of them into the form of a software product, and requires additional research when adapting them.

About the authors

Nikolay E. Veraksa

Lomonosov Moscow State University

ORCID iD: 0000-0003-3752-7319
SPIN-code: 4446-3921

PhD in Psychology, Dr., Professor, Faculty of Psychology

1 Leninskie Gory, Moscow, 119991, Russian Federation

Margarita S. Aslanova

Lomonosov Moscow State University; I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation

Author for correspondence.
ORCID iD: 0000-0002-3150-221X
SPIN-code: 3764-4682

Researcher of the Department of Psychology of Education and Pedagogy

1 Leninskie Gory, Moscow, 119991, Russian Federation; 8 Trubetskaya St, bldg 2, Moscow, 119048, Russian Federation

Kristina S. Tarasova

Lomonosov Moscow State University

ORCID iD: 0000-0002-9072-8761
SPIN-code: 8061-5688

PhD in Psychology, Researcher of the Department of Methodology of Psychology

1 Leninskie Gory, Moscow, 119991, Russian Federation

Viktor A. Klimenko

Lomonosov Moscow State University

ORCID iD: 0000-0002-4112-9690
SPIN-code: 4661-3067

Researcher at the Department of Methodology of Psychology

1 Leninskie Gory, Moscow, 119991, Russian Federation


  1. Aalbers, T., Baars, M.A.E., Olde Rikkert, M.G.M., & Kessels, R.P.C. (2013). Puzzling with online games (BAM-COG): Reliability, validity, and feasibility of an online self-monitor for cognitive performance in aging adults. Journal of Medical Internet Research, 15(12), e270.
  2. Akhutina, T., Kremlev, A., Korneev, A., Matveeva, E., & Gusev, A. (2017). The computerized battery of neuropsychological tests. Cognitive Science in Moscow: New Research: Conference Proceedings (pp. 486–490). Moscow: Buki Vedi Publ., Institute of Practical Psychology and Psychoanalysis. (In Russ.)
  3. Al Mamun, K.A., Bardhan, S., Ullah, Md.A., Anagnostou, E., Brian, J., Akhter, S., & Rabbani, M.G. (2016). Smart autism – a mobile, interactive and integrated framework for screening and confirmation of autism. 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (pp. 5989–5992). New York: IEEE.
  4. Almazova, O.V., Bukhalenkova, D.A., &Veraksa, A.N. (2019). Assessment of the level of development of executive functions in the senior preschool age. Psychology. Journal of Higher School of Economics, 16(2), 302–317. (In Russ.)
  5. Arán-Filippetti, V., & López, M.B. (2016). Predictores de la comprensión lectora en niños y adolescentes: El papel de la edad, el sexo y las funciones ejecutivas. Cuadernos de Neuropsicología, 10(1), 23–44.
  6. Ardila, A., Akhutina, T.V., & Mikadze, Yu.V. (2020). A.R. Luria's contribution to studies of the brain organization of language. Neurology, Neuropsychiatry, Psychosomatics, 12(1), 4–12. (In Russ.)
  7. Aslanova, M.S., Bukhalenkova, D.A., Veraksa, A.N., Gavrilova, M.N., Liutsko, L.N., & Sukhikh, V.L. (2020). Traditional and innovative trends in math education in preschoolers in Russia: Do they fit to educational criteria? Moscow University Psychology Bulletin. Series 14. Psychology, (3), 166–193. (In Russ.)
  8. Atkins, S.M., Sprenger, A.M., Colflesh, G.J.H., Briner, T.L., Buchanan, J.B., Chavis, S.E., Chen, S., Iannuzzi, G.L., Kashtelyan, V., Dowling, E., Harbison, J.I., Bolger, D.J., Bunting, M.F., & Dougherty, M.R. (2014). Measuring working memory is all fun and games. Experimental Psychology, 61(6), 417–438.
  9. Biederman, J., Monuteaux, M.C., Doyle, A.E., Seidman, L.J., Wilens, T.E., Ferrero, F., Morgan, C.L., & Faraone, S.V. (2004). Impact of executive function deficits and attention-deficit/ hyperactivity disorder (ADHD) on academic outcomes in children. Journal of Consulting and Clinical Psychology, 72(5), 757–766.
  10. Bull, R., & Scerif, G. (2001). Executive functioning as a predictor of children's mathematics ability: Inhibition, switching, and working memory. Developmental Neuropsychology, 19(3), 273–293.
  11. Bull, R., & Scerif, G. (2001). Executive functioning as a predictor of children's mathematics ability: Inhibition, switching, and working memory. Developmental Neuropsychology, 19(3), 273–293.
  12. Cepeda, N.J., Kramer, A.F., & Gonzalez de Sather, J.C.M. (2001). Changes in executive control across the life span: Examination of task-switching performance. Developmental Psychology, 37(5), 715–730.
  13. Davidson, M.C., Amso, D., Anderson, L.C., & Diamond, A. (2006). Development of cognitive control and executive functions from 4 to 13 years: Evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia, 44(11), 2037–2078.
  14. Denham, S.A., & Brown, C. (2010). “Plays nice with others”: Social-emotional learning and academic success. Early Education and Development, 21(5), 652–680.
  15. Diamond, A., & Lee, K. (2011). Interventions shown to aid executive function development in children 4 to 12 years old. Science, 333(6045), 959–964.
  16. Duval, S., Bouchard, C., Pagé, P., & Hamel, C. (2016). Quality of classroom interactions in kindergarten and executive functions among five year-old children. Cogent Education, 3(1), 1207909.
  17. Glozman, J.M. (2020). Possibilities of integrating quantitative and qualitative measures to neuropsychological assessment. Children. Society. Future: Proceedings of the III Congress on Mental Health: Meeting the Needs of the XXI Century (vol. 1, pp. 41–43). Moscow: KnoRus Publ. (In Russ.)
  18. Gongsook, P. (2016). Interactive diagnostic game for time perception: Timo's adventure game (PhD in Industrial Design Thesis). Eindhoven: Technische Universiteit Eindhoven.
  19. Hassler Hallstedt, M., & Ghaderi, A. (2018). Tablets instead of paper-based tests for young children? Comparability between paper and tablet versions of the mathematical Heidelberger Rechen Test 1–4. Educational Assessment, 23(3), 195–210.
  20. Hawkins, G.E., Rae, B., Nesbitt, K.V., & Brown, S.D. (2013). Gamelike features might not improve data. Behavior Research Methods, 45(2), 301–318.
  21. Ionescu, T. (2012). Exploring the nature of cognitive flexibility. New Ideas in Psychology, 30(2), 190–200.
  22. Jarvis, H.L. (2003). Verbal and non-verbal working memory and achievements on national curriculum tests at 11 and 14 years of age. Educational and Child Psychology, 20(3), 123–140.
  23. Jurado, M.B., & Rosselli, M. (2007). The elusive nature of executive functions: A review of our current understanding. Neuropsychology Review, 17(3), 213–233.
  24. Kalabina, I.A., & Progackaya, T.K. (2021). Defining digital competence for older preschool children. Psychology in Russia: State of the Art, 14(4), 169–185.
  25. Kemp, A.H., Hatch, A., & Williams, L.M. (2009). Computerized neuropsychological assessments: Pros and cons. CNS Spectrums, 14(3), 118–121.
  26. Korkman, M. (1999). Applying Luria's diagnostic principles in the neuropsychological assessment of children. Neuropsychology Review, 9(2), 89–105.
  27. Kovyazina, M.S., Oschepkova, E.S., Airapetyan, Z.V., Ivanova, M.K., Dedyukina, M.I., & Gavrilova, M.N. (2021). Executive functions’ impact on vocabulary and verbal fluency among monoand bilingual preschool-aged children. Psychology in Russia: State of the Art, 14(4), 65–77.
  28. Kunitsyna, I.A., Popov, S.S., & Yakhudina, E.N. (2018). Psychological characteristics of junior schoolchildren with different levels of self-assessment. Pushkin Leningrad State University Journal, (4), 75–88. (In Russ.)
  29. Lin, C.-H., & Chen, C.-M. (2016). Developing spatial visualization and mental rotation with a digital puzzle game at primary school level. Computers in Human Behavior, 57, 23–30.
  30. Luciana, M., & Nelson, C.A. (2002). Assessment of neuropsychological function through use of the Cambridge neuropsychological testing automated battery: Performance in 4to 12-year-old children. Developmental Neuropsychology, 22(3), 595–624.
  31. Lumsden, J., Edwards, E.A., Lawrence, N.S., Coyle, D., & Munafò, M.R. (2016). Gamification of cognitive assessment and cognitive training: A systematic review of applications and efficacy. JMIR Serious Games, 4(2), e11.
  32. Luria, A.R. (1973). Fundamentals of neuropsychology. Moscow: MSU Publishing House. (In Russ.)
  33. McClelland, M.M., Geldhof, G.J., Cameron, C.E., & Wanless, S.B. (2015). Development and self-regulation. In R.M. Lerner (Ed.), Handbook of Child Psychology and Developmental Science (pp. 1–43). Hoboken: John Wiley & Sons.
  34. McNab, F., & Dolan, R.J. (2014). Dissociating distractor-filtering at encoding and during maintenance. Journal of Experimental Psychology: Human Perception and Performance, 40(3), 960–967.
  35. Miyake, A., Friedman, N.P., Emerson, M.J., Witzki, A.H., Howerter, A., & Wager, T.D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100.
  36. Mokhtar, M.K., Mohamed, F., Sunar, M.S., Arshad, M.A.M., & Mohd Sidik, M.K. (2018). Development of mobile-based augmented reality colouring for preschool learning. 2018 IEEE Conference on E-Learning, e-Management and e-Services (IC3e) (pp. 11–16). New York: IEEE.
  37. Molavi, P., Aziziaram, S., Basharpoor, S., Atadokht, A., Nitsche, M.A., & Salehinejad, M.A. (2020). Repeated transcranial direct current stimulation of dorsolateral-prefrontal cortex improves executive functions, cognitive reappraisal emotion regulation, and control over emotional processing in borderline personality disorder: A randomized, sham-controlled, parallel-group study. Journal of Affective Disorders, 274, 93–102.
  38. Perera, H., Jeewandara, K.C., Guruge, C., & Seneviratne, S. (2013). Presenting symptoms of autism in Sri Lanka: Analysis of a clinical cohort. Sri Lanka Journal of Child Health, 42(3), 139–143.
  39. Raiford, S.E., Zhang, O., Drozdick, L.W., Getz, K., Wahlstrom, D., Gabel, A., Holdnack, J.A., & Daniel, M. (2016). WISC-V Coding and Symbol Search in Digital Format: Reliability, Validity, Special Group Studies, and Interpretation (Q-interactive Technical Report 12). Retrieved October 6, 2022, from
  40. Rosselli, M., Ardila, A., Matute, E., & Inozemtseva, O. (2009). Gender differences and cognitive correlates of mathematical skills in school-aged children. Child Neuropsychology, 15(3), 216–231.
  41. Sim, G., & Horton, M. (2005). Performance and attitude of children in computer based versus paper based testing. In P. Kommers & G. Richards (Eds.), Proceedings of ED-MEDIA 2005 – World Conference on Educational Multimedia, Hypermedia & Telecommunications (pp. 3610–3614). Waynesville: Association for the Advancement of Computing in Education.
  42. Sobolev, M., Vitale, R., Wen, H., Kizer, J., Leeman, R., Pollak, J.P., Baumel, A., Vadhan, N.P., Estrin, D., & Muench, F. (2021). The digital marshmallow test (DMT) diagnostic and monitoring mobile health app for impulsive behavior: Development and validation study. JMIR MHealth and UHealth, 9(1), e25018.
  43. Stephen, C., & Edwards, S. (2017). Young children playing and learning in a digital age: A cultural and critical perspective. London: Routledge.
  44. Swaab, H., Bouma, A., Hendriksen, J., & König, C. (Eds.). (2016). Klinische kinderneuropsychologie. Amsterdam: Boom.
  45. Veraksa, A., Almazova, O., & Bukhalenkova, D. (2020). Studying executive functions in senior preschoolers. PsyCh Journal, 9(1), 144–146.
  46. Veraksa, A., Bukhalenkova, D., Kartushina, N., & Oshchepkova, E. (2020). The relationship between executive functions and language production in 5–6-year-old children: Insights from working memory and storytelling. Behavioral Sciences, 10(2), 52.
  47. Veraksa, A.N. (2009). The role of symbolic mediation in cognitive activity in primary school (acquisition of the function concept). Moscow University Psychology Bulletin. Series 14. Psychology, (2), 31–44. (In Russ.)
  48. Veraksa, A.N., Almazova, O.V., & Bukhalenkova, D.A. (2020). Executive functions assessment in senior preschool age: A battery of methods. Psikhologicheskii Zhurnal, 41(6), 108–118. (In Russ.)
  49. Veraksa, N.E., Bukhalenkova, D.A., Veraksa, A.N., & Chichinina, E.A. (2022). Relationship between the use of digital devices and executive functions development in preschool children. Psikhologicheskii Zhurnal, 43(1), 51–59. (In Russ.)
  50. Veraxa, A.N., Vasilieva, M.D., & Archakova, T.O. (2016). Development of arbitrary regulatory functions in preschool children: a review of contemporary foreign studies. Voprosy Psychologii, (6), 150–166. (In Russ.)
  51. Vrana, S.R., & Vrana, D.T. (2017). Can a computer administer a Wechsler Intelligence Test? Professional Psychology: Research and Practice, 48(3), 191–198.
  52. Vygotskii, L.S. (1982). Thinking and speech. In V.V. Davydov (Eds.), The Collected Works. Vol. 2. Problems of General Psychology (pp. 5–361). Moscow: Pedagogika Publ. (In Russ.)
  53. Willoughby, M.T., Kupersmidt, J.B., & Voegler-Lee, M.E. (2012). Is preschool executive function causally related to academic achievement? Child Neuropsychology, 18(1), 79–91.
  54. Xanthopoulou, M., Kokalia, G., & Drigas, A. (2019). Applications for children with autism in preschool and primary education. International Journal of Recent Contributions from Engineering, Science & IT, 7(2), 4–16.
  55. Zelazo, P.D. (2006). The Dimensional Change Card Sort (DCCS): A method of assessing executive function in children. Nature Protocols, 1(1), 297–301.

Copyright (c) 2023 Veraksa N.E., Aslanova M.S., Tarasova K.S., Klimenko V.A.

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

This website uses cookies

You consent to our cookies if you continue to use our website.

About Cookies