Modern principles of developing the subtest “Reading and Use of Language” of the TORFL-II

Cover Page

Cite item

Abstract

The article is devoted to the topical problem of modern principles of developing tests of Russian as a foreign language (RFL), taking into account the world experience. The purpose of the article is to summarize the modern principles of language test development and to show how they are implemented in the new tests of Russian as a foreign language. The materials of the article include the research papers of Russian and foreign authors in the sphere of methodology over the past 20 years, as well as modern formats of testing in foreign languages. At the first stage of the study, general scientific methods of generalization, systematization and structuring were used. At the second phase, a new format of the RFL test “Reading and Use of Language” (B2) was modelled, combining language and communication competence testing. At the third stage, an experiment was conducted to test the new format. 48 foreign master students studying the program “Russian Language and Russian Culture in the Aspect of Russian as a Foreign Language” in Saint Petersburg State University took part in the experiment. It was concluded that the modern language test, in accordance with the basic cognitive and communicative principle of learning and control, should be based on the following principles: testing skills in different types of speech activities mainly on the text material; interdependence between the type of the task and the speech genre of the text being created/used in the task; basing on a linguistic and didactic description of the communicative competence level; integrative approach; using different types of test tasks within one subtest; the principle of increasing complexity of tasks; taking into account the complexity of each task in its assessment; task feasibility according to students’ educational level; taking into account the values of the multicultural world; taking into account international experience; basing on reliability and validity criteria of test tasks. These principles implemented in the new TORFL-II subtest format “Reading and Use of Language” are presented in the article. The implementation of modern test principles should ensure that all speech control facilities are systematically allocated to the appropriate level and parameters for their assessment. The above-mentioned principles of test creation and the example of their implementation can be taken as the basis of a full-fledged system of control and measurement materials based on linguistic and didactical descriptions of each level.

About the authors

Inna N. Erofeeva

Saint Petersburg State University

Author for correspondence.
Email: i.erofeeva@spbu.ru

Сandidate of Pedagogy, Associate Professor of the Department of Russian as a Foreign Language and Methodology of its Teaching

7-9 Universitetskaya Naberezhnaya, Saint Petersburg, 119034, Russian Federation

Tatiana I. Popova

Saint Petersburg State University

Email: t.popova@spbu.ru

Doctor of Philology, Professor, Professor, Head of the Department of Russian as a Foreign Language and Methodology of its Teaching

7-9 Universitetskaya Naberezhnaya, Saint Petersburg, 119034, Russian Federation

References

  1. Alderson, J., & Charles, B.J. (2002). Language testing and assessment (Part I). Language Teaching, 34, 213–236.
  2. ALTE. (1994). The ALTE Code of Practice. Retrieved August 7, 2020, from https://www.alte.org/resources/Documents/code_practice_en.pdf
  3. ALTE. (2020). ALTE Principles of Good Practice. Retrieved August 8, 2020, from https://www.alte.org/resources/Documents/ALTE (Final).pdf
  4. Anikina, M.E., Yermoshkina, T.A., Iskakov, D.Z., Kobzev, M.V., Pushkareva, D.A., & Shepilova, G.G. (2016). Perception of long texts by the generation of “digital islanders”. Mediaskop, (1). Retrieved December 4, 2020, from http://mediascope.ru/?q=node/2089
  5. Avanesov, V.S. (1998). Composition of test tasks. 2nd ed. Moscow: Adept Publ. (In Russ.)
  6. Avanesov, V.S. (2005). Theory and practice of pedagogical measurements. Public publications and the Internet. Center for Education Testing and Monitoring of Ural Federal University. Retrieved August 8, 2020, from http://www.charko.narod.ru/tekst/biblio/Avanesov_Teoriya_i_metod_ped_izmer.pdf
  7. Averyanova, G.N., Belikova, L.G., Erofeeva, I.N., Ivanova, T.A., Nesterova, T.E., & Yurkov, E.E. (1999). Typical tests in Russian as a foreign language. The second certification level. Saint Petersburg: Zlatoust Publ. (In Russ.)
  8. Bachman, L.E., & Palmer, A.S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford: Oxford University Publ.
  9. Cambridge English: Exams: Cambridge English First (FCE): Exam format: Reading and use of English. Retrieved August 8, 2020, from http://www.cambridgeenglish.org/exams/first/exam-format/
  10. Chelyshkova, M.B. (2002). Theory and practice of designing pedagogical tests: Teaching manual. Moscow: Logos Publ. (In Russ.)
  11. Cohen, A.D. (2007). The coming age for research on test-taking strategies. Retrieved December 3, 2020, from https://www.researchgate.net/publication/272121823_The_Coming_of_Age_of_Research_on_Test-Taking_Strategies
  12. English B2 level. Retrieved August 8, 2020, from http://www.efset.org./ru/english
  13. Hughes, A. (2003). Testing for language teachers. 2nd ed. Cambridge: Cambridge University.
  14. ILTA Guidelines for Practice in English. Retrieved October 10, 2020, from https://cdn.ymaws.com/www.iltaonline.com/resource/resmgr/docs/guidelines_for_practice/2020_revised/ilta_guidelines_for_practice.pdf
  15. Ivanova, T.A., Popova, T.I., Rogova, K.A., & Yurkov, E.E. (1999). State educational standard for Russian as a foreign language. Level two. Saint Petersburg: Zlatoust Publ. (In Russ.)
  16. Manual for Language Test Development and Examining Council of Europe. (2011, April). Retrieved October 21, 2020, from file:///D:/Documents/ManualLanguageTest-Alte2011_EN.pdf
  17. Matienko, A.V. (2011). Methodical concept of cognitive and communication control in the system of teaching a foreign language to students of a linguistic university (Author’s abstract of Doctoral dissertation). Nizhny Novgorod. (In Russ.)
  18. McNamara, T. (2010). The use of language tests in the service of policy: Issues of validity. Revue française de linguistique appliquée, XV, 7–23.
  19. Modern Languages Division. (2005). Common European framework of reference for foreign language: Learning, teaching, assessment: A monograph. Strasburg. (In Russ.)
  20. Pavlovskaya, I.Yu., & Bashmakova, N.I. (2007). The basics of the methodology of learning foreign languages. Testology: Textbook. 2nd ed. Saint Petersburg: Faculty of Philology of the Saint Petersburg State University Publ. (In Russ.)
  21. Phakiti, A. (2003). A closer look at the relationship of cognitive and metacognitive strategy use to EFL reading achievement test performance. Language Testing, 20(1), 26–56.
  22. Rogova, K.A. (2009). Requirements for the level of formation of communicative competence in reading. Second certification level. Methodical Workshops on the Study and Teaching of Russian as a Foreign Language: Collection of Scientific and Methodological Research Papers. Saint Petersburg: MIRS Publ. (In Russ.)
  23. Shamov, A.N. (2006). Cognitive and communicative approach to learning French as a second foreign language. Nizhniy Novgorod: The Linguistics University of Nizhny Novgorod Publ. (In Russ.)
  24. Shepilova, A.V. (2003). Cognitive and communicative approach to learning French as a second foreign language. Moscow: Prosveshcheniye Publ. (In Russ.)
  25. Sitnov, Yu.A. (2005). Methodical concept of cognitive and communication control in the system of teaching a foreign language to students of a linguistic university (Author’s abstr. of Doctoral dissertation). Pyatigorsk. (In Russ.)
  26. Sukyadi, D. (2020). Testing Principles. Retrieved October 10, 2020, from https://www.academia.edu/3095492/Principles_of_language_testing
  27. The Bologna process. Retrieved December 6, 2020, from https://www.unl.pt/data/qualidade/bolonha/guide-to-the-bologna-process.pdf
  28. Vinogradova, E.N., & Klobukova, L.P. (2019). Current linguistic problems of improving the regulatory and methodical documents of testing in Russian as a foreign language. Russian Abroad, (2), 72–79. (In Russ.)
  29. Weir, C., & Bax, S. (2012). Investigating learners’ cognitive processes during a computer-based CAE reading test. Cambridge ESOL: Research notes, (47), 3–14.
  30. Weir, C., Hawkey, R., Green, T., & Devi, S. (2009). The cognitive processes underlying the academic reading construct as measured by IELTS. British Council. IDP Australia IELTS Research Reports, 9(4), 157–189.
  31. Wittrock, M.C., & Baker, E.L. (1991). Testing and cognition. Englewood Cliffs, N.J.: Prentice Hall.

Copyright (c) 2021 Erofeeva I.N., Popova T.I.

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

This website uses cookies

You consent to our cookies if you continue to use our website.

About Cookies