Metaphoric gestures in simultaneous interpreting
- 作者: Leonteva A.V.1,2, Cienki A.3, Agafonova O.V.1,2
-
隶属关系:
- Moscow State Linguistic University
- Institute of Linguistics, RAS
- Vrije Universiteit Amsterdam
- 期: 卷 27, 编号 4 (2023): Modern Languages and Cultures: Varieties, Functions and Ideologies in Cognitive Perspective
- 页面: 820-842
- 栏目: Articles
- URL: https://journals.rudn.ru/linguistics/article/view/37232
- DOI: https://doi.org/10.22363/2687-0088-36189
- EDN: https://elibrary.ru/ZLYPZF
如何引用文章
全文:
详细
The paper deals with the degree to which interpreters incorporate visible behaviors from the people they are interpreting into their own practice. Since metaphoric gestures objectify abstract concepts in visible form, it is worth exploring the degree to which interpreters replicate such gestures of those whose speech they are interpreting; this can indicate how much they are employing the original speakers’ mental imagery connected with those abstract concepts. This imagery for the source domain of the metaphor ranges from highly iconic (high metaphoric) to low in iconicity (low metaphoric). The hypothesis is that interpreters use low metaphoric gestures rather than high metaphoric ones, due to the discourse type (interpreted speech). We performed formal visual and semantic analyses of ten-minute videos of interpreting a scientific lecture for the general public on a psychological topic from English into Russian. First, we analyzed the functions of the gestures in the source videos to identify metaphorically used gestures (e.g., depicting abstract ideas); then we studied the functions of the interpreters’ gestures. The results indicate a predominance of low-level, schematic metaphoricity in the interpreters’ gestures (e.g., simple ontological metaphors, as if presenting ideas on the open hand). Such results might be explained by the time pressure which leads to a decrease in mental imagery of the interpreters. We see a difference between the known role of gestures when speakers are formulating their own ideas (in thinking for speaking) and their role in simultaneous interpreting (when speakers are rendering others’ ideas, rather than forming their own ones).
作者简介
Anna Leonteva
Moscow State Linguistic University; Institute of Linguistics, RAS
编辑信件的主要联系方式.
Email: lentevanja27@gmail.com
ORCID iD: 0000-0001-7234-2999
holds a PhD in Linguistics. She is Head of the Sign Languages Laboratory and Senior Researcher at the Center for Socio-Cognitive Discourse Studies (SCoDis), Moscow State Linguistic University, and Junior Researcher at the Laboratory of Multi-Channel Communication, Institute of Linguistics of Russian Academy of Sciences. Her research interests are cognitive linguistics, co-speech gestures, cognitive load, multimodal communication, argumentative discourse.
Moscow, RussiaAlan Cienki
Vrije Universiteit Amsterdam
Email: a.cienki@vu.nl
ORCID iD: 0000-0003-2951-9722
PhD in Slavic linguistics and is Professor of Language Use & Cognition and English Linguistics in the Department of Language, Literature and Communication at the Vrije Universiteit Amsterdam, Netherlands. His research interests include cognitive linguistics, semantics, gesture studies, metaphor studies, and political discourse analysis.
Amsterdam, NetherlandsOlga Agafonova
Moscow State Linguistic University; Institute of Linguistics, RAS
Email: olga.agafonova92@gmail.com
ORCID iD: 0000-0001-8460-8555
Junior Researcher at the Center for Socio-Cognitive Discourse Studies (SCoDis), Moscow State Linguistic University, and Junior Researcher at the Laboratory of Multi-Channel Communication, Institute of Linguistics of Russian Academy of Sciences. Her research interests are cognitive linguistics, multimodal communication, gesture studies, cognitive load and political discourse.
Moscow, Russia参考
- Barcelona, Antonio. 2012. The cognitive theory of metaphor and metonymy. In Antonio Barcelona (ed.), Metaphor and metonymy at the crossroads: A cognitive perspective, 1-28. De Gruyter Mouton. https://doi.org/10.1515/9783110894677
- Bavelas, Janet B., Nicole Chovil, Douglas A. Lawrie & Allan Wade. 1992. Interactive gestures. Discourse Processes 15. 469-489. https://doi.org/10.1080/01638539209544823
- Bressem, Jana & Cornelia Müller. 2014. The family of Away gestures: Negation, refusal, and negative assessment. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill & Jana Bressem (eds.), Body-language-communication: An international handbook on multimodality in human interaction, Vol. 2, 1592-1604. Berlin: De Gruyter Mouton. https://doi.org/10.1515/9783110302028.1592
- Bressem, Jana, Silva H. Ladewig & Cornelia Müller. 2013. Linguistic Annotation System for Gestures (LASG). In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill & Sedinha Teßendorf (eds.), Body-language-communication: An international handbook on multimodality in human interaction, 1098-1124. Berlin/Boston: De Gruyter Mouton. https://doi.org/10.1515/9783110261318.1098
- Calbris, Geneviève. 2003. From cutting an object to a clear cut analysis: Gesture as the representation of a preconceptual schema linking concrete actions to abstract notions. Gesture 3 (1). 19-46. https://doi.org/10.1075/gest.3.1.03cal
- Calbris, Geneviève. 2011. Elements of Meaning in Gesture. Amsterdam: John Benjamins Publishing Company. https://doi.org/10.1075/gs.5
- Cassell, Justine, David McNeill & Karl-Erik McCullough. 1999. Speech-gesture mismatches: Evidence for one underlying representation of linguistic and nonlinguistic information. Pragmatics and Cognition 7 (1). 1-34. https://doi.org/10.1075/pc.7.1.03cas
- Cienki, Alan. 1998. Metaphoric gestures and some of their relations to verbal metaphoric expressions. In Jean-Pierre Koenig (ed.), Discourse and cognition: Bridging the gap, 189-204. Stanford: CSLI Publications.
- Cienki, Alan. 2005. Image schemas and gesture. In Beate Hampe (ed.), in cooperation with Joseph Grady, From perception to meaning: Image schemas in cognitive linguistics, 421-442. Berlin/New York: Mouton de Gruyter. https://doi.org/10.1515/9783110197532.5.421
- Cienki, Alan. 2023. Self-focused versus dialogic features of gesturing during simultaneous interpreting. Russian Journal of Linguistics 27 (4).
- Cienki, Alan & Cornelia Müller. (2008). Metaphor, gesture, and thought. In Raymond W. Gibbs Jr. (ed.), The Cambridge handbook of metaphor and thought, 483-501. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511816802.029
- Corballis, Michael C. 2012. How language evolved from manual gestures. Gesture 12 (2). 200-226. https://doi.org/10.1075/gest.12.2.04cor
- Dargue, Nicole, Naomi Sweller & Michael P. Jones. 2019. When our hands help us understand: A meta-analysis into the effects of gesture on comprehension. Psychological Bulletin 145. 765-784. https://doi.org/10.1037/bul0000202
- Dayter, Daria. 2020. Variation in non-fluencies in a corpus of simultaneous interpreting vs. non- interpreted English. Perspectives 29. 489-506. https://doi.org/10.1080/0907676X.2020.1718170
- De Ruiter, Jan Peter. 2000. The production of gesture and speech. In David McNeill (ed.), Language and gesture, 248-311. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511620850.018
- Dressel, Dennis. 2020. Multimodal word searches in collaborative storytelling: On the local mobilization and negotiation of coparticipation, Journal of Pragmatics 170. 37-54. https://doi.org/10.1016/j.pragma.2020.08.010
- Drijvers, Linda & Asli Özyürek. 2017. Visual context enhanced: The joint contribution of iconic gestures and visible speech to degraded speech comprehension. Journal of Speech Language and Hearing Research 60. 212-222. https://doi.org/10.1044/2016_JSLHR-H-16-0101
- Forceville, Charles. 2009. Non-verbal and multimodal metaphor in a cognitivist framework: Agendas for research. In Charles J. Forceville & Eduardo Urios-Aparisi (eds.), Multimodal metaphor, 19-42. Berlin: Mouton de Gruyter. https://doi.org/10.1515/9783110215366.1.19
- Fricke, Ellen. 2002. Origo, pointing, and speech: The impact of co-speech gestures on linguistic deixis theory. Gesture 2 (2). 207-226. https://doi.org/10.1075/gest.2.2.05fri
- Fricke, Ellen. 2013. Towards a unified grammar of gesture and speech: A multimodal approach. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva Ladewig, David McNeill & Sedinha Tessendorf (eds.), Body - language - communication, Volume 1, 733-754. Berlin: De Gruyter Mouton. https://doi.org/10.1515/9783110261318.733
- Gerwing, Jennifer & Janet Bavelas. 2004. Linguistic influences on gesture’s form. Gesture 4 (2). 157-195. https://doi.org/10.1075/gest.4.2.04ger
- Gile Daniel. 2009. Basic Concepts and Models for Interpreter and Translator Training. Amsterdam, Philadelphia: John Benjamins. https://doi.org/10.1075/btl.8
- Goldin-Meadow, Susan & Martha W. Alibali. 2013. Gesture’s role in speaking, learning, and creating language. Annual Review of Psychology 64. 257-283. https://doi.org/10.1146/annurev-psych-113011-143802
- Gósy Mária. 2007. Disfluencies and self-monitoring. Govor = Speech 24. 91-110.
- Grishina, Elena A. 2015. O russkom zhestikulyatsionnom otritsanii (On gestural negation in the Russian language). Trudy Instituta Russkogo Yazyka im. V. V. Vinogradova 3. 556-604.
- Harrison, Simon. 2014. The organisation of kinesic ensembles associated with negation. Gesture 14 (2). 117-41. https://doi.org/10.1075/gest.14.2.01har
- Hilliard, Caitlin & Susan W. Cook. 2016. Bridging gaps in common ground: Speakers design their gestures for their listeners. Journal of Experimental Psychology: Learning, Memory, and Cognition 42. 91-103. https://doi.org/10.1037/xlm0000154
- Hostetter, Autumn B. 2011. When do gestures communicate? A meta-analysis. Psychological Bulletin 137. 297-315. https://doi.org/10.1037/a0022128
- Iverson, Jana M. & Susan Goldin-Meadow. 1998. Why people gesture when they speak. Nature 396 (6708). 228. https://doi.org/10.1038/24300
- Jakobson, Roman. 1956. Two aspects of language and two types of aphasic disturbances. In Linda Waugh & Monique Monville-Burston (eds.), On language, 115-133. https://doi.org/10.1515/9783110889598-005
- Jakobson, Roman. 1987. On the relation between auditory and visual signs. In Krystyna Pomorska & Stephen Rudy (eds.), Language in literature, 467-473. Cambridge, MA: Belknap Press.
- Kendon, Adam. 2004. Gesture: Visible Action as Utterance. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511807572
- Kok, Kasper, Kirsten Bergmann, Alan Cienki & Stefan Kopp. 2015. Mapping out the multifunctionality of speakers’ gestures. Gesture 15. 37-59. https://doi.org/10.1075/ gest.15.1.02kok
- Krauss, Robert M., Yihsiu Chen & Rebecca F. Gottesman. 2000. Lexical gestures and lexical access: A process model. In David McNeill (ed.), Language and gesture, 261-283. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511620850.017
- Lakoff, George. 1993. The contemporary theory of metaphor. In Andrew Ortony (ed.), Metaphor and thought (2nd ed.), 202-251. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9781139173865.013
- Lapaire, Jean-Remi P. 2016. From ontological metaphor to semiotic make-believe: Giving shape and substance to fictive objects of conception with the ‘globe gesture’. Santa Cruz do Sul 41 (70). 29-44. https://doi.org/10.17058/signo.v41i70.6413
- Lucero, Ché, Holly Zaharchuk & Daniel Casasanto. 2014. Beat gestures facilitate speech production. Proceedings of the Annual Meeting of the Cognitive Science Society 36. 898-903.
- McNeill, David & Susan D. Duncan. 2000. Growth points in thinking for speaking. In David McNeill (ed.), Language and gesture, 141-161. Cambridge: Cambridge University Press. https://doi.org/10.1017/cbo9780511620850.010
- McNeill, David, Justine Cassell & Karl-Erik McCullough. 1994. Communicative Effects of Speech-Mismatched Gestures. Research on Language and Social Interaction 27. 223-237. https://doi.org/10.1207/s15327973rlsi2703_4
- McNeill, David. 1992. Hand and Mind: What Gestures Reveal about Thought. Chicago, IL: Chicago University Press. https://doi.org/10.2307/1576015
- McNeill, David. 2005. Gesture and Thought. Chicago, IL: University of Chicago Press. https://doi.org/10.7208/chicago/9780226514642.001.0001
- Melinger, Alissa & Willem J. M. Levelt. 2004. Gesture and the communicative intention of the speaker. Gesture 4. 119-141. https://doi.org/10.1075/gest.4.2.02mel
- Mittelberg, Irene & Linda R. Waugh. 2009. Metonymy first, metaphor second: A cognitivesemiotic approach to multimodal figures of thought in co-speech gesture. In Charles J. Forceville & Eduardo Urios-Aparisi (eds.), Multimodal metaphor, 329-358. Berlin: De Gruyter Mouton. https://doi.org/10.1515/9783110215366.5.329
- Mittelberg, Irene. 2006. Metaphor and metonymy in language and gesture: Discourse evidence for multimodal models of grammar. Ph.D. Diss. Cornell University.
- Morsella, Ezequiel & Robert M. Krauss. 2004. The role of gestures in spatial working memory and speech. The American Journal of Psychology 117 (3). 411-424. https://doi.org/10.2307/4149008
- Müller, Cornelia. 2004. Forms and uses of the Palm Up Open Hand: A case of a gesture family? In Cornelia Müller & Roland Posner (eds.), The semantics and pragmatics of everyday gestures, 233-256. Berlin: Weidler.
- Müller, Cornelia. 2008. Metaphors Dead and Alive, Sleeping and Waking. A dynamic view. Chicago: Chicago University Press. https://doi.org/10.7208/chicago/ 9780226548265.001.0001
- Müller, Cornelia. 2014. Gestural modes of representation as techniques of depiction. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill & Jana Bressem (eds.), Body - language - communication, 1687-1702. Berlin: De Gruyter Mouton.
- Poyatos, Fernando. 1987/2002. Nonverbal communication in simultaneous and consecutive interpretation: A theoretical model and new perspectives. In Franz Pöchhacker & Miriam Shlesinger (eds.), The interpreting studies reader, 235-246. London: Routledge.
- Seeber Kilian G. 2011. Cognitive load in simultaneous interpreting: Existing theories - New models. Interpreting 13 (2). 176-204. https://doi.org/10.1075/intp.13.2.02see
- Seeber, Kilian G. 2012. Multimodal input in simultaneous interpreting: An eye-tracking experiment. In Lew N. Zybatow, Alena Petrova & Michael Ustaszewski (eds.), Proceeding of the 1st international conference TRANSLATA, translation and interpreting research: Yesterday-today-tomorrow, 341-347. Frankfurt am Main: Peter Lang.
- Seeber, Kilian G. 2017. Multimodal processing in simultaneous interpreting. In John W. Schwieter & Aline Ferreira (eds.), The handbook of translation and cognition, 461-475. Hoboken, NJ: John Wiley & Sons. https://doi.org/10.1002/9781119241485
- Streeck, Jürgen. 2009a. Forward-gesturing. Discourse Processes 46 (2-3). 161-179. https://doi.org/10.1080/01638530902728793
- Streeck, Jürgen. 2009b. Gesturecraft: The Manu-facture of Meaning. Amsterdam: John Benjamins. https://doi.org/10.1075/gs.2
- Tong, Yao. 2023. Embodiment of concrete and abstract concepts: The role of gesture [Unpublished doctoral dissertation]. Vrije Universiteit Amsterdam.
- Vilà-Giménez, Ingrid & Pilar Prieto. 2020. Encouraging kids to beat: Children’s beat gesture production boosts their narrative performance. Developmental Science 23. e12967. https://doi.org/10.1111/desc.12967
- Wei, Carolyn Y. 2006. Not crazy, just talking on the phone: Gestures and mobile phone conversations. In Proceedings of the 2006 IEEE International Professional Communication Conference, Saratoga. 299-307. https://doi.org/10.1109/IPCC.2006.320363