Metaphoric gestures in simultaneous interpreting

封面

如何引用文章

详细

The paper deals with the degree to which interpreters incorporate visible behaviors from the people they are interpreting into their own practice. Since metaphoric gestures objectify abstract concepts in visible form, it is worth exploring the degree to which interpreters replicate such gestures of those whose speech they are interpreting; this can indicate how much they are employing the original speakers’ mental imagery connected with those abstract concepts. This imagery for the source domain of the metaphor ranges from highly iconic (high metaphoric) to low in iconicity (low metaphoric). The hypothesis is that interpreters use low metaphoric gestures rather than high metaphoric ones, due to the discourse type (interpreted speech). We performed formal visual and semantic analyses of ten-minute videos of interpreting a scientific lecture for the general public on a psychological topic from English into Russian. First, we analyzed the functions of the gestures in the source videos to identify metaphorically used gestures (e.g., depicting abstract ideas); then we studied the functions of the interpreters’ gestures. The results indicate a predominance of low-level, schematic metaphoricity in the interpreters’ gestures (e.g., simple ontological metaphors, as if presenting ideas on the open hand). Such results might be explained by the time pressure which leads to a decrease in mental imagery of the interpreters. We see a difference between the known role of gestures when speakers are formulating their own ideas (in thinking for speaking) and their role in simultaneous interpreting (when speakers are rendering others’ ideas, rather than forming their own ones).

作者简介

Anna Leonteva

Moscow State Linguistic University; Institute of Linguistics, RAS

编辑信件的主要联系方式.
Email: lentevanja27@gmail.com
ORCID iD: 0000-0001-7234-2999

holds a PhD in Linguistics. She is Head of the Sign Languages Laboratory and Senior Researcher at the Center for Socio-Cognitive Discourse Studies (SCoDis), Moscow State Linguistic University, and Junior Researcher at the Laboratory of Multi-Channel Communication, Institute of Linguistics of Russian Academy of Sciences. Her research interests are cognitive linguistics, co-speech gestures, cognitive load, multimodal communication, argumentative discourse.

Moscow, Russia

Alan Cienki

Vrije Universiteit Amsterdam

Email: a.cienki@vu.nl
ORCID iD: 0000-0003-2951-9722

PhD in Slavic linguistics and is Professor of Language Use & Cognition and English Linguistics in the Department of Language, Literature and Communication at the Vrije Universiteit Amsterdam, Netherlands. His research interests include cognitive linguistics, semantics, gesture studies, metaphor studies, and political discourse analysis.

Amsterdam, Netherlands

Olga Agafonova

Moscow State Linguistic University; Institute of Linguistics, RAS

Email: olga.agafonova92@gmail.com
ORCID iD: 0000-0001-8460-8555

Junior Researcher at the Center for Socio-Cognitive Discourse Studies (SCoDis), Moscow State Linguistic University, and Junior Researcher at the Laboratory of Multi-Channel Communication, Institute of Linguistics of Russian Academy of Sciences. Her research interests are cognitive linguistics, multimodal communication, gesture studies, cognitive load and political discourse.

Moscow, Russia

参考

  1. Barcelona, Antonio. 2012. The cognitive theory of metaphor and metonymy. In Antonio Barcelona (ed.), Metaphor and metonymy at the crossroads: A cognitive perspective, 1-28. De Gruyter Mouton. https://doi.org/10.1515/9783110894677
  2. Bavelas, Janet B., Nicole Chovil, Douglas A. Lawrie & Allan Wade. 1992. Interactive gestures. Discourse Processes 15. 469-489. https://doi.org/10.1080/01638539209544823
  3. Bressem, Jana & Cornelia Müller. 2014. The family of Away gestures: Negation, refusal, and negative assessment. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill & Jana Bressem (eds.), Body-language-communication: An international handbook on multimodality in human interaction, Vol. 2, 1592-1604. Berlin: De Gruyter Mouton. https://doi.org/10.1515/9783110302028.1592
  4. Bressem, Jana, Silva H. Ladewig & Cornelia Müller. 2013. Linguistic Annotation System for Gestures (LASG). In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill & Sedinha Teßendorf (eds.), Body-language-communication: An international handbook on multimodality in human interaction, 1098-1124. Berlin/Boston: De Gruyter Mouton. https://doi.org/10.1515/9783110261318.1098
  5. Calbris, Geneviève. 2003. From cutting an object to a clear cut analysis: Gesture as the representation of a preconceptual schema linking concrete actions to abstract notions. Gesture 3 (1). 19-46. https://doi.org/10.1075/gest.3.1.03cal
  6. Calbris, Geneviève. 2011. Elements of Meaning in Gesture. Amsterdam: John Benjamins Publishing Company. https://doi.org/10.1075/gs.5
  7. Cassell, Justine, David McNeill & Karl-Erik McCullough. 1999. Speech-gesture mismatches: Evidence for one underlying representation of linguistic and nonlinguistic information. Pragmatics and Cognition 7 (1). 1-34. https://doi.org/10.1075/pc.7.1.03cas
  8. Cienki, Alan. 1998. Metaphoric gestures and some of their relations to verbal metaphoric expressions. In Jean-Pierre Koenig (ed.), Discourse and cognition: Bridging the gap, 189-204. Stanford: CSLI Publications.
  9. Cienki, Alan. 2005. Image schemas and gesture. In Beate Hampe (ed.), in cooperation with Joseph Grady, From perception to meaning: Image schemas in cognitive linguistics, 421-442. Berlin/New York: Mouton de Gruyter. https://doi.org/10.1515/9783110197532.5.421
  10. Cienki, Alan. 2023. Self-focused versus dialogic features of gesturing during simultaneous interpreting. Russian Journal of Linguistics 27 (4).
  11. Cienki, Alan & Cornelia Müller. (2008). Metaphor, gesture, and thought. In Raymond W. Gibbs Jr. (ed.), The Cambridge handbook of metaphor and thought, 483-501. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511816802.029
  12. Corballis, Michael C. 2012. How language evolved from manual gestures. Gesture 12 (2). 200-226. https://doi.org/10.1075/gest.12.2.04cor
  13. Dargue, Nicole, Naomi Sweller & Michael P. Jones. 2019. When our hands help us understand: A meta-analysis into the effects of gesture on comprehension. Psychological Bulletin 145. 765-784. https://doi.org/10.1037/bul0000202
  14. Dayter, Daria. 2020. Variation in non-fluencies in a corpus of simultaneous interpreting vs. non- interpreted English. Perspectives 29. 489-506. https://doi.org/10.1080/0907676X.2020.1718170
  15. De Ruiter, Jan Peter. 2000. The production of gesture and speech. In David McNeill (ed.), Language and gesture, 248-311. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511620850.018
  16. Dressel, Dennis. 2020. Multimodal word searches in collaborative storytelling: On the local mobilization and negotiation of coparticipation, Journal of Pragmatics 170. 37-54. https://doi.org/10.1016/j.pragma.2020.08.010
  17. Drijvers, Linda & Asli Özyürek. 2017. Visual context enhanced: The joint contribution of iconic gestures and visible speech to degraded speech comprehension. Journal of Speech Language and Hearing Research 60. 212-222. https://doi.org/10.1044/2016_JSLHR-H-16-0101
  18. Forceville, Charles. 2009. Non-verbal and multimodal metaphor in a cognitivist framework: Agendas for research. In Charles J. Forceville & Eduardo Urios-Aparisi (eds.), Multimodal metaphor, 19-42. Berlin: Mouton de Gruyter. https://doi.org/10.1515/9783110215366.1.19
  19. Fricke, Ellen. 2002. Origo, pointing, and speech: The impact of co-speech gestures on linguistic deixis theory. Gesture 2 (2). 207-226. https://doi.org/10.1075/gest.2.2.05fri
  20. Fricke, Ellen. 2013. Towards a unified grammar of gesture and speech: A multimodal approach. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva Ladewig, David McNeill & Sedinha Tessendorf (eds.), Body - language - communication, Volume 1, 733-754. Berlin: De Gruyter Mouton. https://doi.org/10.1515/9783110261318.733
  21. Gerwing, Jennifer & Janet Bavelas. 2004. Linguistic influences on gesture’s form. Gesture 4 (2). 157-195. https://doi.org/10.1075/gest.4.2.04ger
  22. Gile Daniel. 2009. Basic Concepts and Models for Interpreter and Translator Training. Amsterdam, Philadelphia: John Benjamins. https://doi.org/10.1075/btl.8
  23. Goldin-Meadow, Susan & Martha W. Alibali. 2013. Gesture’s role in speaking, learning, and creating language. Annual Review of Psychology 64. 257-283. https://doi.org/10.1146/annurev-psych-113011-143802
  24. Gósy Mária. 2007. Disfluencies and self-monitoring. Govor = Speech 24. 91-110.
  25. Grishina, Elena A. 2015. O russkom zhestikulyatsionnom otritsanii (On gestural negation in the Russian language). Trudy Instituta Russkogo Yazyka im. V. V. Vinogradova 3. 556-604.
  26. Harrison, Simon. 2014. The organisation of kinesic ensembles associated with negation. Gesture 14 (2). 117-41. https://doi.org/10.1075/gest.14.2.01har
  27. Hilliard, Caitlin & Susan W. Cook. 2016. Bridging gaps in common ground: Speakers design their gestures for their listeners. Journal of Experimental Psychology: Learning, Memory, and Cognition 42. 91-103. https://doi.org/10.1037/xlm0000154
  28. Hostetter, Autumn B. 2011. When do gestures communicate? A meta-analysis. Psychological Bulletin 137. 297-315. https://doi.org/10.1037/a0022128
  29. Iverson, Jana M. & Susan Goldin-Meadow. 1998. Why people gesture when they speak. Nature 396 (6708). 228. https://doi.org/10.1038/24300
  30. Jakobson, Roman. 1956. Two aspects of language and two types of aphasic disturbances. In Linda Waugh & Monique Monville-Burston (eds.), On language, 115-133. https://doi.org/10.1515/9783110889598-005
  31. Jakobson, Roman. 1987. On the relation between auditory and visual signs. In Krystyna Pomorska & Stephen Rudy (eds.), Language in literature, 467-473. Cambridge, MA: Belknap Press.
  32. Kendon, Adam. 2004. Gesture: Visible Action as Utterance. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511807572
  33. Kok, Kasper, Kirsten Bergmann, Alan Cienki & Stefan Kopp. 2015. Mapping out the multifunctionality of speakers’ gestures. Gesture 15. 37-59. https://doi.org/10.1075/ gest.15.1.02kok
  34. Krauss, Robert M., Yihsiu Chen & Rebecca F. Gottesman. 2000. Lexical gestures and lexical access: A process model. In David McNeill (ed.), Language and gesture, 261-283. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511620850.017
  35. Lakoff, George. 1993. The contemporary theory of metaphor. In Andrew Ortony (ed.), Metaphor and thought (2nd ed.), 202-251. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9781139173865.013
  36. Lapaire, Jean-Remi P. 2016. From ontological metaphor to semiotic make-believe: Giving shape and substance to fictive objects of conception with the ‘globe gesture’. Santa Cruz do Sul 41 (70). 29-44. https://doi.org/10.17058/signo.v41i70.6413
  37. Lucero, Ché, Holly Zaharchuk & Daniel Casasanto. 2014. Beat gestures facilitate speech production. Proceedings of the Annual Meeting of the Cognitive Science Society 36. 898-903.
  38. McNeill, David & Susan D. Duncan. 2000. Growth points in thinking for speaking. In David McNeill (ed.), Language and gesture, 141-161. Cambridge: Cambridge University Press. https://doi.org/10.1017/cbo9780511620850.010
  39. McNeill, David, Justine Cassell & Karl-Erik McCullough. 1994. Communicative Effects of Speech-Mismatched Gestures. Research on Language and Social Interaction 27. 223-237. https://doi.org/10.1207/s15327973rlsi2703_4
  40. McNeill, David. 1992. Hand and Mind: What Gestures Reveal about Thought. Chicago, IL: Chicago University Press. https://doi.org/10.2307/1576015
  41. McNeill, David. 2005. Gesture and Thought. Chicago, IL: University of Chicago Press. https://doi.org/10.7208/chicago/9780226514642.001.0001
  42. Melinger, Alissa & Willem J. M. Levelt. 2004. Gesture and the communicative intention of the speaker. Gesture 4. 119-141. https://doi.org/10.1075/gest.4.2.02mel
  43. Mittelberg, Irene & Linda R. Waugh. 2009. Metonymy first, metaphor second: A cognitivesemiotic approach to multimodal figures of thought in co-speech gesture. In Charles J. Forceville & Eduardo Urios-Aparisi (eds.), Multimodal metaphor, 329-358. Berlin: De Gruyter Mouton. https://doi.org/10.1515/9783110215366.5.329
  44. Mittelberg, Irene. 2006. Metaphor and metonymy in language and gesture: Discourse evidence for multimodal models of grammar. Ph.D. Diss. Cornell University.
  45. Morsella, Ezequiel & Robert M. Krauss. 2004. The role of gestures in spatial working memory and speech. The American Journal of Psychology 117 (3). 411-424. https://doi.org/10.2307/4149008
  46. Müller, Cornelia. 2004. Forms and uses of the Palm Up Open Hand: A case of a gesture family? In Cornelia Müller & Roland Posner (eds.), The semantics and pragmatics of everyday gestures, 233-256. Berlin: Weidler.
  47. Müller, Cornelia. 2008. Metaphors Dead and Alive, Sleeping and Waking. A dynamic view. Chicago: Chicago University Press. https://doi.org/10.7208/chicago/ 9780226548265.001.0001
  48. Müller, Cornelia. 2014. Gestural modes of representation as techniques of depiction. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill & Jana Bressem (eds.), Body - language - communication, 1687-1702. Berlin: De Gruyter Mouton.
  49. Poyatos, Fernando. 1987/2002. Nonverbal communication in simultaneous and consecutive interpretation: A theoretical model and new perspectives. In Franz Pöchhacker & Miriam Shlesinger (eds.), The interpreting studies reader, 235-246. London: Routledge.
  50. Seeber Kilian G. 2011. Cognitive load in simultaneous interpreting: Existing theories - New models. Interpreting 13 (2). 176-204. https://doi.org/10.1075/intp.13.2.02see
  51. Seeber, Kilian G. 2012. Multimodal input in simultaneous interpreting: An eye-tracking experiment. In Lew N. Zybatow, Alena Petrova & Michael Ustaszewski (eds.), Proceeding of the 1st international conference TRANSLATA, translation and interpreting research: Yesterday-today-tomorrow, 341-347. Frankfurt am Main: Peter Lang.
  52. Seeber, Kilian G. 2017. Multimodal processing in simultaneous interpreting. In John W. Schwieter & Aline Ferreira (eds.), The handbook of translation and cognition, 461-475. Hoboken, NJ: John Wiley & Sons. https://doi.org/10.1002/9781119241485
  53. Streeck, Jürgen. 2009a. Forward-gesturing. Discourse Processes 46 (2-3). 161-179. https://doi.org/10.1080/01638530902728793
  54. Streeck, Jürgen. 2009b. Gesturecraft: The Manu-facture of Meaning. Amsterdam: John Benjamins. https://doi.org/10.1075/gs.2
  55. Tong, Yao. 2023. Embodiment of concrete and abstract concepts: The role of gesture [Unpublished doctoral dissertation]. Vrije Universiteit Amsterdam.
  56. Vilà-Giménez, Ingrid & Pilar Prieto. 2020. Encouraging kids to beat: Children’s beat gesture production boosts their narrative performance. Developmental Science 23. e12967. https://doi.org/10.1111/desc.12967
  57. Wei, Carolyn Y. 2006. Not crazy, just talking on the phone: Gestures and mobile phone conversations. In Proceedings of the 2006 IEEE International Professional Communication Conference, Saratoga. 299-307. https://doi.org/10.1109/IPCC.2006.320363

版权所有 © Leonteva A., Cienki A., Agafonova O., 2023

Creative Commons License
此作品已接受知识共享署名-非商业性使用 4.0国际许可协议的许可。

##common.cookie##