Self-focused versus dialogic features of gesturing during simultaneous interpreting

封面

如何引用文章

详细

The present study considers an implicit debate in the field of gesture studies as to whether gestures are produced primarily for the speaker or for the addressee. It considers the unique monologic setting of simultaneous interpreters working in a booth in which there is no visible audience present and where they only hear and do not see the speaker whose words they are interpreting. The hypotheses (H) are that the interpreters might produce more representational gestures, to aid in their own idea formulation (H1), and self-adapter movements, to maintain their self-focus (H2), rather than pragmatic gestures, which are known to serve interactive functions. Forty-nine interpreters were videorecorded as they interpreted two portions of popular science lectures, one from either English or German (their L2) into Russian (their L1) and one from Russian into their respective L2. The results showed that a vast majority of the gestures produced were either pragmatic in function or self adapters. H2 was thus supported, but H1 was not. The frequent use of pragmatic gestures is interpreted in terms of the internalized dialogic nature of talk and gesturing itself. Both beat gestures expressing emphasis and reduced forms of presentation gestures can facilitate the interpreters’ speaking by prompting the presentation and emphasis of ideas. Though focused on their own process of speech production, simultaneous interpreters may embody elements of the lecturer of the source text engaging with the audience, blended with their own dialogic speaking behaviors, aspects of which we may see in their gesturing.

作者简介

Alan Cienki

Vrije Universiteit Amsterdam

编辑信件的主要联系方式.
Email: a.cienki@vu.nl
ORCID iD: 0000-0003-2951-9722

has a PhD in Slavic linguistics and is Professor of Language Use & Cognition and English Linguistics in the Department of Language, Literature and Communication at the Vrije Universiteit Amsterdam, Netherlands. His research interests include cognitive linguistics, semantics, gesture studies, metaphor studies and political discourse analysis.

Amsterdam, Netherlands

参考

  1. Andries, Fien, Katharina Meissl, Clarissa de Vries, Kurt Feyaerts, Bert Oben, Paul Sambre, Myriam Vermeerbergen & Geert Brône. 2023. Multimodal stance-taking in interaction-A systematic literature review. Frontiers in Communication 8. 1187977. https://doi.org/10.3389/fcomm.2023.1187977
  2. Bakhtin, Mikhail, Michael Holquist & Caryl Emerson. 1981. The Dialogic Imagination: Four Essays by M. M. Bakhtin. Austin, TX: University of Texas Press.
  3. Bavelas, Janet B., Nicole Chovil, Douglas A. Lawrie & Allan Wade. 1992. Interactive gestures. Discourse Processes 15. 469-489. https://doi.org/10.1080/01638539209544823
  4. Boutet, Dominique, Aliyah Morgenstern & Alan Cienki. 2016. Grammatical aspect and gesture in French: A kinesiological approach. Russian Journal of Linguistics 20 (3). 132-151.
  5. Bressem, Jana & Cornelia Müller. 2014. The family of Away gestures: Negation, refusal, and negative assessment. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva Ladewig, David McNeill & Jana Bressem (eds.), Body - language - communication: An international handbook on multimodality in human interaction, 1592-1604. Berlin: De Gruyter Mouton.
  6. Brookes, Heather & Olivier Le Guen. 2019. Gesture studies and anthropological perspectives. Gesture 18 (2-3). 119-141. https://doi.org/10.1075/gest.00040.bro
  7. Cienki, Alan. 2021. From the finger lift to the palm-up open hand when presenting a point: A methodological exploration of forms and functions. Languages and Modalities 1. 17-30. https://doi.org/10.3897/lamo.1.68914
  8. Cienki, Alan & Gianluca Giansante. 2014. Conversational framing in televised political discourse: A comparison from the 2008 elections in the United States and Italy. Journal of Language and Politics 13 (2). 255-288. https://doi.org/10.1075/jlp.13.2.04cie
  9. Cienki, Alan & Olga. K Iriskhanova. 2020. Patterns of multimodal behavior under cognitive load: An analysis of simultaneous interpretation from L2 to L1. Voprosy Kognitivnoy Lingvistiki 1. 5-11. https://doi.org/10.20916/1812-3228-2020-1-5-11
  10. Clark, Herbert H. 2003. Pointing and placing. In Sotaro Kita (ed.), Pointing: Where language, culture, and cognition meet, 243-268. Mahwah, NJ: Lawrence Erlbaum Associates.
  11. Condon, William S. & W. D. Ogston. 1966. Soundfilm analysis of normal and pathological behavior patterns. Journal of Nervous and Mental Disease 143 (4). 338-347.
  12. Debras, Camille. 2013. L’Expression Multimodale du Positionnement Interactionnel (Multimodal Stance-taking). Paris: Université Sorbonne Nouvelle - Paris 3.
  13. Ekman, Paul & Wallace V. Friesen. 1969. The repertoire of nonverbal behavior: Cateogries, origins, usage, and coding. Semiotica 1 (1). 49-98.
  14. Freedman, Norbert. 1972. The analysis of movement behavior during the clinical interview. In Aron Wolfe Siegman & Benjamin Pope (eds.), Studies in dyadic communication, 153-175. New York, NY: Pergamon Press.
  15. Galhano-Rodrigues, Isabel & Elena Zagar Galvão. 2010. The importance of listening with one’s eyes: A case study of multimodality in simultaneous interpreting. In Jorge Díaz-Cintas, Anna Matamala & Josélia Neves (eds.), New insights into audiovisual translation and media accessibility, 241-253. Amsterdam: Rodopi.
  16. Gibbon, Dafydd. 2005. Prerequisites for a multimodal semantics of gesture and prosody. Proceedings of the International Workshop on Computational Semantics 6. 2-15.
  17. Goffman, Erving. 1981. Forms of Talk. Philadelphia, PA: University of Pennsylvania Press.
  18. Goodwin, Charles & Marjorie H. Goodwin. 2004. Participation. In Alessandro Duranti (ed.), A companion to linguistic anthropology, 222-243. Oxford: Basil Blackwell.
  19. Grishina, Elena A. 2017. Russkaya zhestikulyatsiya s lingvisticheskoi tochki zreniya: korpusnye issledovanya (Russian gesticulation from a linguistic point of view: Corpus studies). Moscow: Languages of Slavic Culture. (In Russ.).
  20. Iriskhanova, Olga K., Andrei A. Petrov, Alina I. Makoveeva & Anna V. Leonteva. 2019. Kognitivnaya nagruzka v usloviyakh sinkhronnogo perevoda: opyt polimodal’nogo analiza (Cognitive load in the context of simultaneous interpreting: An experiment in multimodal analysis). Kognitivnye issledovaniya yazyka 38. 100-115. (In Russ.).
  21. Iverson, Jana M. & Susan Goldin-Meadow. 1998. Why people gesture when they speak. Nature 396. 228.
  22. Iverson, Jana M. & Esther Thelen. 1999. Hand, mouth and brain. The dynamic emergence of speech and gesture. Journal of Consciousness Studies 6 (11-12). 19-40.
  23. Kendon, Adam. 1972. Some relations between body motion and speech: An analysis of an example. In Aron Wolfe Siegman & Benjamin Pope (eds.), Studies in dyadic communication, 177-210. New York, NY: Pergamon Press.
  24. Kendon, Adam. 1973. The role of visible behaviour in the organization of social interaction. In Mario von Cranach & Ian Vine (eds.), Social communication and movement: Studies in interaction and expression in man and chimpanzee, 29-74. New York, NY: Academic Press.
  25. Kendon, Adam. 1980. Gesticulation and speech: Two aspects of the process of utterance. In Mary R. Key (ed.), The relation of verbal and nonverbal communication, 207-227. The Hague: Mouton
  26. Kendon, Adam. 2004. Gesture: Visible Action as Utterance. Cambridge: Cambridge University Press.
  27. Kibrik, Andrei A. & Olga V. Fedorova (eds.) 2020. Annotating Multichannel Discourse: A Guide Book. Moscow: Institute of Linguistics RAS.
  28. Kita, Sotaro. 2000. How representational gestures help speaking. In David McNeill (ed.), Language and gesture, 162-185. Cambridge: Cambridge University Press.
  29. Kita, Sotaro & Aslı Özyürek. 2003. What does cross-linguistic variation in semantic coordination of speech and gesture reveal: Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language 48. 16-32.
  30. Ladewig, Silva H. 2014. Recurrent gestures. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva Ladewig, David McNeill & Jana Bressem (eds.), Body - language - communication: An international handbook on multimodality in human interaction, 1558-1574. Berlin: De Gruyter Mouton.
  31. Lausberg, Hedda. 2013. Understanding Body Movement. A Guide to Empirical Research on Nonverbal Behaviour - with an Introduction to the NEUROGES Coding System. Frankfurt am Main: Peter Lang.
  32. Lausberg, Hedda & Han Sloetjes. 2016. The revised NEUROGES-ELAN system: An objective and reliable interdisciplinary analysis tool for nonverbal behavior and gesture. Behavior Research Methods 48. 973-993. https://doi.org/10.3758/s13428-015-0622-z
  33. Leonteva, Anna V., Alan Cienki & Olga V. Agafonova. 2023. Metaphoric gestures in simultaneous interpreting. Russian Journal of Linguistics 27 (3). 820-842. https://doi.org/10.22363/2687-0088-36189
  34. Litvinenko, Alla O., Andrei A. Kibrik, Olga V. Fedorova & Yuliya V. Nikolaeva. 2018. Annotating hand movements in multichannel discourse: Gestures, adaptors and manual postures. The Russian Journal of Cognitive Science 5 (2). 4-17.
  35. Lucero, Ché, Holly Zaharchuk & Daniel Casasanto. 2014. Beat gestures facilitate speech production. Proceedings of the Annual Meeting of the Cognitive Science Society 36. 898-903.
  36. McNeill, David. 1992. Hand and Mind: What Gestures Reveal about Thought. Chicago, IL: Chicago University Press.
  37. McNeill, David & Susan D. Duncan. 2000. Growth points in thinking for speaking. In David McNeill (ed.), Language and gesture, 141-161. Cambridge: Cambridge University Press.
  38. McNeill, David, Justine Cassell & Elena T. Levy. 1993. Abstract deixis. Semiotica 95 (1/2). 5-19. https://doi.org/10.1515/semi.1993.95.1-2.5
  39. Mondada, Lorenza. 2013. Multimodal interaction. In Cornelia Müller, Alan Cienki, Ellen Fricke & David McNeill (eds.), Body - language - communication: An international handbook on multimodality in human interaction, 577-589. Berlin: De Gruyter Mouton.
  40. Morris, Desmond. 2002. Peoplewatching. London: Vintage.
  41. Müller, Cornelia. 1998. Redebegleitende Gesten. Kulturgeschichte - Theorie - Sprachvergleich. Berlin: Berlin Verlag A. Spitz.
  42. Müller, Cornelia. 2004. Forms and uses of the Palm Up Open Hand: A case of a gesture family? In Cornelia Müller & Roland Posner (eds.), The semantics and pragmatics of everyday gestures, 233-256. Berlin: Weidler.
  43. Müller, Cornelia. 2014. Gestural modes of representation as techniques of depiction. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva Ladewig, David McNeill & Jana Bressem (eds.), Body - language - communication: An international handbook on multimodality in human interaction, 1687-1702. Berlin: De Gruyter Mouton.
  44. Payrató, Lluís & Sedinha Teßendorf. 2014. Pragmatic gestures. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva Ladewig, David McNeill & Jana Bressem (eds.), Body - language - communication: An international handbook on multimodality in human interaction, 1531-1539. Berlin: De Gruyter Mouton.
  45. Ponton, Douglas M. 2016. Movements and meanings: Towards an integrated approach to political discourse analysis. Russian Journal of Linguistics 20 (4). 122-139. https://doi.org/10.22363/2687-0088-15152
  46. Pouw, Wim, Shannon Proksch, Linda Drijvers, Marco Gamba, Judith Holler, Christoher Kello, Rebecca S. Schaefer & Geraint A. Wiggins. 2021 Multilevel rhythms in multimodal communication. Philosophical Transactions of the Royal Society B 376: 20200334. https://doi.org/10.1098/rstb.2020.0334
  47. Rauscher, Frances H., Robert M. Krauss & Yihsiu Chen. 1996. Gesture, speech, and lexical access: The role of lexical movements in speech production. Psychological Science 7 (4). 226-231
  48. Slobin, Dan I. 1987. Thinking for speaking. In Jon Aske, Natasha Beery, Laura Michaelis & Hana Filip (eds.), Proceedings of the 13th Annual Meeting of the Berkeley Linguistics Society, 435-445. Berkeley, CA: Berkeley Linguistics Society.
  49. Slobin, Dan I. 1996. From ‘thought and language’ to ‘thinking for speaking.’ In John Gumperz & Stephen C. Levinson (eds.), Rethinking linguistic relativity, 70-96. Cambridge: Cambridge University Press.
  50. Stachowiak-Szymczak, Katarzyna. 2019. Eye Movements and Gestures in Simultaneous and Consecutive Interpreting. Cham: Springer.
  51. Streeck, Jürgen. 2009. Gesturecraft: The Manu-facture of Meaning. Amsterdam: John Benjamins.
  52. Vranjes, Jelena & Geert Brône. 2021. Interpreters as laminated speakers: Gaze and gesture as interpersonal deixis in consecutive dialogue interpreting. Journal of Pragmatics 181. 83-99. https://doi.org/10.1016/j.pragma.2021.05.008
  53. Way, Lyndon C. 2021. Trump, memes and the Alt-right: Emotive and affective criticism and praise. Russian Journal of Linguistics 25 (3). 789-809. https://doi.org/10.22363/2687-0088-2021-25-3-789-809
  54. Wittgenstein, Ludwig. 1953. Philosophical Investigations. Oxford: Basil Blackwell.
  55. Zagar Galvão, Elena. 2015. Gesture in Simultaneous Interpreting from English into European Portuguese: An Exploratory Study. Porto: University of Porto, Portugal.
  56. Zagar Galvão, Elena. 2020. Gesture functions and gestural style in simultaneous interpreting. In Heidi Salaets & Geert Brône (eds.), Linking up with video: Perspectives on interpreting practice and research, 151-179. Amsterdam: John Benjamins Publishing Company.

版权所有 © Cienki A., 2024

Creative Commons License
此作品已接受知识共享署名-非商业性使用 4.0国际许可协议的许可。

##common.cookie##