Event Construal through Spatial Relations in Science Documentaries: Language and Image

Cover Page

Cite item

Full Text

Abstract

Information construal in cinematic discourse employs different semiotic modes; meanwhile, their variance is yet to be explored. The study is aimed at exploring spatial event construal in the language and image modes of science documentaries. We hypothesise that three major event types - environmental events, human-environment interaction events and interpersonal interaction events - employ different spatial construal patterns in language and image, which results from mode allowances and constraints. To verify the hypothesis, we use spatial image schema topology while identifying the image schemas in the lexical and grammatical structure of language and in the layout of the objects, the manner of their movement and interaction in image. The research data include 353 events in single clauses and in shots extracted from two English-language science documentaries. The results show the prevalence of the source-path-goal schema in both semiotic modes, which consequently prevents it from differentiating between event types both within and across the modes. The schemas scale, straight, and near-far display a tendency to differentiate between events; however, no significant distinctions were observed, presumably due to the ontological nature of events as well as the semiotic characteristics of the modes. Additionally, the study reveals that spatial construal of events can follow parallel alignment, commonly with the schemas source-path-goal, contact, near-far, and complementary alignment with the schemas centre-periphery, scale, up-down, front-back, straight, left-right, which reflects a complex nature of inter-semiotic relations in cinematic discourse. The findings of the article contribute to the understanding of event construal in the multimodal discourse of science documentaries.

Full Text

.
×

About the authors

Nare A. Ovagimian

Moscow State Linguistic University

Email: n.ovagimian@yandex.ru
ORCID iD: 0009-0004-1981-0051
SPIN-code: 2035-7040

Senior Lecturer at the Department of English, Faculty of Translation and Interpreting

38, Ostozhenka str., Moscow, Russian Federation, 119034

Maria I. Kiose

Moscow State Linguistic University; Institute of Linguistics RAS

Author for correspondence.
Email: maria_kiose@mail.ru
ORCID iD: 0000-0001-7215-0604
SPIN-code: 4419-0090
Scopus Author ID: 56642747500
ResearcherId: AAB-79892019

Leading Researcher; Laboratory for multichannel communication, Institute of Linguistics, RAS

38, Ostozhenka str., Moscow, Russian Federation, 119034; 1, B. Kislovsky ln., Moscow, Russian Federation, 125009

References

  1. Lemke, J. (1998). Multiplying meaning: Visual and verbal semiotics in scientific text. In: Martin J.R., Veel R. (Eds.), Reading science: Critical and functional perspectives on discourses of science. London: Routledge. pp. 87-114.
  2. Bezemer, J. & Kress, G. (2008). Writing in multimodal texts: A social semiotic account of designs for learning. Written Communication, 25(2), 166-195. https://doi.org/10.1177/0741088307313177
  3. Liu, Y. & O’Halloran, K.L. (2009). Intersemiotic texture: Analyzing cohesive devices between language and images. Social Semiotics, 19(4), 367-388. https://doi.org/10.1080/10350330903361059
  4. Forceville, C. & Jeulink, M. (2011). The flesh and blood of embodied understanding: The source-path-goal schema in animation film. Pragmatics & Cognition, 19(1), 37-59. https://doi.org/10.1075/pc.19.1.02for
  5. Forceville, C.J. (2017). From image schema to metaphor in discourse: The force schemas in animation films. In: Hampe B. (Ed.) Metaphor: Embodied Cognition and Discourse. Cambridge: Cambridge University Press. pp. 239-256. https://doi.org/10.1017/9781108182324.014
  6. Coëgnaerts, M. & Kravanja, P. (2012). The visual and multimodal representation of time in film, or: How time is metaphorically shaped in space. Image and narrative online magazine of the visual narrative, 13(3), 85-100.
  7. Lou, A. (2017). Viewpoint and image schemas in multimodal political discourse. Journal of Pragmatics, 122, 77-90. https://doi.org/10.1016/j.pragma.2017.07.002
  8. Khan, S. & Siddiqui, B. (2023). Space Image Schema in multimodal representation of Afghan migrants living in Pakistan: a cognitive linguistics approach to multimodal discourse analysis. Journal of Positive School Psychology, 7(4), 1920-1948.
  9. Kiose, M.I. (2023). Image schemas as an instrument of multimodal research. Germanistika-2022: nove et nova. Materials of the V International Scientific Conference, Moscow, 07-09 December 2022, A.A. Klinovskaya (Ed.) [et al.]. Moscow: Moscow State Linguistic University. pp. 136-140. (In Russ.).
  10. Deane, P.D. (2005). Multimodal spatial representation: On the semantic unity of over. From perception to meaning: Image schemas in cognitive linguistics, 29, 235-282. https://doi.org/10.1515/9783110197532.3.235
  11. Unsworth, L. & Cléirigh, C. (2014). Multimodality and reading: The construction of meaning through image-text interaction. London: Routledge.
  12. Gibbs, R. & Colston, H. (1995). The cognitive psychological reality of image schemas and their transformations. Cognitive Linguistics, 6(4), 347-378. https://doi.org/10.1515/cogl.1995.6.4.347
  13. Mandler, J.M. & Cánovas, C.P. (2014). On defining image schemas. Language and Cognition, 6(4), 510-532. https://doi.org/10.1017/langcog.2014.14
  14. Royce, T. (1998). Synergy on the page: Exploring intersemiotic complementarity in pagebased multimodal text. JASFL Occasional papers, 1(1), 25-49.
  15. Johnson, M. (1987). The body in the mind: The bodily basis of meaning, imagination, and reason. Chicago: University of Chicago Press. https://doi.org/10.7208/chicago/9780226177847.001.0001
  16. Sweetser, E. (1990). From etymology to pragmatics: metaphorical and cultural aspects of semantic structure. New York: Cambridge University Press. https://doi.org/10.1017/cbo9780511620904
  17. Ioannou, G. (2020). Image schemas as prototypes in the diachronic evolution of kámnō and eutheiázō in Greek: A behavioural-profile analysis. Lingua, 245(4), 102938. https://doi.org/10.1016/j.lingua.2020.102938
  18. Langacker, R. (1987). Foundations of cognitive grammar: Volume I: Theoretical prerequisites. Stanford: Stanford University Press.
  19. Langacker, R. (1991). Concept, Image, and Symbol: The Cognitive Basis of Grammar. Berlin; New York: Mouton de Gruyter.
  20. Brugman, C. & Lakoff, G. (1988). Cognitive Topology and Lexical Networks. Lexical Ambiguity Resolution, 477-508. https://doi.org/10.1016/b978-0-08-051013-2.50022-7
  21. Vandeloise, C. (1991). Spatial prepositions: A case study from French. Chicago: University of Chicago Press.
  22. Talmy, L. (2005). The fundamental system of spatial schemas in language. From perception to meaning: Image schemas in cognitive linguistics, 29, 199-234. https://doi. org/10.1515/9783110197532.3.199
  23. Jackendoff, R. (1996). The architecture of the linguistic-spatial interface. In: P. Bloom, M.A. Peterson, L. Nadel & M.F. Garrett (Eds.), Language and Space. Mass.: The MIT Press. pp. 1-30. https://doi.org/10.7551/mitpress/4107.003.0003
  24. Levinson, S.C. (1996). Frames of References and Molyneux’s Question: Crosslinguistic Evidence. In: P. Bloom, M.A. Peterson, L. Nadel & M.F. Garrett (Eds.), Language and Space. Mass.: The MIT Press. pp. 109-170. https://doi.org/10.7551/mitpress/4107.003.0006
  25. Cienki, A. (1997). Some properties and groupings of image schemas. Lexical and syntactical constructions and the construction of meaning, 3-15. https://doi.org/10.1075/ cilt.150.04cie
  26. Talmy, L. (2000). Toward a cognitive semantics. Vol. II: Typology and process in concept structuring. Mass.: The MIT Press.
  27. Clausner, T.C. & Croft, W. (1999). Domains and image schemas. Cognitive Linguistics, 10(1), 1-31. https://doi.org/10.1515/cogl.1999.001
  28. Cienki, A. (1998). STRAIGHT: An image schema and its metaphorical extensions. Cognitive Linguistics, 9(2), 107-150. https://doi.org/10.1515/cogl.1998.9.2.107
  29. Evans, V. (2007). Glossary of cognitive linguistics. Edinburgh: Edinburgh University Press.
  30. Hurtienne, J. & Blessing, L. (2007). Design for Intuitive Use-Testing image schema theory for user interface design. In: Proceedings of ICED 2007, the 16th International Conference on Engineering Design, Paris, France, 28-31.07. 2007. Paris. pp. 829-830.
  31. Zykova, I.V. (Ed.). (2021). Linguistic creativity in different discourse types: Limitations and allowances. Moscow: R. Valent. Зыкова И.В. (ред.) Лингвокреативность в дискурсах разных типов: Пределы и возможности. М.: Р-Валент, 2021.
  32. Kiose, M.I. (2022). Event Construal in Text and Image. Gaze Behavior and Discourse Interpretations. RUDN Journal of Language Studies, Semiotics and Semantics, 13(2), 396-415. https://doi.org/10.22363/2313-2299-2022-13-2-396-415
  33. Maksimenko, O.I. & Podlegaeva, E.P. (2023). Animated videoverbal text: problems of translation and interpretation. Moscow: Nauka. (In Russ.).
  34. Halliday, M. & Matthiessen, C. (2004). An Introduction to Functional Grammar (3rd ed.). London: Routledge. https://doi.org/10.4324/9780203783771
  35. Martinec, R. & Salway, A. (2005). A system for image-text relations in new (and old) media. Visual communication, 4(3), 337-371. https://doi.org/10.1177/1470357205055928
  36. Kiose, M.I. (2021). Secrets of interpretation of text and image. Construal and oculographic experiment. Moscow: R.Valent. (In Russ.).
  37. Kiose, М.I. & Efremov, А.А. (2020). HETEROSTAT. Software for Comprehensive Parametrical Discourse Analysis. Registration Date: 21.09.2020. Registration Number: 2020661240. 2020.

Supplementary files

Supplementary Files
Action
1. Fig. 1. Fragment 1

Download (72KB)
Indexing metadata
2. Fig. 2. Distribution of Event Types among Image Schemas in Language

Download (63KB)
Indexing metadata
3. Fig. 3. Distribution of Event Types between Image Schemas in Image

Download (74KB)
Indexing metadata
4. Fig. 4. Fragment 2

Download (118KB)
Indexing metadata
5. Fig. 5. Fragment 3

Download (80KB)
Indexing metadata
6. Fig. 6. Co-occurrence of image schemas of spatial relations in language and image, %

Download (128KB)
Indexing metadata
7. Fig. 7. Fragment 4

Download (100KB)
Indexing metadata

Copyright (c) 2024 Ovagimian N.A., Kiose M.I.

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

This website uses cookies

You consent to our cookies if you continue to use our website.

About Cookies