On the Chief Modes of Multimodal Prose


  • Hu Zhuanglin Peking University




meaning, multimodality, prose, realization, regularity


There are mainly four forms of modes, that is, language, pictures, music and songs and video productions, among which language and picture modes can be further divided into hand operation and automatic operation. They can be combined in various ways, resulting in different modality combinations, but we still need to explore the regularities of these groupings, in particular the causes and functions which lead to these regularities. Therefore, the article discusses three chief points: (a) the meaning of a particular piece of multimodal prose to be realized by different modes; (b) these modes to be used singly or jointly; and (c) one or two modes playing the chief role, and the rest complementary roles under the circumstance when multiple modes were chosen. This endeavour may help with our creation and appreciation of multimodal prose.

Author Biography

Hu Zhuanglin, Peking University

Zhuanglin Hu was Chair, Dept. of English, PKU (1985–1993). Director, PKU Australia Studies Center (1996–2014), and is PKU emeritus professor (January 2005), Publications: Linguistics: A Course Book (chief editor, 1988; 4th edition, 2011); On Systemic-Functional Grammar (co-author, 1989), Cohesion and Cohearance of Discourse (1994), Contemporary Linguistic Theories and Application (1995), A Comprehensive Review of Functionalism (2000), Theoretical Stylistics (2000), Cognitive Metaphology (2004), A Survey of Systemic-Functional Linguistics (coauthor, 2005), Collection of Hu Zhuanglin’s Papers on English Education (2008), and Linguistic Theories and Schools (co-author, 2010).


Halliday, M. A. K. (1978) Language as Social Semiotic: The Social Interpretation of Language and Meaning. London: Edward Arnold.

Halliday, M. A. K. (1994) An Introduction to Functional Grammar (2nd edn). London: Edward Arnold.

Hu, Z. (2004a) Hypertextual discourse analysis. Shandong Foreign Language Teaching 5: 3–8.

Hu, Z. (2004b) Oration, literacy, and hypertext: On the changes of the relation between and perceptive modes. Computer-Assisted Foreign Language Education 6: 2–8.

Hu, Z. (2007) Multimodalization in sociolinguistic research. Language Teaching and Research 1: 1–10.

Hu, Z. (2010) The growth and development of multimodal prose. Computer-assisted Foreign Language Education 4: 3–9.

Hu, Z. and Dong, J. (2006) Multimodal construction of meaning: Discourse analysis of a PPT presentation contest. Computer-assisted Foreign Language Education 3: 3–12.

Iedema, R. (2003) Multimodality, resemiotizaion: Extending the analysis of discourse as multisemiotic process. Visual Communication 2 (1): 29–57. http://dx.doi.org/10.1177/1470357203002001751

Kress, G. and van Leeuwen, T. (1996) Reading Images: The Grammar of Visual Design. (1st edn) London and New York: Routledge.

Li, M. (2009) Translation of film captions of ‘The Bright Sunny Days’: Under multimodal conditions. Film Literature 7: 159–160.

Li, Z. (2003) Sociosemiotic analysis of multimodal discourse. Foreign Language Research 5: 1–8.

O’Halloran, K. L. (2008) Multimodal analysis and digital technology. In A. Baldry and E. Montagna (eds) Interdisciplinary Perspectives on Multimodality: Theory and Practice 1–26. Campobasso: Palladino.

O’Toole, M. (1994) The Language of Displayed Art. Rutherford: Fairleigh-Dickinson University Press.

de Saussure, F. (2001) Course in General Linguistics. Beijing: Foreign Language and Research Press.

Scallon, R. and Philip, L. (2004) Multiple Discourse Analysis as the Confluence of Discourse and Technology. Washington, DC.: Georgetown University Press.

Scollon, R. and Levine, P. (Eds) (2004) Discourse and Technology: Multimodal Discourse Analysis. Washington, DC: Georgetown University Press.

van Leuween, T. (2005) Introducing Social Semiotics. London: Routledge.

Wei, X. (2009) Multimodal analysis of cartoon discourse. Journal of Writers 3: 259–60.

Yang, X. (2009) Multimodal discourse analysis and systemic functional linguistics. Foreign Language Education 30 (4): 11–4.

Zhang, D. (2009) Exploring an integral theoretical framework for multimodal discourse analysis. Foreign Languages in China 1: 24–30.

Zhu, Y. (2007) The theoretical foundation and research method of multimodal discourse analysis. Journal of Foreign Languages 5: 82–86.



How to Cite

Zhuanglin, H. (2015). On the Chief Modes of Multimodal Prose. Linguistics and the Human Sciences, 10(3), 207–219. https://doi.org/10.1558/lhs.v10i3.29298