Condensing Meaning

Imagic Aggregations in Secondary School Science

Authors

  • J. R. Martin University of Sydney
  • David Rose University of Sydney

DOI:

https://doi.org/10.1558/lhs.25767

Keywords:

Multimodality, infographics, Systemic Function Linguistics, science education, genre pedagogy, mass, presence

Abstract

In this chapter we address the challenge of interpreting and teaching complex infographics of the kind read and viewed in secondary school science in Australia. Inspired by the work of Bateman and his colleagues we adopt a complementary bottom-up and top-down perspective – analysing infographics bottom-up in terms of general gestalt grouping principles (for both micro- and macro-groups) and interpreting images top-down with respect to abductions based on modelling of the relevant field (as activity, item, and property), in Systemic Functional Linguistic theory (SFL). We then compare two infographics in detail, considering how mitosis is intermodally construed as activity and composition in verbiage and image. The key finding arising from this analysis is that in spite of the complexity of the infographics, considerable information has to be abduced, drawing on additional knowledge of the field – information that the co-text in the textbooks accompanying these infographics may not make explicit. This highlights the importance of multimodal literacy pedagogy as a crucial part of science education. We show how such a pedagogy can address the complexity of reading infographics in conjunction with verbal co-text. In this kind of carefully scaffolded methodology, the synoptic view of complex knowledge aggregation provided by infographics can play a significant role in the dynamics of knowledge building.

Author Biographies

  • J. R. Martin, University of Sydney

    J. R. Martin is Professor of Linguistics at the University of Sydney. His research interests include systemic theory, functional grammar, discourse semantics, register, genre, multimodality and positive discourse analysis (PDA), focusing on English, Tagalog and Korean – with special reference to the transdisciplinary fields of clinical linguistics, educational linguistics, forensic linguistics and social semiotics.

    Recent publications include a book on paralanguage Modelling Paralanguage using Systemic Functional Semiotics (Bloomsbury 2022) with Thu Ngo, Brad Smith, Clare Painter, Michele Zappavigna and Susan Hood; a functional grammar of Korean (Cambridge 2023) with Mira Kim, Gi-Hyun Shin and Gyung Hee Choi; a book on SFL language description, focusing on English, Spanish and Chinese (Cambridge 2023) with Beatriz Quiroz and Pin Wang; and a book on infographics (Routledge 2024) with Len Unsworth. A collection of papers on history discourse, edited with Jing Hao is in press with Cambridge; and a book on the discourse analysis of Filipino, with Prixie Cruz, will soon go to press. Four special issues of Word focusing on nominal groups have appeared over 2021 and 2022 (edited with Yaegan Doran and Dongbing Zhang).

  • David Rose, University of Sydney

    David Rose is is an Honorary Associate of the University of Sydney and Director of Reading to Learn, an international literacy program that trains teachers across school and university sectors (www.readingtolearn.com.au). His research interests include literacy teaching practices, teacher professional learning, analysis and design of classroom discourse, language typology and social semiotic theory. His books include The Western Desert Code: An Australian Cryptogrammar (Pacific Linguistics, 2001), Working with Discourse (Continuum, 2007), Genre Relations (Equinox, 2008) and Learning to Write, Reading to Learn: Genre, Knowledge and Pedagogy in the Sydney School (Equinox, 2012) (with J. R. Martin) and Reading to Learn, Reading the World (forthcoming, with C. Painter & R. Whittaker).

References

Bateman, J. (2008) Multimodality and Genre: A Foundation for the Systematic Analysis of Multimodal Documents. London: Palgrave Macmillan.

Bateman, J., Wildfeuer, J. and Hiippala, T. (2017) Multimodality: Foundations, Research and Analysis – A Problem Oriented Introduction. Berlin: De Gruyter Mouton.

Bernstein, B. (2000) Pedagogy, Symbolic Control and Identity: Theory, Research, Critique. Oxford: Rowman and Littlefield.

Callow, J. (ed.) (1999) Image Matters: Visual Texts in the Classroom. Sydney: Primary English Teaching Association.

Christie, F. and Martin, J. R. (eds.) (2007) Language, Knowledge and Pedagogy: Functional Linguistic and Sociological Perspectives. London: Continuum.

Christie, F. and Maton, K. (eds.) (2011) Disciplinarity: Functional Linguistic and Sociological Perspectives. London: Continuum.

Danielsson, K. and Selander, S. (2016) Reading multimodal texts for learning: A model for cultivating multimodal literacy. Designs for Learning 8(1): 25–36. https://doi.org/10.16993/dfl.72

Doran, Y. (2017) The Discourse of Physics: Building Knowledge through Language, Mathematics and Image. London: Routledge.

Doran, Y. J. and Martin, J. R. (2021) Field relations: Understanding scientific explanations. In K. Maton, J. R. Martin and Y. J. Doran (eds.) Studying Science: Knowledge, Language, Pedagogy 105–133. London: Routledge.

Edelman, G. (1992) Bright Air, Brilliant Fire: On the Matter of the Mind. New York: Basic Books.

Gebre, E. H. and Polman, J. L. (2016) Developing young adults’ representational competence through infographic-based science news reporting. International Journal of Science Education 38(18): 2667–2687. https://doi.org/10.1080/09500693.2016.1258129

Greenwood, T. and Allen, R. (2004) Year 12 Biology. Hamilton, N.Z.: Biozone.

Halliday, M. A. K. (1998) Things and relations: Regrammaticising experience as technical knowledge. In J. R. Martin and R. Veel (eds.) Reading Science: Critical and Functional Perspectives on Discourses of Science 185–235. London: Routledge.

Halliday, M. A. K. and Martin, J. R. (1993) Writing Science: Literacy and Discursive Power. London: Taylor & Francis.

Hiippala, T. (2016) The Structure of Multimodal Documents: An Empirical Approach. London: Routledge.

Hiippala, T. (2020) A multimodal perspective on data visualisation. In M. Engebretsen and H. Kennedy (eds.) Data Visualization in Society 277–294. Amsterdam: Amsterdam University Press.

Hiippala, T., Haverinen, J., Kalliokoski, T., Logacheva, E., Tuomainen, A. and Bateman, J. A. (2020) AI2D-RST: A multimodal corpus of school textbook diagrams. Language Resources and Evaluation 55: 661–688. https://doi.org/10.1007/s10579-020-09517-1

Kress, G. and van Leeuwen, T. (1990) Reading Images. Geelong: Deakin University Press.

Kress, G. and van Leeuwen, T. (1988/89) A Grammar of Diagrammes, Maps and Charts. Sydney: Unpublished manuscript.

Kress, G. and van Leeuwen, T. (1996) Reading Images: The Grammar of Visual Design (2nd edition). Geelong: Deakin University Press.

Kress, G. and van Leeuwen, T. (2021) Reading Images: The Grammar of Visual Design. Geelong: Deakin University Press.

Lima, M. (2011) Visual Complexity: Mapping Patterns of Information. New York: Princeton Architectural Press.

Lima, M. (2014) The Book of Trees: Visualizing Branches of Knowledge. New York: Princeton Architectural Press.

Lima, M. (2017) The Book of Circles: Visualizing Spheres of Knowledge. New York: Princeton Architectural Press.

Martin, J. R. (1992) English Text: System and Structure. Amsterdam: Benjamins.

Martin, J. R. (2006) Metadiscourse: Designing interaction in genre-based literacy programs, in R. Whittaker, M. O’Donnell and A. McCabe (eds.) Language and Literacy: Functional Approaches 95–122. London: Continuum.

Martin, J. R. (2014) Teaching/learning: The yin and yang of language development from home through school. Linguistics and the Human Sciences 10(1): 49–68. https://doi.org/10.1558/lhs.v10i1.27276

Martin, J. R. (2017) Revisiting field: Specialized knowledge in secondary school science and humanities discourse. Onomázein (NE II): 111–148. https://doi.org/10.7764/onomazein.ne2.05

Martin, J. R. and Maton, K. (eds.) (2013) Special issue on cumulative knowledge-building in secondary schooling. Linguistics and Education 24(1): 1–3. https://doi.org/10.1016/j.linged.2012.11.003

Martin, J. R., Maton, K. and Doran, Y. J. (eds.) (2020) Accessing Academic Discourse: Systemic Functional Linguistics and Legitimation Code Theory. London: Routledge.

Martin, J. R., Maton, K., Quiroz, B. and Vidal, M. (eds.) (2017) Special issue on systemic functional linguistics and legitimation code theory on education and knowledge. Onomázein (NE II).

Martin, J. R. and Matruglio, E. (2013) Revisiting mode: Context in/dependency in Ancient History classroom discourse. In H. Guowen, Z. Delu and Y. Xinzhang (eds.) Studies in Functional Linguistics and Discourse Analysis 72–95. V. Beijing: Higher Education Press.

Martin, J. R. and Unsworth, L. (2024) Reading Images for Knowledge Building: Analyzing Infographics in School Science. London: Routledge.

Maton, K., Martin, J. R. and Doran, Y. J. (eds.) (2021) Teaching Science: Language, Knowledge and Pedagogy. London: Routledge.

Matthiessen, C. M. I. M. (2007) The multimodal page. In T. Royce and W. Bowcher (eds.) New Directions in the Analysis of Multimodal Discourse 1–62. Mahwah, NJ: Lawrence Erlbaum Associates.

Matthiessen, C. M. I. M. (2009) Multisemiosis and context-based register typology. In E. Ventola and M. Guijarro (eds.) The World Told and the World Shown: Multisemiotic Issues 11–38. London: Palgrave Macmillan.

NESA (2018) Learning through Reading and Writing. Sydney: NSW Education & Standards Authority.

Nuthall, G. (1999) The way students learn: Acquiring knowledge from an integrated science and social studies unit. The Elementary School Journal 99(4): 303–341. https://doi.org/10.1086/461928

Painter, C., Martin, J. R. and Unsworth, L. (2013) Reading Visual Narratives: Image Analysis of Children’s Picture Books. London: Equinox.

Polman, J. L. and Gebre, E. H. (2015) Towards critical appraisal of infographics as scientific inscriptions. Journal of Research in Science Teaching 52(6): 868–893. https://doi.org/10.1002/tea.21225

Rose, D. (2014) Analysing pedagogic discourse: An approach from genre and register. Functional Linguistics 1(11): 1–32. https://doi.org/10.1186/s40554-014-0011-4

Rose, D. (2018) Pedagogic register analysis: Mapping choices in teaching and learning. Functional Linguistics 5(3): 1–33. https://doi.org/10.1186/s40554-018-0053-0

Rose, D. (2020a) Building a pedagogic metalanguage I: Curriculum genres. In K. Maton, J. R. Martin and Y. J. Doran (eds.) Studying Science: Knowledge, Language and Pedagogy. London: Taylor & Francis.

Rose, D. (2020b) Building a pedagogic metalanguage II: Knowledge genres. In K. Maton, J. R. Martin and Y. J. Doran (eds.) Studying Science: Knowledge, Language and Pedagogy. London: Taylor & Francis.

Rose, D. (forthcoming) Viewing to learn: Intermodal pedagogy in science and mathematics lessons. https://www.researchgate.net/project/Register-Analysis

Rose, D. and Martin, J. R. (2012) Learning to Write, Reading to Learn: Genre, Knowledge and Pedagogy across the Curriculum. London: Equinox.

Unsworth, L. (2001) Teaching Multiliteracies across the Curriculum: Changing Contexts of Text and Image in Classroom Practice. Buckingham: Open University Press.

Unsworth, L. (2020) Intermodal relations, mass and presence in school science explanation genres. In M. Zappavigna and S. Dreyfus (eds.) Discourses of Hope and Reconciliation: J. R. Martin’s Contributions to Systemic Functional Linguistics 131–152. London: Bloomsbury. https://doi.org/10.5040/9781350116092.ch-007

Unsworth, L. (2021) High school science infographics: Multimodal meaning complexes in compositie image-language ensembles. Pensamiento Educativo (Revista de Investigación Educational Latinoamericana) 58(2): 1–18.

van Leeuwen, T. (2019) The power of diagrams. In M. Hollerer, T. van Leeuwen, D. Jancsary, R. Meyer and T. Andersen (eds.) Visual and Multimodal Research in Organization and Management Studies 104–127. London: Routledge.

Published

2023-07-12

Issue

Section

Articles

How to Cite

Martin, J. R., & Rose, D. (2023). Condensing Meaning: Imagic Aggregations in Secondary School Science. Linguistics and the Human Sciences, 15(3), 369-410. https://doi.org/10.1558/lhs.25767