Writing measures and outcomes in CLIL and EMI
A systematic review
DOI:
https://doi.org/10.1558/wap.17755Keywords:
CONTENT AND LANGUAGE INTEGRATED LEARNING, SECOND LANGUAGE WRITING, WRITING MEASURES, ENGLISH LEARNERS, SYSTEMATIC REVIEWAbstract
This study utilizes a systematic review approach to examine current research in content and language integrated learning (CLIL) and English-medium instruction (EMI). Studies were examined for their use of language-related and content-related writing measurement and outcomes. Findings on CLIL/EMI writing measurement shows that studies have utilized a variety of methods for measuring language, but measurement of the content dimension is limited. While some studies in the review combine multiple types of writing measures, CLIL writing research often does not simultaneously assess both the language and content dimensions of writing. For writing outcomes, the reviewed studies show CLIL/EMI generally equals or exceeds traditional language classrooms and that CLIL/EMI instruction leads toward growth in some but not all (i.e. accuracy), language-related metrics. However, regarding the content dimension, the findings are mixed and show CLIL/EMI writing generally does not communicate disciplinary content knowledge appropriately. It is recommended that future research gives more attention to measuring both the language and content dimensions of writing while also incorporating new methods for measuring discipline-specific content in writing. It is also recommended that instructors increase their language awareness and reconsider how disciplinary writing is taught in their CLIL/EMI classroom.
References
Ackerl, C. (2007) Lexico-grammar in the essays of CLIL and non-CLIL students: Error analysis of written production. Vienna English Working Papers 16(3): 6–11. Retrieved from https://anglistik.univie.ac.at/research/views/archive.
Adamson, J. and Coulson, D. (2015) Translanguaging in English academic writing preparation. International Journal of Pedagogies and Learning 10(1): 24–37. https://doi.org/10.1080/22040552.2015.1084674
Agustín Llach, M. P. and Jiménez Catalán, R. M. (2007) Lexical reiteration in EFL young learners’ essays: Does it relate to the type of instruction? International Journal of English Studies 7(2): 85–104. Retrieved from https://revistas.um.es/ijes/article/view/49001.
Agustín-Llach, M. P. (2016) Age and type of instruction (CLIC vs. traditional EFL) in lexical development. International Journal of English Studies 16(1): 75–96. https://doi.org/10.6018/ijes/2016/1/220691
Agustín-Llach, M. P. (2017) The effects of the CLIL approach in young foreign language learners’ lexical profiles. International Journal of Bilingual Education and Bilingualism 20(5): 557–73. https://doi.org/10.1080/13670050.2015.1103208
Airey, J. (2016) EAP, EMI, or CLIL. In K. Hyland and P. Shaw (eds), The Routledge Handbook of English for Academic Purposes, 71–83. Routledge.
Ball, P., Kelly, K., and Clegg, J. (2015) Putting CLIL into Practice. Oxford University Press.
Bennett, P. J. (2017) The Effects of Raising Learners’ Awareness of Metaphorical Vocabulary on Written Production in the Content-Based Classroom. Unpublished doctoral dissertation. Birmingham, England: University of Birmingham.
Brinton, D. M. and Snow, M. A. (2017) The evolving architecture of CBI. In M. A. Snow and D. M. Brinton (eds), The Content-Based Classroom, 2–20. Ann Arbor, Michigan: University of Michigan Press.
Celaya, M. L. (2008) ‘I study natus in English’: Lexical transfer in CLIL and regular learners. In R. Monroy and A. Sanchez (eds), 25 years of Applied Linguistics in Spain: Milestones and Challenges, 43–9. Murcia, Spain: Servicio de Publicaciones de la Universidad de Murcia.
Celestén Pérez, M. and Basse, R. (2015) Analysing Errors of CLIL and Non-CLIL Primary School Students in Their Written and Oral Productions: A Comparative Study. Paper presentation. Madrid, Spain: Spanish Association of Applied Linguistics (AESLA) 32nd International Conference. https://doi.org/10.1016/j.sbspro.2015.02.023
Cenoz, J., Genesee, F., and Gorter, D. (2013) Critical analysis of CLIL: Taking stock and looking forward. Applied Linguistics 35(3): 243–62. https://doi.org/10.1093/applin/amt011
Chansri, C. and Wasanasomsithi, P. (2016) Implementing CLIL in higher education in Thailand: The extent to which CLIL improves agricultural students’ writing ability, agricultural content and cultural knowledge. PASAA: Journal of Language Teaching and Learning in Thailand 51: 15–38. https://doi.org/10.14456/pasaa.2016.1
Coetzee-Lachmann, D. (2007) Assessment of Subject-Specific Task Performance of Bilingual Geography Learners: Analysing Aspects of Subject-Specific Written Discourse. Unpublished doctoral dissertation. Osnabrück, Germany: Osnabrück University.
Cortes, V. (2019) Considering the importance of L2 learners’ writing needs. Journal of Second Language Writing 46, 100679. https://doi.org/10.1016/j.jslw.2019.100679
Coyle, D., Hood, P., and Marsh, D. (2010) CLIL: Content and Language Integrated Learning. Cambridge, England: Cambridge University Press.
Dafouz, E., Camacho, M., and Urquia, E. (2014) ‘Surely they can‘t do as well‘: A comparison of business students‘ academic performance in English-medium and Spanish-as-first-language-medium programmes. Language and Education 18(3), 223–236. https://doi.org/10.1080/09500782.2013.808661
Dalton-Puffer, C. (2008) Outcomes and processes in content and language integrated learning (CLIL): Current research from Europe. In W. Delanoy and L. Volkmann (eds), Future Perspectives for English Language Teaching, 139–158. Carl Winter.
Del Mar Sanchez Perez, M. and Sagrario Salaberri Ramiro, M. (2015) Writing professional genres in a second language: Results from a Spanish university CLIL context. American Journal of Educational Research 3(5): 576–80. https://doi.org/10.12691/education-3-5-7
Gené-Gil, M., Juan-Garau, M., and Salazar-Noguera, J. (2015a) Development of EFL writing over three years in secondary education: CLIL and non-CLIL settings. Language Learning Journal: Journal of the Association for Language Learning 43(3): 286–303. https://doi.org/10.1080/09571736.2015.1053278
Gené-Gil, M., Juan-Garau, M. and Salazar-Noguera, J. (2015b) Writing development under CLIL provision. In M. Juan-Garau and J. Salazar-Noguera (eds), Content-Based Language Learning in Multilingual Educational Environments, 139–61. New York: Springer. https://doi.org/10.1007/978-3-319-11496-5_9
Goris, J. A., Denessen, E., and Verhoeven, L. (2019) Effects of content and language integrated learning in Europe: A systematic review of longitudinal experimental studies. European Educational Research Journal. Advance online publication: 1–24. https://doi.org/10.1177/1474904119872426
Graham, K. M., Choi, Y., Davoodi, A., Razmeh, S., and Dixon, L. Q. (2018) Language and content outcomes of content-based instruction: A systematic review. Latin American Journal of Content and Language Integrated Learning 11(1): 19–37. https://doi.org/10.5294/laclil.2018.11.1.2
Graham, K. M., and Eslami, Z. R. (2019) Attitudes toward EMI in East Asia and the Gulf: A systematic review. Language Problems and Language Planning 43(1): 8–31. https://doi.org/10.1075/lplp.00030.gra
Jacobs, H. L., Zinkgraf, S. A., Wormuth, D. R., Hartfield, V. F., and Hughey, J. B. (1981) Testing ESL Composition. Newbury, MA: Rowley.
Järvinen, H. M. (2010) Language as a meaning making resource in learning and teaching content: Analysing historical writing in content and language integrated learning. In C. Dalton-Puffer, T. Nikula and U. Smit (eds), Language Use and Language Learning in CLIL Classrooms, 145–68. Amsterdam, Netherlands: John Benjamins. https://doi.org/10.1075/aals.7.08jar
Jexenflicker, S. and Dalton-Puffer, C. (2010) The CLIL differential: Comparing the writing of CLIL and non-CLIL students in higher colleges of technology. In C. Dalton-Puffer, T. Nikula, and U. Smit (eds), Language Use and Language Learning in CLIL Classrooms, 169–89. Amsterdam, Netherlands: John Benjamins. https://doi.org/10.1075/aals.7.09jex
Kachru, B. B. (1985) Standards, codification and sociolinguistic realm: The English language in the outer circle. In R. Quick and H. G. Widdowson (eds), English in the World, 11–30. Cambridge, England: Cambridge University Press.
Kjellén Simes, M. (2008) Room for Improvement?: A Comparative Study of Swedish Learners’ Free Written Production in English in the Foreign Language Classroom and in Immersion Education. Unpublished doctoral dissertation. Karlstad, Sweden: Karlstad University.
Kong, S. (2010) Writing in late immersion biology and history classes in Hong Kong. Writing and Pedagogy 2(1): 13–38. https://doi.org/10.1558/wap.v2i1.13
Lahuerta, A. (2020) Analysis of accuracy in the writing of EFL students enrolled on CLIL and non-CLIL programmes: The impact of grade and gender. The Language Learning Journal 48(2): 1–12. https://doi.org/10.1080/09571736.2017.1303745
Lahuerta Martínez, A. C. (2017) Syntactic complexity in secondary-level English writing: Differences among writers enrolled on bilingual and non-bilingual programmes. Porta Linguarum 28: 67–80.
Larsen-Freeman, D. (2009) Adjusting expectations: The study of complexity, accuracy and fluency in second language acquisition. Applied Linguistics 30(4): 579–89. https://doi.org/10.1093/applin/amp043
Lightbown, P. M. (2014) Focus on Content-Based Language Teaching. Oxford, England: Oxford University Press.
Llinares, A. and Whittaker, R. (2007) Talking and writing in a foreign language in CLIL contexts: A linguistic analysis of secondary school learners of geography and history. Volumen Monografico: 83–91.
Llinares, A. and Whittaker, R. (2010) Writing and speaking in the history class: A comparative analysis of CLIL and first language contexts. In C. Dalton-Puffer, T. Nikula and U. Smit (eds), Language Use and Language Learning in CLIL Classrooms, 125–43. Amsterdam, Netherlands: John Benjamins. https://doi.org/10.1075/aals.7.14dal
Lo, Y. Y. (2019) Development of the beliefs and language awareness of content subject teachers in CLIL: Does professional development help? International Journal of Bilingual Education and Bilingualism 22(7): 818–832. https://doi.org/10.1080/13670050.2017.1318821
Macaro, E. (2018) English Medium Instruction. Oxford, England: Oxford University Press.
Macaro, E., Curle, S., Pun, J., An, J., and Dearden, J. (2018) A systematic review of English medium instruction in higher education. Language Teaching 51(1): 36–76. https://doi.org/10.1017/s0261444817000350
Manzano Vázquez, B. (2014) Lexical transfer in the written production of a CLIL group and a non-CLIL group. International Journal of English Studies 14(2): 57–76. https://doi.org/10.6018/j.166251
Matsuda, P. K. and Xu, F. (2019) DD Editors‘ introduction: The place of language in second language writing. Journal of Second Language Writing 46, 100674. https:/doi.org/10.1016/j.jslw.2019.100674
Miret Pallarols, M. (2009) CLIL Effects on Writing Performance and Overall Proficiency of Secondary School Students. Unpublished master’s thesis. Barcelona, Spain: University of Barcelona.
Naves, T. (2011) How promising are the results of integrating content and language for EFL writing and overall EFL proficiency? In Y. Ruiz de Zarobe, J. M. Sierra, and F. Gallardo del Puerto (eds), Content and Foreign Language Integrated Learning: Contributions to Multilingualism in European Contexts, 155–86. Bern, Switzerland: Peter Lang. https://doi.org/10.3726/978-3-0351-0171-3
Olsson, E. (2015) Progress in English academic vocabulary use in writing among CLIL and non-CLIL students in Sweden. Moderna Sprak 109(2): 51–74.
Olsson, E. and Sylvén, L. K. (2017) Validity in high- and low-stakes tests: A comparison of academic vocabulary and some lexical features in CLIL and non-CLIL students’ written texts. Oslo Studies in Language 9(3): 127–46. https://doi.org/10.17011/apples/urn.201512234129
Ouzzani, M., Hammady, H., Fedorowicz, Z., and Elmagarmid, A. (2016) Rayyan: A web and mobile app for systematic reviews. Systematic Reviews 5(1): 2–10. https://doi.org/10.1186/s13643-016-0384-4
Pessoa, S., Miller, R. T., and Kaufer, D. (2014) Students‘ challenges and development in the transition to academic writing at an English-medium university in Qatar. International Review of Applied Linguistics in Language Teaching 52(2): 127–56. https://doi.org/10.1515/iral-2014-0006
Polio, C. (2019) Keeping the language in second language writing classes. Journal of Second Language Writing, 46, 100675. https:/doi.org/10.1016/j.jslw.2019.100675
Roquet, H. and Pérez-Vidal, C. (2017) Do productive skills improve in content and language integrated learning contexts? The case of writing. Applied Linguistics 38(4): 489–511. https://doi.org/10.1093/applin/amv050
Ruiz de Zarobe, Y. (2010) Written production and CLIL: An empiricial study. In C. Dalton-Puffer, T. Nikula and U. Smit (eds), Language Use and Language Learning in CLIL Classrooms, 191–209. Amsterdam, Netherlands: John Benjamins. https://doi.org/10.1075/aals.7.10rui
Sagrario Salaberri Ramiro, M. and Del Mar Sánchez Pérez, M. (2015) Analyzing writing in English-medium instruction at university. Linguarum Arena 6: 45–58.
Tai, H.-Y. (2015) Writing development in syntactic complexity, accuracy and fluency in a content and language integrated learning class. International Journal of Language and Linguistics 2(3): 149–56. Retrieved from http://ijllnet.com/journal/index/2131.
Tedick, D. J. and Wesely, P. M. (2015) A review of research on content-based foreign/second language education in US K-12 contexts. Language, Culture and Curriculum 28(1): 25–40. https://doi.org/10.1080/07908318.2014.1000923
Vidal, K. and Jarvis, S. (2018) Effects of English-medium instruction on Spanish students’ proficiency and lexical diversity in English. Language Teaching Research. Advance online publication: 1–20. https://doi.org/10.1177/1362168818817945
Whittaker, R. and Llinares, A. (2009) CLIL in social science classrooms: Analysis of spoken and written productions. In Y. Ruiz de Zarobe and R. M. Jiménez Catalán (eds), Content and Language Integrated Learning: Evidence from Research in Europe, 215–34. Bristol, England: Multilingual Matters. https://doi.org/10.21832/9781847691675-015
Whittaker, R., Llinares, A., and McCabe, A. (2011) Written discourse development in CLIL at secondary school. Language Teaching Research 15(3): 343–62. https://doi.org/10.1177/1362168811401154
Xanthou, D.-C. (2017) The Effect of CLIL on the Writing and Vocabulary Skills of 3rd Graders in the 3rd Experimental Primary School of Thessaloniki. Unpublished master’s thesis. Thessaloniki, Greece: Aristotle University of Thessaloniki. https://doi.org/10.22540/jfsf-02-001
