Language assessment frameworks as language policy
Is a multilingual approach possible?
DOI:
https://doi.org/10.1558/jmtp.20395Keywords:
language assessment, multilingual assessment, bilingualism, translanguaging, multilingual education, Steps to English Proficiency, STEP, teacher educationAbstract
Reviewing the development and implementation of the Steps to English Proficiency (STEP) language proficiency assessment framework in Ontario, Canada, this article calls attention to how language proficiency is operationalised in English language proficiency (ELP) standards in ways that may institutionalise hierarchies among home, school and community language practices. Use of these standards for classroom-based language assessment requires teachers to play a defining role, to observe, interpret and make judgements about students’ bi/multilingual language practice. However, STEP was developed and validated based on teacher perceptions of students’ language use, revealing the monolingual ideologies at work in Ontario education. The study concludes by discussing opportunities for teachers to identify, observe and document students’ multilingual practice through teacher-inquiry to align curriculum and assessment policy and practice with the sociolinguistic reality of Ontario’s multilingual classrooms and communities.
References
Baker, B. (2016). Language assessment literacy as professional competence: The case of Canadian admissions decision makers. Canadian Journal of Applied Linguistics, 19.1, 63–83.
Black, P. and Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5.1, 7–74.
https://doi.org/10.1080/0969595980050102
Brindley, G. (2001). Outcomes-based assessment in practice: Some examples and emerging insights. Language Testing, 18.4, 393–407.
https://doi.org/10.1191/026553201682430102
Cardinal, L. and Léger, R. (2018). The politics of multilingualism in Canada: A neo-institutional approach. In P. A. Kraus and F. Grin (Eds.), The Politics of Multilingualism (pp. 19–37). John Benjamins. https://doi.org/10.1075/wlp.6.02car
Chalhoub-Deville, M. (2003). Second language interaction: Current perspectives and future trends. Language Testing, 20.4, 369–383. https://doi.org/10.1191/0265532203lt264oa
Chalhoub-Deville, M. (2016). Validity theory: Reform policies, accountability testing, and consequences. Language Testing, 33.4, 453–472.
https://doi.org/10.1177/0265532215593312
Chalhoub-Deville, M. B. (2019). Multilingual testing constructs: Theoretical foundations. Language Assessment Quarterly, 16.4–5, 472–480. https://doi.org/10.1080/15434303.2019.1671391
Cheng, L. and Fox, J. (2017). Assessment in the Language Classroom: Teachers Supporting Student Learning. Palgrave.
Chumak-Horbatsch, R. (2012). Linguistically Appropriate Practice: A Guide for Working with Young Immigrant Children. University of Toronto Press.
Coburn, C. E. and Penuel, W. R. (2016). Research–practice partnerships in education: Outcomes, dynamics, and open questions. Educational Researcher, 45.1, 48–54. https://doi.org/10.3102/0013189X16631750
Council of Europe (2001). Common European Framework of Reference for Languages: Learning, Teaching, Assessment. Cambridge University Press.
Cumming, A. (2009). Language assessment in education: Tests, curricula, and teaching. Annual Review of Applied Linguistics, 29, 90–100. https://doi.org/10.17763/1943-5045-87.3.404
Cummins, J. (2017). Teaching minoritized students: Are additive approaches legitimate? Harvard Educational Review, 87.3, 404–425. https://doi.org/10.17763/1943-5045-87.3.404
Cummins, J. and Early, M. (2010). Identity Texts: The Collaborative Creation of Power in Multilingual Schools. Trentham Books.
Cummins, J. and Schecter, S. R. (2003). School-based language policy in culturally diverse contexts. In S. R. Schecter and J. Cummins (Eds.), Multilingual Education in Practice: Using Diversity as a Resource (pp. 1–16). Heinemann.
Darvin, R. and Norton, B. (2014). Social class, identity, and migrant students. Journal of Language, Identity & Education, 13.2, 111–117. https://doi.org/10.1080/15348458.2014.901823
Davison, C. and Leung, C. (2009). Current issues in English language teacher-based assessment. TESOL Quarterly, 43.3, 393–415. https://doi.org/10.1002/j.1545-7249.2009.tb00242.x
De Backer, F., Van Avermaet, P. and Slembrouck, S. (2017). Schools as laboratories for exploring multilingual assessment policies and practices. Language and Education, 31.3, 217–230.
DeLuca, C., Chavez, T., Bellara, A. and Cao, C. (2013). Pedagogies for preservice assessment education: Supporting teacher candidates’ assessment literacy development. The Teacher Educator, 48.2, 128–142.
Donohoo, J. (2020). What Are We Learning about Supporting English Language Learners in Ontario? Ontario Ministry of Education.
Flores, N. and Schissel, J. (2014). Dynamic bilingualism as the norm: Envisioning a heteroglossic approach to standards-based reform. TESOL Quarterly, 48.3, 454–479.
Frey, B. B. and Schmitt, V. L. (2007). Coming to terms with classroom assessment. Journal of Advanced Academics, 18.3, 402–423. https://doi.org/10.4219/jaa-2007-495
Genesee, F. (2006). Bilingual first language acquisition in perspective. In Childhood Bilingualism: Research on infancy through school age (pp. 45–67). De Gruyter. https://doi.org/10.21832/9781853598715-005
Grosjean, F. (2008). Studying Bilinguals. Oxford University Press.
Gunderson, L., D’Silva, R. A. and Odo, D. M. (2012). Immigrant students navigating Canadian schools: A longitudinal view. TESL Canada Journal, 29, 142.
Guzman-Orth, D. A., Lopez, A. A. and Tolentino, F. (2019). Exploring the use of a dual language assessment task to assess young English learners. Language Assessment Quarterly, 16.4–5, 447–463.
Hamp-Lyons, L. (2007). The impact of testing practices on teaching: Ideologies and alternatives. In J. Cummins and C. Davison (Eds.), The International Handbook of English Language Teaching, Vol. 1 (pp. 487–504). Springer.
Haque, E. (2018). Multiculturalism within a Bilingual Framework. University of Toronto Press.
Harding, L. and Kremmel, B. (2016). Teacher assessment literacy and professional development. In D. Tsagari and J. Banerjee (Eds.), Handbook of Second Language Assessment (pp. 413–427). De Gruyter. https://doi.org/10.1515/9781614513827-027
Heugh, K., Prinsloo, C., Makgamatha, M., Diedericks, G. and Winnaar, L. (2017). Multilingualism(s) and system-wide assessment: a southern perspective. Language and Education, 31.3, 197–216. https://doi.org/10.1080/09500782.2016.1261894
Hornberger, N. H. and Johnson, D. C. (2007). Slicing the onion ethnographically: Layers and spaces in multilingual language education policy and practice. TESOL Quarterly, 41.3, 509–532. https://doi.org/10.1002/j.1545-7249.2007.tb00083.x
Jang, E.E., Cummins, J., Wagner, M., Stille, S., Dunlop, M. and Starkey, J. (2011). Field Research on Steps to English Proficiency. Report for the Literacy and Numeracy Secretariat, Ministry of Education, Ontario, Canada.
Jang, E.E., Cummins, J., Wagner, M., Stille, S. and Dunlop, M. (2015). Assessing school-aged English language learners in Ontario curriculum learning contexts using Steps to English Proficiency. Language Assessment Quarterly, 12.1, 87–109.
Kibler, A. K. and Valdes, G. (2016). Conceptualizing language learners: Socioinstitutional mechanisms and their consequences. The Modern Language Journal, 100(S1), 96–116. https://doi.org/10.1111/modl.12310
Kubota, R. and Bale, J. (2020), Bilingualism – but not plurilingualism – promoted by immersion education in Canada: Questioning equity for students of English as an additional language. TESOL Quarterly, 54, 773–785. https://doi.org/10.1002/tesq.575
Lau, S. M. C. and Van Viegen, S. (Eds.). (2020). Plurilingual Pedagogies: Critical and Creative Endeavors for Equitable Language (in) Education. Springer Nature. https://doi.org/10.1007/978-3-030-36983-5
Leung, C. (2004). Developing formative teacher assessment: Knowledge, practice, and change. Language Assessment Quarterly: An International Journal, 1.1, 19–41. https://doi.org/10.1207/s15434311laq0101_3
Leung, C. (2013). Classroom-based assessment issues for language teacher education. The Companion to Language Assessment, 3, 1510–1519. https://doi.org/10.1002/9781118411360.wbcla064
Leung, C. and Scarino, A. (2016). Reconceptualizing the nature of goals and outcomes in language/s education. The Modern Language Journal, 100(S1), 81–95. https://doi.org/10.1111/modl.12300
Li, W. (2018). Translanguaging as a practical theory of language. Applied Linguistics, 39.1, 9–30. https://doi.org/10.1093/applin/amx039
Lin, A. M. (2016). Language across the Curriculum & CLIL in English as an Additional Language (EAL) Contexts: Theory and Practice. Springer. https://doi.org/10.1007/978-981-10-1802-2
Lin, A. and Martin, P. W. (Eds.). (2005). Decolonisation, Globalisation: Language-in-Education Policy and Practice, Vol. 3. Multilingual Matters. https://doi.org/10.21832/9781853598265
Llosa, L. (2008). Building and supporting a validity argument for a standards-based classroom assessment of English proficiency based on teacher judgments. Educational Measurement: Issues and Practice, 27.3, 32–42. https://doi.org/10.1111/j.1745-3992.2008.00126.x
Llosa, L. (2011). Standards-based classroom assessments of English proficiency: A review of issues, current developments, and future directions for research. Language Testing, 28.3, 367–382. https://doi.org/10.1177/0265532211404188
Lopez, A. A., Turkan, S. and Guzman-Orth, D. (2017). Conceptualizing the use of translanguaging in initial content assessments for newly arrived emergent bilingual students. ETS Research Report Series, 2017.1, 1–12. https://doi.org/10.1002/ets2.12140
McIvor, O. and Jacobs, P. (Februrary 2016). NETOLNEW Language Learning Assessment Tool (v3.1). Retrieved from: http://netolnew.ca/assessment/
McNamara, T. (2001). Language assessment as social practice: Challenges for research. Language Testing, 18.4, 333–349. https://doi.org/10.1191/026553201682430076
McNamara, T. and Roever, C. (2006). Language Testing: The Social Dimension, Vol. 1. John Wiley & Sons.
Menken, K. (2006). Teaching to the test: How No Child Left Behind impacts language policy, curriculum, and instruction for English language learners. Bilingual Research Journal, 30.2, 521–546. https://doi.org/10.1080/15235882.2006.10162888
Menken, K. (2013). Emergent bilingual students in secondary school: Along the academic language and literacy continuum. Language Teaching, 46.4, 438–476. https://doi.org/10.1017/S0261444813000281
Menken, K. and García, O. (Eds.). (2010). Negotiating Language Education Policies: Educators as Policymakers. Routledge. https://doi.org/10.4324/9780203855874
Moore, D., Lau, S.M.C. and Van Viegen, S. (2020). Mise en écho perspectives on plurilingual competence and pluralistic pedagogies: A conversation with Daniele Moore. In S. M. C. Lau and S. Van Viegen (Eds.), Plurilingual Pedagogies: Critical and Creative Endeavors for Equitable Language Education (pp. 23–46). Springer.
Moss, P. A. (2003). Reconceptualizing validity for classroom assessment. Educational Measurement: Issues and Practice, 22.4, 13–25.
Naqvi, R., McKeough, A., Thorne, K. and Pfitscher, C. (2013). Dual-language books as an emergent-literacy resource: Culturally and linguistically responsive teaching and learning. Journal of Early Childhood Literacy, 13.4, 501–528. https://doi.org/10.1177/1468798412442886
North, B. (2007). The CEFR illustrative descriptor scales. The Modern Language Journal, 91.4, 656–659. https://doi.org/10.1111/j.1540-4781.2007.00627_3.x
Ntelioglou, B. Y., Fannin, J., Montanera, M. and Cummins, J. (2014). A multilingual and multimodal approach to literacy teaching and learning in urban education: A collaborative inquiry project in an inner city elementary school. Frontiers in Psychology, 5, 533.
Office of the Auditor General of Ontario. (2005). Annual Report. Toronto: Queen’s Printer for Ontario.
Ontario Ministry of Education. (2007). English Language Learners: ESL and ELD Programs and Services. Policies and Procedures for Ontario Elementary and Secondary Schools, Kindergarten to Grade 12. Toronto: Queen’s Printer for Ontario.
Ontario Ministry of Education. (2012a). English as a Second Language Observable Language Continua. Toronto: Queen’s Printer for Ontario.
Ontario Ministry of Education. (2012b). STEP – STEPs to English Proficiency – A Guide for Users. Toronto: Queen’s Printer for Ontario.
Ortega, L. (2019). SLA and the study of equitable multilingualism. The Modern Language Journal, 103, 23–38. https://doi.org/10.1111/modl.12525
Otheguy, R., García, O. and Reid, W. (2015). Clarifying translanguaging and deconstructing named languages: A perspective from linguistics. Applied Linguistics Review, 6.3, 281–307.
Prasad, G. L. (2014). Portraits of plurilingualism in a French international school in Toronto: Exploring the role of visual methods to access students’ representations of their linguistically diverse identities. Canadian Journal of Applied Linguistics, 17.1, 51–77.
Rea-Dickins, P., Khamis, Z. and Olivero, F. (2011). Does English-medium instruction and examining lead to social and economic advantage? Promises and threats: A sub-Saharan case study. In E. Erling and P. Seargeant (Eds.), English and International Development (pp. 111–140). Multilingual Matters.
Roessingh, H. (2004). Effective high school ESL programs: A synthesis and meta-analysis. Canadian Modern Language Review, 60.5, 611–636. https://doi.org/10.3138/cmlr.60.5.611
Roever, C. and McNamara, T. (2006). Language testing: The social dimension. International Journal of Applied Linguistics, 16.2, 242–258.
https://doi.org/10.1111/j.1473-4192.2006.00117.x
Sánchez, M. T., García, O. and Solorza, C. (2018). Reframing language allocation policy in dual language bilingual education. Bilingual Research Journal, 41.1, 37–51.
Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30.3, 309–327. https://doi.org/10.1177/0265532213480128
Schiffman, H. F. (1996). Linguistic Culture and Language Policy. Routledge.
Schissel, J. (2019). Social Consequences of Testing for Language-Minoritized Bilinguals in the United States. Multilingual Matters. https://doi.org/10.21832/9781788922715
Schissel, J. L., De Korne, H. and López-Gopar, M. (2018). Grappling with translanguaging for teaching and assessment in culturally and linguistically diverse contexts: Teacher perspectives from Oaxaca, Mexico. International Journal of Bilingual Education and Bilingualism, 1–17.
Schissel, J. L., Leung, C. and Chalhoub-Deville, M. (2019). The construct of multilingualism in language testing. Language Assessment Quarterly, 16.4–5, 373–378.
Shepard, L. (2002). Standardized tests and high-stakes assessment. In Gurthrie (Ed.), Encyclopedia of Education, Vol. 6 (2nd edition, pp. 2533–2537). Macmillan Reference.
Shohamy, E. (2006). Language Policy: Hidden Agendas and New Approaches. Routledge. https://doi.org/10.4324/9780203387962
Shohamy, E. (2014). The Power of Tests: A Critical Perspective on the Uses of Language Tests. Routledge. https://doi.org/10.4324/9781315837970
Stille, S., Bethke, R., Bradley-Brown, J., Giberson, J. and Hall, G. (2016). Broadening educational practice to include translanguaging: An outcome of educator inquiry into multilingual students’ learning needs. Canadian Modern Language Review, 72.4, 480–503. https://doi.org/10.3138/cmlr.3432
Stille, S. and Cummins, J. (2013). Foundation for learning: Engaging plurilingual students’ linguistic repertoires in the elementary classroom. TESOL Quarterly, 47.3, 630–638. https://doi.org/10.1002/tesq.116
Watt, D. and Roessingh, H. (2001). The dynamics of ESL drop-out: Plus ça change…. Canadian Modern Language Review, 58.2, 203–222. https://doi.org/10.3138/cmlr.58.2.203
Wigglesworth, G. (2008). Task and performance based assessment. In E. Shohamy and N. H. Hornberger (Vol. Eds.), Language Testing and Assessment, N. Hornberger (Series Ed.), Encyclopedia of Language and Education (pp. 111–122). Springer. https://doi.org/10.1007/978-0-387-30424-3_171
