How are multilingual communities of practice being considered in language assessment? A language ecology approach

Authors

  • Angel Arias Carleton University
  • Jamie L. Schissel University of North Carolina at Greensboro

DOI:

https://doi.org/10.1558/jmtp.21242

Keywords:

Validation, Assessment

Abstract

.

Author Biographies

  • Angel Arias, Carleton University

    Angel Arias is Assistant Professor of Applied Linguistics in the School of Linguistics and Language Studies at Carleton University, Canada. His research focuses on the application of psychometric models and mixed methods approaches in language testing and assessment to evaluate validity evidence of test score meaning and justification of test use in high-stakes and classroom contexts.

  • Jamie L. Schissel, University of North Carolina at Greensboro

    Jamie L. Schissel is Associate Professor, TESOL, at the University of North Carolina at Greensboro. Her research focuses on educational assessments and policies affecting linguistically and culturally diverse communities. Through historical analyses and participatory action research collaborations, these projects emphasise relationship building to inform actions that challenge multiple modes of oppression.

References

Addey, C., Maddox, B. and Zumbo, B. D. (2020). Assembled validity: Rethinking Kane’s argument-based approach in the context of international large-scale assessments (ILSAs). Assessment in Education: Principles, Policy & Practice, 27.6, 588–606. https://doi.org/10.1080/0969594X.2020.1843136

American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (Eds.). (2014). Standards for Educational and Psychological Testing. American Educational Research Association.

Bachman, L. F. and Palmer A. S. (2010). Language Assessment in Practice: Developing Language Assessments and Justifying Their Use in the Real World. Oxford University Press.

Bronfenbrenner, U. (1979). The Ecology of Human Development: Experiments by Nature and Design. Harvard University Press.

Canagarajah, S. and Liyanage, I. (2012) Lessons from pre-colonial multilingualism. In M. Martin-Jones, A. Blackledge and A. Creese (Eds.), The Routledge Handbook of Multilingualism (pp. 49–65). Routledge.

Chapelle, C. A. (2020). Argument-Based Validation in Testing and Assessment: Vol. 184. Quantitative Applications in the Social Sciences. Sage Publications.

Chapelle, C. A., Enright, M. A. and Jamieson, J. M. (2008). (Eds.). Building a Validity Argument for the Test of English as a Foreign Language. Routledge.

Cizek, G. J. (2020). Validity: An Integrated Approach to Test Score Meaning and Use. Routledge. https://doi.org/10.4324/9780429291661

Eckert, P. (2006). Communities of practice. In K. Brown (Ed.), Encyclopedia of Language & Linguistics (2nd edition, 683–685). Elsevier.

https://doi.org/10.1016/B0-08-044854-2/01276-1

Eizadirad, A. (2019). Decolonising Educational Assessment: Ontario Elementary Students and the EQAO. Palgrave Macmillan. https://doi.org/10.1007/978-3-030-27462-7

Fox, J. and Artemeva, N. (in press). Reconsidering Context in Language Assessment: Transdisciplinary Perspectives, Social Theories and Validity. Routledge.

Gee, J. P. (2004). Situated Language and Learning: A Critique of Traditional Schooling. Routledge.

Haugen, E. (1972). The ecology of language. In S. A. Dil (Ed.), The Ecology of Language: Essays by Einar Haugen (pp. 325–339). Stanford University Press.

Hornberger, N. H. and Hult, F. M. (2008). Ecological language education policy. In B. Spolsky and F. M. Hult (Eds.), The Handbook of Educational Linguistics (pp. 280–296). Blackwell. https://doi.org/10.1002/9780470694138.ch20

Kane, M. T. (1992). An argument-based approach to validity. Psychological Bulletin, 112.3, 527–535. https://doi.org/10.1037/0033-2909.112.3.527

Kane, M. T. (2006). Validation. In R. Brennan (Ed.), Educational Measurement (4th edition, pp. 17–64). American Council of Education and Praeger.

Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50.1, 1–73. https://doi.org/10.1111/jedm.12000

Kane, M. T. (2021). A hierarchical framework for validation. Invited Speaker Session AERA Division D Robert L. Linn Distinguished Award Address. American Educational Research Association [Online Virtual Conference].

Lave, J. (1991). Situating learning in communities of practice. In L. B. Resnick, J. M. Levine, and S. D. Teasley (Eds.), Perspectives on Socially Shared Cognition (pp. 63–82). American Psychological Association. https://doi.org/10.1037/10096-003

Lave, J. and E. Wenger (1991). Situated Learning: Legitimate Peripheral Participation. Cambridge University Press. https://doi.org/10.1017/CBO9780511815355

Leung, C. and Valdés, G. (2019). Translanguaging and the transdisciplinary framework for language teaching and learning in a multilingual world. The Modern Language Journal, 103.2, 348–370. https://doi.org/10.1111/modl.12568

Li, L. C., Grimshaw, J. M., Nielsen, C., Judd, M., Coyte, P. C. and Graham, I. D. (2009). Evolution of Wenger’s concept of community of practice. Implementation Science, 4.1, 1–8. https://doi.org/10.1186/1748-5908-4-11

Messick, S. (1989a). Validity. In R. L. Linn (Ed.), Educational Measurement (3rd edition, pp. 13–103). American Council on Education and Macmillan.

Messick, S. (1989b). Meaning and values in test validation: The science and ethics of assessment. Educational Researcher 18.2: 5–11. https://doi.org/10.3102/0013189X018002005

Moss, P. A. (2016). Shifting the focus of validity for test use. Assessment in Education: Principles, Policy & Practice, 23.2, 236–251. https://doi.org/10.1080/0969594X.2015.1072085

Mühlhäusler, P. (2000). Language planning and language ecology. Current Issues in Language Planning, 1.3, 306–367. https://doi.org/10.1080/14664200008668011

Prior, P. (24 March 2003). Are communities of practice really an alternative to discourse communities? Paper presented at the Conference of the American Association of Applied Linguistics (AAAL) [available online].

Rea-Dickins, P. (1997). So, why do we need relationships with stakeholders in language testing? A view from the UK. Language Testing, 14.3, 304–314. https://doi.org/10.1177/026553229701400307

Scollon, R. (2001). Mediated Discourse: The Nexus of Practice. Routledge. https://doi.org/10.4324/9780203420065

Shohamy, E. (2011). Assessing multilingual competencies: Adopting construct valid assessment policies. The Modern Language Journal, 95.3, 418–429. https://doi.org/10.1111/j.1540-4781.2011.01210.x

Skutnabb-Kangas, T. and Phillipson, R. (2011). Language ecology. Pragmatics in Practice, 9, 177. https://doi.org/10.1075/hoph.9.12sku

Swain, M. (2006). Languaging, agency and collaboration in advanced second language learning. In H. Byrnes (Ed.), Advanced Language Learning: The Contribution of Halliday and Vygotsky (pp. 95–108). Continuum.

Walter, M. and Andersen, C. (2013). Indigenous Statistics: A Quantitative Research Methodology. Left Coast Press.

Wenger, E. (2010). Communities of practice and social learning systems: The career of a concept. In C. Blackmore (Ed.), Social Learning Systems and Communities of Practice (pp. 179–198). Springer. https://doi.org/10.1007/978-1-84996-133-2_11

Downloads

Published

2021-12-07

Issue

Section

Introduction

How to Cite

Arias, A. ., & Schissel, J. L. . (2021). How are multilingual communities of practice being considered in language assessment? A language ecology approach. Journal of Multilingual Theories and Practices, 2(2), 141–153. https://doi.org/10.1558/jmtp.21242