Null results in bilingualism research

What they tell us and what they don’t

Authors

  • Ellen Bialystok York University

DOI:

https://doi.org/10.1558/jmtp.17104

Keywords:

bilingualism, cognitive advantage, executive function, null results

Abstract

The controversy over whether bilingualism has consequences for mind and brain shows no sign of abating. A steady stream of research reporting both positive results supporting the claim for beneficial effects of bilingualism and null results finding no significant differences between monolingual and bilingual groups continues to be published. With the number of null results that are produced, it is tempting to conclude that the positive effects are not reliable and that there is in fact no effect of bilingualism. However, research results, both positive and null, need to be interpreted in the larger context of factors that describe the experimental paradigm, the linguistic context, and the individual differences of the participants and not reduced to a simple binary question. The present article discusses some of the factors that must be considered in evaluating the interpretation of these research results.

Author Biography

  • Ellen Bialystok, York University

    Ellen Bialystok is a Distinguished Research Professor of Psychology and Walter Gordon Research Chair of Lifespan Cognitive Development at York University and Associate Scientist at the Rotman Research Centre of Baycrest. Her research uses behavioural and neuroimaging methods to examine the effect of bilingualism on cognitive processes across the lifespan.

References

Adesope, O. O., Lavin, T., Thompson, T., and Ungerleider, C. (2010) A systematic review and meta-analysis of the cognitive correlates of bilingualism. Review of Educational Research 80: 207–45. https://doi.org/10.3102/0034654310368803

Alladi, S., Bak, T. H., Duggirala, V., Surampudi, B., Shailaja, M., Shukla, A. K., … Kaul, S. (2013) Bilingualism delays age at onset of dementia, independent of education and immigration status. Neurology 81: 1938–44. https://doi.org/10.1212/01.wnl.0000436620.33155.a4

Antón, E., Fernández García, Y., Carreiras, M., and Duñabeitia, J. A. (2016) Does bilingualism shape inhibitory control in the elderly? Journal of Memory and Language 90: 147–60. https://doi.org/10.1016/j.jml.2016.04.007

Bak, T. H. (2016) Cooking pasta in La Paz. Linguistic Approaches to Bilingualism 6: 699–717. https://doi.org/10.1075/lab.16002.bak

Beatty-Martinez, A. L., Navarro-Torres, C. A., Dussias, P. E., Bajo, M. T., Guzzardo Tamargo, R. E., and Kroll, J. F. (2019) Interactional context mediates the consequences of bilingualism for language and cognition. Journal of Experimental Psychology: Learning, Memory, and Cognition. https://doi.org/10.1037/xlm0000770.supp

Bialystok, E. (2006) Effect of bilingualism and computer video game experience on the Simon task. Canadian Journal of Experimental Psychology 60.1: 68–79. https://doi.org/10.1037/cjep2006008

Bialystok, E. (2017) The bilingual adaptation: How minds accommodate experience.

Psychological Bulletin 143.3: 233–62. https://doi.org/10.1037/bul000009

Bialystok, E., Craik, F. I. M., and Freedman, M. (2007) Bilingualism as a protection against the onset of symptoms of dementia. Neuropsychologia 45.2: 459–64. https://doi.org/10.1016/j.neuropsychologia.2006.10.009

Bialystok, E., Craik, F. I. M., Klein, R., and Viswanathan, M. (2004) Bilingualism, aging, and cognitive control: Evidence from the Simon task. Psychology and Aging 19.2: 290–303. https://doi.org/10.1037/0882-7974.19.2.290

Bialystok, E., Kroll, J. F., Green, D. W., MacWhinney, B., and Craick, F. I. M. (2015) Publication bias and the validity of evidence: What’s the connection? Psychological Science 26: 944–46. https://doi.org/10.1177/0956797615573759

Bialystok, E., Martin, M. M., and Viswanathan, M. (2005) Bilingualism across the lifespan: The rise and fall of inhibitory control. International Journal of Bilingualism 9: 103–19. https://doi.org/10.1177/13670069050090010701

Bice, K. and Kroll, J. F. (2019) English only? Monolinguals in linguistically diverse contexts have an edge in language learning. Brain Lang 196: 104644. https://doi.org/10.1016/j.bandl.2019.104644

Carlson, S. M. and Meltzoff, A. N. (2008) Bilingual experience and executive functioning in young children. Developmental Science 11.2: 282–98. https://doi.org/10.1111/j.1467-7687.2008.00675.x

Chang, Y. K., Labban, J. D., Gapin, J. I., and Etnier, J. L. (2012) The effects of acute exercise on cognitive performance: A meta-analysis. Brain Research 1453: 87–101. https://doi.org/10.1016/j.brainres.2012.02.068

Comishen, K., Bialystok, E., and Adler, S. A. (2019) The impact of bilingual environments on selective attention in infancy. Developmental Science 22: e12797. https://doi.org/10.1111/desc.12797

Costa, A., Hernandez, A., Costa-Faidella, J., and Sebastian-Galles, N. (2009) On the bilingual advantage in conflict processing: Now you see it, now you don’t. Cognition 113: 135–49. https://doi.org/10.1016/j.cognition.2009.08.001

Dash, T., Berroir, P., Joanette, Y., and Ansaldo, A. I. (2019) Alerting, orienting, and executive control: The effect of bilingualism and age on the subcomponents of attention. Frontiers in Neurology 10. https://doi.org/10.3389/fneur.2019.01122

DeLuca, V., Rothman, J., Bialystok, E., and Pliatsikas, C. (2019) Redefining bilingualism as a spectrum of experiences that differentially affects brain structure and function. Proceedings of the National Academy of Sciences 116.15: 7565–74. https://doi.org/10.1073/pnas.1811513116

DeLuca, V., Rothman, J., Bialystok, E., and Pliatsikas, C. (2020) Duration and extent of bilingual experience modulate neurocognitive outcomes. Neuroimage 204: 116222. https://doi.org/10.1016/j.neuroimage.2019.116222

Donnelly, S., Brooks, P. J., and Homer, B. D. (2019) Is there a bilingual advantage on interference-control tasks? A multiverse meta-analysis of global reaction time and interference cost. Psychonomic Bulletin and Review 26: 1122–47. https://doi.org/10.3758/s13423-019-01567-z

Dunabeitia, J. A., Hernandez, J. A., Anton, E., Macizo, P., Estevez, A., Fuentes, L. J., and Carreiras, M. (2014) The inhibitory advantage in bilingual children revisited: Myth or reality? Experimental Psychology 61.3: 234–51. https://doi.org/10.1027/1618-3169/a000243

Duncan, H. D., Nikelski, J., Pilon, R., Steffener, J., Chertkow, H., and Phillips, N. A. (2018) Structural brain differences between monolingual and multilingual patients with mild cognitive impairment and Alzheimer disease: Evidence for cognitive reserve. Neuropsychologia 109: 270–82. https://doi.org/10.1016/j.neuropsychologia.2017.12.036

Etnier, J. L., Salazar, W., Landars, D. M., Petruzzello, S. J., Han, M., and Nowell, P. (1997) The influence of physical fitness and exercise upon cognitive functioning: A meta-analysis. Journal of Sport and Exercise Psychology 19: 249–77. https://doi.org/10.1123/jsep.19.3.249

Folke, T., Ouzia, J., Bright, P., De Martino, B., and Filippi, R. (2016) A bilingual disadvantage in metacognitive processing. Cognition 150: 119–32. https://doi.org/10.1016/j.cognition.2016.02.008

Gathercole, V. C., Thomas, E. M., Kennedy, I., Prys, C., Young, N., Vinas Guasch, N., … Jones, L. (2014) Does language dominance affect cognitive performance in bilinguals? Lifespan evidence from preschoolers through older adults on card sorting, Simon, and metalinguistic tasks. Front Psychol 5: 11. https://doi.org/10.3389/fpsyg.2014.00011

Green, D. W. and Abutalebi, J. (2013) Language control in bilinguals: The adaptive control hypothesis. Journal of Cognitive Psychology 25: 515–30. https://doi.org/10.1080/20445911.2013.796377

Grundy, J. G. and Timmer, K. (2017) Bilingualism and working memory capacity: A comprehensive meta-analysis. Second Language Research 33.3: 325–40. https://doi.org/10.1177/0267658316678286

Hartanto, A. and Yang, H. (2016) Disparate bilingual experiences modulate task-switching advantages: A diffusion-model analysis of the effects of interactional context on switch costs. Cognition 150: 10–19. https://doi.org/10.1016/j.cognition.2016.01.016

Kirk, N. W., Fiala, L., Scott-Brown, K. C., and Kempe, V. (2014) No evidence for reduced Simon cost in elderly bilinguals and bidialectals. Journal of Cognitive Psychology 26.6: 640–48. https://doi.org/10.1080/20445911.2014.929580

Kovacs, A. M. and Mehler, J. (2009) Cognitive gains in 7-month-old bilingual infants. Proceedings of the National Academy of Science 106.16: 6556–60. https://doi.org/10.1073/pnas.0811323106

Kroll, J. F. and Bialystok, E. (2013) Understanding the consequences of bilingualism for language processing and cognition. Journal of Cognitive Psychology 25.5: 497–514. https://doi.org/10.1080/20445911.2013.799170

Kroll, J. F., Dussias, P. E., Bice, K., and Perrotti, L. (2015a) Bilingualism, mind, and brain. Annual Review of Linguistics 1.1: 377–94. https://doi.org/10.1146/annurev-linguist-030514-124937

Kroll, J. F., Gullifer, J., McClain, R., Rossi, E., and Cruz Martin, M. (2015b) Selection and control in bilingual comprehension and production. In J. W. Schwieter (ed.) Cambridge Handbook of Bilingual Processing 485–507. New York: Cambridge University Press.

Lehtonen, M., Soveri, A., Laine, A., Jarvenpaa, J., de Bruin, A., and Antfolk, J. (2018) Is bilingualism associated with enhanced executive functioning in adults? A meta-analytic review. Psychological Bulletin 144: 394–425. https://doi.org/10.1037/bul0000142.supp

Martin-Rhee, M. M. and Bialystok, E. (2008) The development of two types of inhibitory control in monolingual and bilingual children. Bilingualism: Language and Cognition 11.1: 81–93. https://doi.org/10.1017/s1366728907003227

Mehrani, M. B. and Zabihi, R. (2017) A comparative study of shifting ability, inhibitory control and working memory in monolingual and bilingual children. Psychological Studies 62.4: 421–27. https://doi.org/10.1007/s12646-017-0432-8

Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., and Wager, T. D. (2000) The unity and diversity of executive functions and their contributions to complex “Frontal Lobe” tasks: A latent variable analysis. Cognitive Psychology 41.1: 49–100. https://doi.org/10.1006/cogp.1999.0734

Ooi, S. H., Goh, W. D., Sorace, A., and Bak, T. H. (2018) From bilingualism to bilingualisms. Bilingualism: Language and Cognition, in press.

Paap, K. R. (2019) The bilingual advantage debate: Quantity and quality of the evidence. In J. W. Schwieter (ed.) The Handbook of Neuroscience of Multilingualism 701–35. London: Wiley-Blackwell.

Paap, K. R. and Greenberg, Z. I. (2013) There is no coherent evidence for a bilingual advantage in executive processing. Cognitive Psychology 66.2: 232–58. https://doi.org/10.1016/j.cogpsych.2012.12.002

Pashler, H. and Wagenmakers, E. (2012) Editors’ introduction to the special section on replicability in psychological science: A crisis of confidence? Perspectives on Psychological Science 7: 528–30. https://doi.org/10.1177/1745691612465253

Perani, D., Farsad, M., Ballarini, T., Lubian, F., Malpetti, M., Fracchetti, A., . . . Abutalebi, J. (2017) The impact of bilingualism on brain reserve and metabolic connectivity in Alzheimer’s dementia. Proceedings of the National Academy of Sciences, 201610909. https://doi.org/10.1073/pnas.1610909114

Perquin, M., Vaillant, M., Schuller, A. M., Pastore, J., Dartigues, J. F., Lair, M. L., . . . MemoVie, G. (2013) Lifelong exposure to multilingualism: New evidence to support cognitive reserve hypothesis. PLoS One 8.4: e62030. https://doi.org/10.1371/journal.pone.0062030

Pot, A., Keijzer, M., and de Bot, K. (2018) Intensity of multilingual language use predicts cognitive performance in some multilingual older adults. Brain Sci 8.5. https://doi.org/10.3390/brainsci8050092

Salvatierra, J. L. and Rosselli, M. (2010) The effect of bilingualism and age on inhibitory control. International Journal of Bilingualism 15.1: 26–37. https://doi.org/10.1177/1367006910371021

Schweizer, T. A., Ware, J., Fischer, C. E., Craik, F. I. M., and Bialystok, E. (2012) Bilingualism as a contributor to cognitive reserve: Evidence from brain atrophy in Alzheimer’s disease. Cortex 48.8: 991–96. https://doi.org/10.1016/j.cortex.2011.04.009

Silver, N. (2012) The Signal and the Noise: Why So Many Predictions Fail — but Some Don’t. New York: Penguin.

Surrain, S. and Luk, G. (2019) Describing bilinguals: A systematic review of labels and descriptions used in the literature between 2005–2015. Bilingualism: Language and Cognition 22: 401–15. https://doi.org/10.1017/S1366728917000682

von Bastian, C. C., Souza, A. S., and Gade, M. (2016) No evidence for bilingual cognitive advantages: A test of four hypotheses. Journal of Experimental Psychology: General 145: 246–58. https://doi.org/10.1037/xge0000120.supp

Weikum, W. M., Vouloumanos, A., Navarra, J., Soto-Faraco, S., Sebastian-Galles, N., and Werker, J. F. (2007) Visual language discrimination in infancy. Science 316: 1159. https://doi.org/10.1126/science.1137686

Woumans, E., Santens, P., Sieben, A., Versijpt, J., Stevens, M., and Duyck, W. (2015) Bilingualism delays clinical manifestation of Alzheimer’s disease. Bilingualism: Language and Cognition 18: 568–74. https://doi.org/10.1017/S136672891400087X

Yang, S., Yang, H., and Lust, B. (2011) Early childhood bilingualism leads to advances in executive attention: Dissociating culture and language. Bilingualism: Language and Cognition 14: 412–22. https://doi.org/10.1017/S1366728910000611

Published

2020-10-15

Issue

Section

Articles

How to Cite

Bialystok, E. (2020). Null results in bilingualism research: What they tell us and what they don’t. Journal of Multilingual Theories and Practices, 1(1), 8-22. https://doi.org/10.1558/jmtp.17104