Null results in bilingualism research
What they tell us and what they don’t
DOI:
https://doi.org/10.1558/jmtp.17104Keywords:
bilingualism, cognitive advantage, executive function, null resultsAbstract
The controversy over whether bilingualism has consequences for mind and brain shows no sign of abating. A steady stream of research reporting both positive results supporting the claim for beneficial effects of bilingualism and null results finding no significant differences between monolingual and bilingual groups continues to be published. With the number of null results that are produced, it is tempting to conclude that the positive effects are not reliable and that there is in fact no effect of bilingualism. However, research results, both positive and null, need to be interpreted in the larger context of factors that describe the experimental paradigm, the linguistic context, and the individual differences of the participants and not reduced to a simple binary question. The present article discusses some of the factors that must be considered in evaluating the interpretation of these research results.
References
Adesope, O. O., Lavin, T., Thompson, T., and Ungerleider, C. (2010) A systematic review and meta-analysis of the cognitive correlates of bilingualism. Review of Educational Research 80: 207–45. https://doi.org/10.3102/0034654310368803
Alladi, S., Bak, T. H., Duggirala, V., Surampudi, B., Shailaja, M., Shukla, A. K., … Kaul, S. (2013) Bilingualism delays age at onset of dementia, independent of education and immigration status. Neurology 81: 1938–44. https://doi.org/10.1212/01.wnl.0000436620.33155.a4
Antón, E., Fernández García, Y., Carreiras, M., and Duñabeitia, J. A. (2016) Does bilingualism shape inhibitory control in the elderly? Journal of Memory and Language 90: 147–60. https://doi.org/10.1016/j.jml.2016.04.007
Bak, T. H. (2016) Cooking pasta in La Paz. Linguistic Approaches to Bilingualism 6: 699–717. https://doi.org/10.1075/lab.16002.bak
Beatty-Martinez, A. L., Navarro-Torres, C. A., Dussias, P. E., Bajo, M. T., Guzzardo Tamargo, R. E., and Kroll, J. F. (2019) Interactional context mediates the consequences of bilingualism for language and cognition. Journal of Experimental Psychology: Learning, Memory, and Cognition. https://doi.org/10.1037/xlm0000770.supp
Bialystok, E. (2006) Effect of bilingualism and computer video game experience on the Simon task. Canadian Journal of Experimental Psychology 60.1: 68–79. https://doi.org/10.1037/cjep2006008
Bialystok, E. (2017) The bilingual adaptation: How minds accommodate experience.
Psychological Bulletin 143.3: 233–62. https://doi.org/10.1037/bul000009
Bialystok, E., Craik, F. I. M., and Freedman, M. (2007) Bilingualism as a protection against the onset of symptoms of dementia. Neuropsychologia 45.2: 459–64. https://doi.org/10.1016/j.neuropsychologia.2006.10.009
Bialystok, E., Craik, F. I. M., Klein, R., and Viswanathan, M. (2004) Bilingualism, aging, and cognitive control: Evidence from the Simon task. Psychology and Aging 19.2: 290–303. https://doi.org/10.1037/0882-7974.19.2.290
Bialystok, E., Kroll, J. F., Green, D. W., MacWhinney, B., and Craick, F. I. M. (2015) Publication bias and the validity of evidence: What’s the connection? Psychological Science 26: 944–46. https://doi.org/10.1177/0956797615573759
Bialystok, E., Martin, M. M., and Viswanathan, M. (2005) Bilingualism across the lifespan: The rise and fall of inhibitory control. International Journal of Bilingualism 9: 103–19. https://doi.org/10.1177/13670069050090010701
Bice, K. and Kroll, J. F. (2019) English only? Monolinguals in linguistically diverse contexts have an edge in language learning. Brain Lang 196: 104644. https://doi.org/10.1016/j.bandl.2019.104644
Carlson, S. M. and Meltzoff, A. N. (2008) Bilingual experience and executive functioning in young children. Developmental Science 11.2: 282–98. https://doi.org/10.1111/j.1467-7687.2008.00675.x
Chang, Y. K., Labban, J. D., Gapin, J. I., and Etnier, J. L. (2012) The effects of acute exercise on cognitive performance: A meta-analysis. Brain Research 1453: 87–101. https://doi.org/10.1016/j.brainres.2012.02.068
Comishen, K., Bialystok, E., and Adler, S. A. (2019) The impact of bilingual environments on selective attention in infancy. Developmental Science 22: e12797. https://doi.org/10.1111/desc.12797
Costa, A., Hernandez, A., Costa-Faidella, J., and Sebastian-Galles, N. (2009) On the bilingual advantage in conflict processing: Now you see it, now you don’t. Cognition 113: 135–49. https://doi.org/10.1016/j.cognition.2009.08.001
Dash, T., Berroir, P., Joanette, Y., and Ansaldo, A. I. (2019) Alerting, orienting, and executive control: The effect of bilingualism and age on the subcomponents of attention. Frontiers in Neurology 10. https://doi.org/10.3389/fneur.2019.01122
DeLuca, V., Rothman, J., Bialystok, E., and Pliatsikas, C. (2019) Redefining bilingualism as a spectrum of experiences that differentially affects brain structure and function. Proceedings of the National Academy of Sciences 116.15: 7565–74. https://doi.org/10.1073/pnas.1811513116
DeLuca, V., Rothman, J., Bialystok, E., and Pliatsikas, C. (2020) Duration and extent of bilingual experience modulate neurocognitive outcomes. Neuroimage 204: 116222. https://doi.org/10.1016/j.neuroimage.2019.116222
Donnelly, S., Brooks, P. J., and Homer, B. D. (2019) Is there a bilingual advantage on interference-control tasks? A multiverse meta-analysis of global reaction time and interference cost. Psychonomic Bulletin and Review 26: 1122–47. https://doi.org/10.3758/s13423-019-01567-z
Dunabeitia, J. A., Hernandez, J. A., Anton, E., Macizo, P., Estevez, A., Fuentes, L. J., and Carreiras, M. (2014) The inhibitory advantage in bilingual children revisited: Myth or reality? Experimental Psychology 61.3: 234–51. https://doi.org/10.1027/1618-3169/a000243
Duncan, H. D., Nikelski, J., Pilon, R., Steffener, J., Chertkow, H., and Phillips, N. A. (2018) Structural brain differences between monolingual and multilingual patients with mild cognitive impairment and Alzheimer disease: Evidence for cognitive reserve. Neuropsychologia 109: 270–82. https://doi.org/10.1016/j.neuropsychologia.2017.12.036
Etnier, J. L., Salazar, W., Landars, D. M., Petruzzello, S. J., Han, M., and Nowell, P. (1997) The influence of physical fitness and exercise upon cognitive functioning: A meta-analysis. Journal of Sport and Exercise Psychology 19: 249–77. https://doi.org/10.1123/jsep.19.3.249
Folke, T., Ouzia, J., Bright, P., De Martino, B., and Filippi, R. (2016) A bilingual disadvantage in metacognitive processing. Cognition 150: 119–32. https://doi.org/10.1016/j.cognition.2016.02.008
Gathercole, V. C., Thomas, E. M., Kennedy, I., Prys, C., Young, N., Vinas Guasch, N., … Jones, L. (2014) Does language dominance affect cognitive performance in bilinguals? Lifespan evidence from preschoolers through older adults on card sorting, Simon, and metalinguistic tasks. Front Psychol 5: 11. https://doi.org/10.3389/fpsyg.2014.00011
Green, D. W. and Abutalebi, J. (2013) Language control in bilinguals: The adaptive control hypothesis. Journal of Cognitive Psychology 25: 515–30. https://doi.org/10.1080/20445911.2013.796377
Grundy, J. G. and Timmer, K. (2017) Bilingualism and working memory capacity: A comprehensive meta-analysis. Second Language Research 33.3: 325–40. https://doi.org/10.1177/0267658316678286
Hartanto, A. and Yang, H. (2016) Disparate bilingual experiences modulate task-switching advantages: A diffusion-model analysis of the effects of interactional context on switch costs. Cognition 150: 10–19. https://doi.org/10.1016/j.cognition.2016.01.016
Kirk, N. W., Fiala, L., Scott-Brown, K. C., and Kempe, V. (2014) No evidence for reduced Simon cost in elderly bilinguals and bidialectals. Journal of Cognitive Psychology 26.6: 640–48. https://doi.org/10.1080/20445911.2014.929580
Kovacs, A. M. and Mehler, J. (2009) Cognitive gains in 7-month-old bilingual infants. Proceedings of the National Academy of Science 106.16: 6556–60. https://doi.org/10.1073/pnas.0811323106
Kroll, J. F. and Bialystok, E. (2013) Understanding the consequences of bilingualism for language processing and cognition. Journal of Cognitive Psychology 25.5: 497–514. https://doi.org/10.1080/20445911.2013.799170
Kroll, J. F., Dussias, P. E., Bice, K., and Perrotti, L. (2015a) Bilingualism, mind, and brain. Annual Review of Linguistics 1.1: 377–94. https://doi.org/10.1146/annurev-linguist-030514-124937
Kroll, J. F., Gullifer, J., McClain, R., Rossi, E., and Cruz Martin, M. (2015b) Selection and control in bilingual comprehension and production. In J. W. Schwieter (ed.) Cambridge Handbook of Bilingual Processing 485–507. New York: Cambridge University Press.
Lehtonen, M., Soveri, A., Laine, A., Jarvenpaa, J., de Bruin, A., and Antfolk, J. (2018) Is bilingualism associated with enhanced executive functioning in adults? A meta-analytic review. Psychological Bulletin 144: 394–425. https://doi.org/10.1037/bul0000142.supp
Martin-Rhee, M. M. and Bialystok, E. (2008) The development of two types of inhibitory control in monolingual and bilingual children. Bilingualism: Language and Cognition 11.1: 81–93. https://doi.org/10.1017/s1366728907003227
Mehrani, M. B. and Zabihi, R. (2017) A comparative study of shifting ability, inhibitory control and working memory in monolingual and bilingual children. Psychological Studies 62.4: 421–27. https://doi.org/10.1007/s12646-017-0432-8
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., and Wager, T. D. (2000) The unity and diversity of executive functions and their contributions to complex “Frontal Lobe” tasks: A latent variable analysis. Cognitive Psychology 41.1: 49–100. https://doi.org/10.1006/cogp.1999.0734
Ooi, S. H., Goh, W. D., Sorace, A., and Bak, T. H. (2018) From bilingualism to bilingualisms. Bilingualism: Language and Cognition, in press.
Paap, K. R. (2019) The bilingual advantage debate: Quantity and quality of the evidence. In J. W. Schwieter (ed.) The Handbook of Neuroscience of Multilingualism 701–35. London: Wiley-Blackwell.
Paap, K. R. and Greenberg, Z. I. (2013) There is no coherent evidence for a bilingual advantage in executive processing. Cognitive Psychology 66.2: 232–58. https://doi.org/10.1016/j.cogpsych.2012.12.002
Pashler, H. and Wagenmakers, E. (2012) Editors’ introduction to the special section on replicability in psychological science: A crisis of confidence? Perspectives on Psychological Science 7: 528–30. https://doi.org/10.1177/1745691612465253
Perani, D., Farsad, M., Ballarini, T., Lubian, F., Malpetti, M., Fracchetti, A., . . . Abutalebi, J. (2017) The impact of bilingualism on brain reserve and metabolic connectivity in Alzheimer’s dementia. Proceedings of the National Academy of Sciences, 201610909. https://doi.org/10.1073/pnas.1610909114
Perquin, M., Vaillant, M., Schuller, A. M., Pastore, J., Dartigues, J. F., Lair, M. L., . . . MemoVie, G. (2013) Lifelong exposure to multilingualism: New evidence to support cognitive reserve hypothesis. PLoS One 8.4: e62030. https://doi.org/10.1371/journal.pone.0062030
Pot, A., Keijzer, M., and de Bot, K. (2018) Intensity of multilingual language use predicts cognitive performance in some multilingual older adults. Brain Sci 8.5. https://doi.org/10.3390/brainsci8050092
Salvatierra, J. L. and Rosselli, M. (2010) The effect of bilingualism and age on inhibitory control. International Journal of Bilingualism 15.1: 26–37. https://doi.org/10.1177/1367006910371021
Schweizer, T. A., Ware, J., Fischer, C. E., Craik, F. I. M., and Bialystok, E. (2012) Bilingualism as a contributor to cognitive reserve: Evidence from brain atrophy in Alzheimer’s disease. Cortex 48.8: 991–96. https://doi.org/10.1016/j.cortex.2011.04.009
Silver, N. (2012) The Signal and the Noise: Why So Many Predictions Fail — but Some Don’t. New York: Penguin.
Surrain, S. and Luk, G. (2019) Describing bilinguals: A systematic review of labels and descriptions used in the literature between 2005–2015. Bilingualism: Language and Cognition 22: 401–15. https://doi.org/10.1017/S1366728917000682
von Bastian, C. C., Souza, A. S., and Gade, M. (2016) No evidence for bilingual cognitive advantages: A test of four hypotheses. Journal of Experimental Psychology: General 145: 246–58. https://doi.org/10.1037/xge0000120.supp
Weikum, W. M., Vouloumanos, A., Navarra, J., Soto-Faraco, S., Sebastian-Galles, N., and Werker, J. F. (2007) Visual language discrimination in infancy. Science 316: 1159. https://doi.org/10.1126/science.1137686
Woumans, E., Santens, P., Sieben, A., Versijpt, J., Stevens, M., and Duyck, W. (2015) Bilingualism delays clinical manifestation of Alzheimer’s disease. Bilingualism: Language and Cognition 18: 568–74. https://doi.org/10.1017/S136672891400087X
Yang, S., Yang, H., and Lust, B. (2011) Early childhood bilingualism leads to advances in executive attention: Dissociating culture and language. Bilingualism: Language and Cognition 14: 412–22. https://doi.org/10.1017/S1366728910000611
