Predicting veracity in online hotel reviews using types of reported speech, speaker identity and quotation marks
DOI:
https://doi.org/10.1558/ijsll.20600Keywords:
deception detection, online discourse, narrative, reported speech, ewomAbstract
Many studies of deception detection have supported using direct reported speech as a linguistic indicator of veracity (Vrij 2015). However, indirect reported speech and narrative reports of speech (Leech and Short 1981[2007]; Chafe 1994) have not received such attention in veracity assessment research. The current study investigates whether these types of reported speech (along with speaker identities and the use/non-use of quotation marks) act as indicators of veracity in a corpus of truthful and deceptive negative online hotel reviews developed by Ott, Choi, Cardie and Hancock (2011). Logistic regression modelling found that type of reported speech and speaker identity were significant, with deceptive reviews more often using indirect reported speech and truthful reviews featuring speaker identities other than the reviewer or hotel staff. This article contributes to our understanding of deception detection by considering theoretically meaningful classes of indicators (Burgoon 2018) and connecting previous approaches from multiple fields and perspectives.
References
Adams, S. H. and Jarvis, J. P. (2006) Indicators of veracity and deception: an analysis of written statements made to police. International Journal of Speech, Language and the Law 13(1): 1–22. https://doi.org/10.1558/sll.2006.13.1.1
Agha, A. (2005) Voice, footing, enregisterment. Journal of Linguistic Anthropology 15(1): 38–59. https://doi.org/10.1525/jlin.2005.15.1.38
Ali, M. and Levine, T. (2008) The language of truthful and deceptive denials and confessions. Communication Reports 21(2): 82–91. https://doi.org/10.1080/08934210802381862
Amado, B., Arce, R., Fariña, F. and Vilariño, M. (2016) Criteria-Based Content Analysis (CBCA) reality criteria in adults: a meta-analytic review. International Journal of Clinical and Health Psychology 16(2): 201–210. https://doi.org/10.1016/j.ijchp.2016.01.002
Bogaard, G., Colwell, K. and Crans, S. (2019) Using the reality interview improves the accuracy of the criteria-based content analysis and reality monitoring. Applied Cognitive Psychology 33(6): 1018–1031. https://doi.org/10.1002/acp.3537
Buchstaller, I., Rickford, J., Traugott, E., Wasow, T. and Zwicky, A. (2010) The sociolinguistics of a short-lived innovation: tracing the development of quotative all across spoken and internet newsgroup data. Language Variation and Change 22(2): 191–219. https://doi.org/10.1017/S0954394510000098
Burgoon, J. (2018) Predicting veracity from linguistic indicators. Journal of Language and Social Psychology 37(6): 603–631. https://doi.org/10.1177/0261927X18784119
Chafe, W. L. (1994) Discourse, Consciousness, and Time: The Flow and Displacement of Conscious Experience in Speaking and Writing. Chicago: University of Chicago Press.
Clark, H. H. and Gerrig, R. J. (1990) Quotations as demonstrations. Language 66(4): 764–805. https://doi.org/10.2307/414729
Fitzpatrick, E., Bachenko, J. and Fornaciari, T. (2015) Automatic Detection of Verbal Deception. San Rafael, CA: Morgan and Claypool. https://doi.org/10.2200/S00656ED1V01Y201507HLT029
Gokhman, S., Hancock, J., Prabhu, P., Ott, M. and Cardie, C. (2012) In search of a gold standard in studies of deception. In Proceedings of the Workshop on Computational Approaches to Deception Detection 3–30. Avignon, France. Association for Computational Linguistics.
Gordon, R., Gerrig, R. J. and Franklin, N. (2009) Qualitative characteristics of memories for real, imagined, and media-based events. Discourse Processes 46(1): 70–91. https://doi.org/10.1080/01638530802629117
Gumperz, J. J. (1982) Discourse Strategies. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511611834
Hamilton, H. E. (1998) Reported speech and survivor identity in on-line bone marrow transplantation narratives. Journal of Sociolinguistics 2(1): 53–67. https://doi.org/10.1111/1467-9481.00030
Holt, E. (2000) Reporting and reacting: concurrent responses to reported speech, Research on Language and Social Interaction 33(4): 425–454. https://doi.org/10.1207/S15327973RLSI3304_04
Holt, E. (2017) Indirect reported speech in storytelling: its position, design, and uses. Research on Language and Social Interaction 50(2): 171–187. https://doi.org/10.1080/08351813.2017.1301302
Jindal, N. and Liu, B. (2008) Opinion spam and analysis. In Proceedings of the 2008 International Conference on Web Search and Data Mining 219–230. ACM Digital Library. https://doi.org/10.1145/1341531.1341560
Johnson, M. K. and Raye, C. L. (1981) Reality monitoring. Psychological Review 88(1): 67–85. https://doi.org/10.1037/0033-295X.88.1.67
Johnstone, B. (2001) Narrative analysis. In H. Hamilton, D. Schiffrin and D. Tannen (eds) The Handbook of Discourse Analysis 635–649. Malden, MA: Blackwell Publishers.
Labov, W. (1972) The transformation of experience in narrative syntax. In W. Labov (ed.) Language in the Inner City 354–396. Philadelphia: University of Pennsylvania Press.
Labov, W. (2004) Ordinary events. In C. Fought (ed.) Sociolinguistic Variation: Critical Reflections 31–43. Oxford: Oxford University Press.
Labov, W. (2011) Narratives of personal experience. In P. C. Hogan (ed.) The Cambridge Encyclopedia of the Language Science 546–548. New York: Cambridge University Press.
Labov, W. and Waletzky, J. (1967) Narrative analysis: oral versions of personal experience. In J. Helms (ed.) Essays on the Verbal and Visual Arts: Proceedings of the 1966 Annual Spring Meeting of the American Ethnological Society 12–44. Seattle, WA: University of Washington Press.
Leech, G. N. and Short, M. (1981 [2007]) Style in Fiction: A Linguistic Introduction to English Fictional Prose. London: Longman.
Levinson, S. (1983) Pragmatics. Cambridge: Cambridge University Press.
Lowrey, B. V. and Ray, S. (2015) Mitigating murder: the construction of blame in true and false confessions. Discourse Studies 17(3): 282–298. https://doi.org/10.1177/1461445615571197
Masip, J. (2017) Deception detection: state of the art and future prospects. Psicothema 29(2): 149–159.
Nahari, G. (2018) Reality monitoring in the forensic context: digging deeper into the speech of liars. Journal of Applied Research in Memory and Cognition 7(3): 432–440. https://doi.org/10.1016/j.jarmac.2018.04.003
Nahari, G., Vrij, A. and Fisher, R. (2014) Exploiting liars’ verbal strategies by examining the verifiability of details. Legal and Criminological Psychology 19(2): 227–239. https://doi.org/10.1111/j.2044-8333.2012.02069.x
Ott, M., Cardie, C., and Hancock, J. T. (2013) Negative deceptive opinion spam. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: 497–501. Atlanta, GA: Association for Computational Linguistics.
Ott, M., Choi, Y., Cardie, C. and Hancock, J. T. (2011) Finding deceptive opinion spam by any stretch of the imagination. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies 309–319. Portland, OR: Association for Computational Linguistics.
Pennebaker, J. W., Booth, R. J., Boyd, R. L. and Francis, M. E. (2007) The Development and Psychometric Properties of LIWC2007. Austin, TX: LIWC (www.liwc.net).
Perkins, R. and Grant, T. (2018) Native language influence detection for forensic authorship analysis: identifying L1 Persian bloggers. International Journal of Speech Language and the Law 25(1): 1–20. https://doi.org/10.1558/ijsll.30844
Rabon, D. (1996) Investigative Discourse Analysis. Durham, NC: Carolina Academic Press.
Raskin, D. C. and Esplin, P. W. (1991) Statement validity assessment: interview procedures and content analysis of children’s statements of sexual abuse. Behavioral Assessment 13: 265–291.
Ricci, F. and Wietsma, R. (2006) Product reviews in travel decision-making. In M. Hitz, M. Sigala and J. Murphy (eds) Information and Communication Technologies in Tourism 296–307. Vienna: Springer. https://doi.org/10.1007/3-211-32710-X_41
Sen, S. and Lerman, D. (2007) ‘Why are you telling me this?’ An examination into negative consumer reviews on the Web. Journal of Interactive Marketing 21(4): 76–94. https://doi.org/10.1002/dir.20090
Shuy, R. W. (2013) Deceit, distress and false imprisonment: the anatomy of a car sales event. International Journal of Speech, Language and the Law 1(2): 133–149. https://doi.org/10.1558/ijsll.v1i2.133
Steller, M. and Köhnken, G. (1989) Criteria based statement analysis. In D. C. Raskin (ed.) Psychological Methods for Criminal Investigation and Evidence 217–245. New York: Springer.
Tagliamonte, S. and D’Arcy, A. (2004) He’s like, she’s like: the quotative system in Canadian youth. Journal of Sociolinguistics 8(4): 493–514. https://doi.org/10.1111/j.1467-9841.2004.00271.x
Tannen, D. (1986) Introducing constructed dialogue in Greek and American conversational and literary narrative. In F. Coulmas (ed.) Direct and Indirect Speech 311–322. Berlin: Mouton de Gruyter.
Tannen, D. (2007) Talking Voices: Repetition, Dialogue, and Imagery in Conversational Discourse. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511618987
Undeutsch, U. (1967) Beurteilung der Glaubhaftigkeit von Aussagen. In U. Undeutsch (ed.) Handbuch der Psychologie vol. 11: Forensische Psychologie 26–181. Göttingen: Hogrefe.
Undeutsch, U. (1989) The development of statement reality analysis. In J. C. Yuille (ed.) Credibility Assessment 101–119. London: Kluwer. https://doi.org/10.1007/978-94-015-7856-1_6
Vásquez, C. (2011) Complaints online: the case of TripAdvisor. Journal of Pragmatics 43(6): 1707–1717. https://doi.org/10.1016/j.pragma.2010.11.007
Vásquez, C. (2012) Narrativity and involvement in online consumer reviews: the case of TripAdvisor. Narrative Inquiry 22(1): 105–121. https://doi.org/10.1075/ni.22.1.07vas
Vásquez, C. (2014) The Discourse of Online Consumer Reviews. New York: Bloomsbury
Vrij, A. (2015) Verbal lie detection tools: statement validity analysis, reality monitoring and scientific content analysis. In P. A. Granhag, A. Vrij and B. Verschuere (eds) Detecting Deception: Current Challenges and Cognitive Approaches 1–35. Chichester: Wiley Blackwell. https://doi.org/10.1002/9781118510001.ch1
Weisburd, D. and Britt, C. (2014) Statistics in Criminal Justice (4th edn). New York: Springer. https://doi.org/10.1007/978-1-4614-9170-5
Yen, C. and Tang, C. (2019) The effects of hotel attribute performance on electronic word-of mouth (eWOM) behaviors. International Journal of Hospitality Management 76: 9–18. https://doi.org/10.1016/j.ijhm.2018.03.006
