Creativity and Multimodality
Analytical Framework for Creativity in Multimodal Texts (AFCMT)
DOI:
https://doi.org/10.1558/lhs.33598Keywords:
creativity, pattern, multimodality, digital art, logo, song, social mediaAbstract
Creativity studies have been expanding into multimodality in recent years, particularly in the field of computational creativity (Elgammal and Saleh, 2015) and cognitive science (Gardner, 2008). Comparatively, linguistics is far behind in productivity in this area. A key linguistic contribution by Carter (2004) theorizes creativity in everyday common talk into two main categories: pattern-reforming and patternforming. This paper extends Carter’s (2004) hypothesis on linguistic creativity to multimodal texts. Inspired by the concept of ‘given’ and ‘new’ from Halliday’s (1967) information status, a new framework for creativity analysis is proposed and discussed in detail using scenes from TV drama House M.D., movie Casablanca (1942), sitcom Blackadder the Third (1987), digital arts such as logos of the Hong Kong Polytechnic University, Tesla Inc., Hotel ICON, fractal art from the novel Jurassic Park (1990) as well as viral MTV of Pen-Pineapple-Apple-Pen – PPAP Song (2016). This paper also discusses the importance of a base unit of creativity to both the creator and the target. Special attention is placed on endo-referenced and exoreferenced creativity, and their relationship with the implicitness and explicitness of the formula of creativity construction.
References
ACC. (2016). About Computational Creativity. Retrieved March 11, 2017, from Association for Computational Creativity: http://computationalcreativity.net/home/about/computational-creativity/
Ahamo. (2015). A Conversation With Koko The Gorilla: Full Documentary. Retrieved from YouTube: https://www.youtube.com/watch?v=8oh1uhrdc6w&feature=youtu.be&t=29m27s
Arashi Ni Shiyagare 嵐にしやがれ. (2016). 秘店 ARASHI，Nino X PPAP. Retrieved from bilibili.com: http://www.bilibili.com/video/av7347379/
BBC. (2010). C is for Contrafibularity – Blackadder –BBC. Retrieved from YouTube: https://www.youtube.com/watch?v=hOSYiT2iG08
Boden, M. A. (1994). What is Creativity? In M. A. Boden (Ed.), Dimensions of Creativity, 75–117. Cambridge, MA: MIT Press. DOI: https://doi.org/10.7551/mitpress/2437.001.0001
Boden, M. A. (1998). Creativity and artificial intelligence. Artificial Intelligence, 103: 347–356. https://doi.org/10.1016/s0004-3702(98)00055-1 DOI: https://doi.org/10.1016/S0004-3702(98)00055-1
Boden, M. A. (2004). The Creative Mind: Myths and Mechanisms (2nd edn). London: Routledge. DOI: https://doi.org/10.4324/9780203508527
Boden, M. A. (2009). Computer Models of Creativity. AI Magazine, 30 (3): 23–34. DOI: https://doi.org/10.1609/aimag.v30i3.2254
Carter, R. (1999). Common language: Corpus, creativity and cognition. Language and Literature, 8 (3): 195–216. https://doi.org/10.1177/096394709900800301 DOI: https://doi.org/10.1177/096394709900800301
Carter, R. (2004). Language and Creativity: The Art of Common Talk. London: Routledge.
Cohen, H. (1999). Coloring without seeing: A problem in machine creativity. AISB Quarterly, 102: 26–35.
Curtiz, M. (Dir.). (1942). Casablanca [Motion Picture].
Edison Tech Center. (2014). Electric Motor: Model S, Tesla Motors. Retrieved February 19, 2017, from YouTube: https://youtu.be/NaV7V07tEMQ
Elgammal, A. and Saleh, B. (2015). Quantifying creativity in art networks. ICCC 2015: The Sixth International Conference on Computational Creativity, 39–46. Park City, UT, USA: Brigham Young University.
Gardner, H. (2008). Art, Mind, and Brain: A Cognitive Approach to Creativity. Madison, WI: Basic Books.
Halliday, M. (1967). Notes on Transitivity and Theme in English: Part 2. Journal of Linguistics, 3 (2): 199–244. DOI: https://doi.org/10.1017/S0022226700016613
Halliday, M. (1993). Towards a language-based theory of learning. Linguistics and Education, 5 (2): 93–116. DOI: https://doi.org/10.1016/0898-5898(93)90026-7
Halliday, M. and Matthiessen, C. M. (1999 [2006]). Construing Experience Through Meaning: A Language-based Approach to Cognition. London and New York: Continuum.
Hotel Online (2011). 262-room Hotel ICON opens in Hong Kong. Retrieved from Hotel Online : http://www.hotel-online.com/News/PR2011_2nd/Jun11_HotelICON.html
ICCC (2010). Welcome to ICCC X — ICCC Xity. Retrieved from First International Conference on Computational Creativity: http://computationalcreativity.net/iccc2010/
ICCC (2016). Conferences. Retrieved from Association for Computational Creativity: http://computationalcreativity.net/home/conferences/
Kress, G. and van Leeuwen, T. (2006 [1996]). Reading Images: The Grammar of Visual Design. (2nd edn) London and New York: Routledge. DOI: https://doi.org/10.4324/9780203619728
Lambert, F. (2017). Elon Musk confirms that Tesla’s logo is the cross section of an electric motor. Retrieved February 18, 2017, from Electrek.co: https://electrek.co/2017/01/24/tesla-logo-cross-section-electric-motor/
Lynch, K. (2016). Video: Pikotaro performs Pen-Pineapple-Apple-Pen at certificate ceremony as song sets Billboard chart record. Retrieved March 23, 2017, from Guinness World Records: http://www.guinnessworldrecords.com/news/2016/10/video-pikotaro-performs-pen-pineapple-apple-pen-at-certificate-ceremony-as-song-449045
Musk, E. (2017). @elonmusk. Retrieved from Twitter: https://twitter.com/elonmusk/status/822180663285514240?ref_src=twsrc%5Etfw
Nature (Dir.). (1999). A Conversation with Koko [Motion Picture].
NBC Universial International. (2017). House And Cuddy’s First Fight | House M.D. Retrieved from YouTube: https://youtu.be/0PuCx5Q9r4I?t=57
NBC Universial International. (2017). House’s Stalker | House M.D. Retrieved from YouTube: https://youtu.be/wQCj-pLmBko?t=411
O’Toole, M. (1994). The Language of Displayed Art. Cranbury, NJ: Associated University Presses.
Parkstone. (2014). ‘Everything starts from a dot’, Wassily Kandinsky. Retrieved April 25, 2017, from Wassily Kandinsky: https://wassily-kandinsky.us/2014/11/18/everything-starts-from-a-dot-wassily-kandinsky/
Random, J. (2003). Blackadder the Third: A Dictionary. Retrieved from Reviewers Choice: http://www.reviewers-choice.com/blackadder_the_third.htm
Straits Times. (2016). Piko-Taro explains his creative process for Pen-Pineapple-Apple-Pen. Retrieved from YouTube: https://www.youtube.com/watch?v=QwoqIsgLS-I
Tesla Motors, Inc. (2012). Patent US8154167 – Induction motor lamination design. Retrieved from Google Patents: https://www.google.com/patents/US8154167
The Gorilla Foundation. (2017). Scientific Goals & History | koko.org. Retrieved from The Gorilla Foundation: http://www.koko.org/scientific-goals-history
The Hong Kong Polytechnic University. (2014). PolyU Glossary – Our Logo 校徽釋義. Retrieved February 21, 2017, from The Hong Kong Polytechnic University: https://www.polyu.edu.hk/web/glossary/en/appendix/our_logo/index.html
Vo, T. A. and Carter, R. (2010). What can a corpus tell us about creativity? In A. O’Keeffe and M. McCarthy (Eds), The Routledge Handbook of Corpus Linguistics, 302–315. Abingdon: Routledge. https://doi.org/10.4324/9780203856949.ch22 DOI: https://doi.org/10.4324/9780203856949-22
YouTube. (2006). Casablanca – We’ll Always Have Paris. Retrieved from YouTube: https://www.youtube.com/watch?v=pa-dGYjSq5k
公式ピコ太郎歌唱ビデオチャンネル -PIKOTARO OFFICIAL CHANNEL. (2016, August 25). Pen-Pineapple-Apple-Pen/PIKO-TARO. Retrieved from YouTube: https://www.youtube.com/watch?v=0E00Zuayv9Q
Published
How to Cite
Issue
Section
