Introduced here by its guest editors, this special issue of Poetics Today focuses on multimodal media. Its purpose is twofold. On the one hand, it aims to explore the multimodal combination of semiotic resources in a range of primarily aesthetic media forms that until now have attracted comparatively little attention in multimodality studies, including not only multimodal novels, comics, and films but also current television programs, video games, and other forms of digital media. On the other hand, and no less importantly, the articles collected here engage with previously under-explored dimensions of multimodality and thus expand our understanding of what multimodality can mean, including not only perceptual and semiotic but also referential and participatory multimodality.
The text of this article is only available as a PDF.
References
Bateman, John A.
2008
. Multimodality and Genre: A Foundation for the Systematic Analysis of Multimodal Documents
. Basingstoke, UK
: Palgrave Macmillan
.Bateman, John A.
2014
. Text and Image: A Critical Introduction to the Visual/Verbal Divide
. New York
: Routledge
.Bateman, John A.; Schmidt, Karl-Heinrich.
2012
. Multimodal Film Analysis: How Films Mean
. New York
: Routledge
.Bateman, John A.; Wildfeuer, Janina.
2014
. “A Multimodal Discourse Theory of Visual Narrative
.” Journal of Pragmatics
74
: 180
–208
.Bolter, Jay David; Grusin, Richard.
1998
. Remediation: Understanding New Media
. Cambridge, MA
: MIT Press
.Cohn, Neil.
2013
. The Visual Language of Comics: Introduction to the Structure and Cognition of Sequential Images
. London
: Bloomsbury
.Elleström, Lars.
2010
. “The Modalitites of Media: A Model for Understanding Intermedial Relations
.” In Media Borders, Multimodality, and Intermediality
, edited by Elleström, Lars, 11
–50
. Basingstoke, K
: Palgrave Macmillan
.Forceville, Charles.
2006
. “Non-verbal and Multimodal Metaphor in a Cognitivist Framework: Agendas for Research
.” In Cognitive Linguistics: Current Applications and Future Perspectives
, edited by Kristiansen, Gitte; Achard, Michel; Dirven, René; Ruiz de Mendoza Ibáñez, Francisco J., 379
–402
. Berlin
: De Gruyter
.Forceville, Charles; Urios-Aparisi, Eduardo, eds.
2009
. Multimodal Metaphor
. Berlin
: De Gruyter
.Fricke, Ellen.
2012
. Grammatik multimodal: Wie Wörter und Gesten zusammenwirken
. Berlin
: De Gruyter
.Gibbons, Alison.
2012
. Multimodality, Cognition, and Experimental Literature
. New York
: Routledge
.Hallet, Wolfgang.
2014
. “The Rise of the Multimodal Novel: Generic Change and Its Narratological Implications
.” In Storyworlds across Media: Toward a Media-Conscious Narratology
, edited by Ryan, Marie-Laure; Thon, Jan-Noël, 151
–72
. Lincoln
: University of Nebraska Press
.Jewitt, Carey, ed.
2009b
. The Routledge Handbook of Multimodal Analysis
. London
: Routledge
.Kress, Gunther.
2010
. Multimodality: A Social Semiotic Approach to Contemporary Communication
. Abingdon, UK
: Routledge
.Kress, Gunther; Leeuwen, Theo van.
1996
. Reading Images: The Grammar of Visual Design
. Abingdon, UK
: Routledge
.Kress, Gunther; Leeuwen, Theo van.
2001
. Multimodal Discourse: The Modes and Media of Contemporary Communication
. London
: Arnold
.Levine, Philip; Scollon, Ronald, eds.
2004
. Discourse and Technology: Multimodal Discourse Analysis
. Washington, DC
: Georgetown University Press
.McLuhan, Marshall.
1964
. Understanding Media: The Extensions of Men
. New York
: McGraw-Hill
.Mittelberg, Irene.
2006
. “Metaphor and Metonymy in Language and Gesture: Discourse Evidence for Multimodal Models of Grammar
.” PhD diss
., Cornell University
.Norris, Sigrid.
2011
. Identity in (Inter)Action: Introducing Multimodal (Inter)Action Analysis
. Berlin
: De Gruyter
.O’Halloran, Kay L.
2005
. Mathematical Discourse: Language, Symbolism, and Visual Images
. London
: Continuum
.O’Toole, Michael.
1994
. The Language of Displayed Art
. Rutherford, NJ
: Fairleigh Dickinson University Press
.Page, Ruth, ed.
2010b
. New Perspectives on Narrative and Multimodality
. New York
:Routledge
.Ryan, Marie-Laure.
2006
. Avatars of Story
. Minneapolis
: University of Minnesota Press
.Sachs-Hombach, Klaus.
2003
. Das Bild als kommunikatives Medium: Elemente einer allgemeinen Bildwissenschaft
. Cologne
: Herbert von Halem
.Sachs-Hombach, Klaus; Bateman, John A.; Curtis, Robin; Ochsner, Beate; Thies, Sebastian.
2018
. “Medienwissenschaftliche Multimodalitätsforschung
.” MEDIENwissenschaft
1
/2018
: 8
–26
.Schmidt, Siegfried J.
2000
. Kalte Faszination: Medien—Kultur—Wissenschaft in der Mediengesellschaft
. Weilerswist, Germany
: Velbrück Wissenschaft
.Schneider, Jan G.; Stöckl, Hartmut, eds.
2011
. Medientheorien und Multimodalität: Ein TV-Werbespot—Sieben methodische Beschreibungsansätze
. Cologne
: Herbert von Halem
.Stöckl, Hartmut.
1997
. Werbung in Wort und Bild: Textstil und Semiotik englischsprachiger Anzeigenwerbung
. Frankfurt am Main
: Lang
.Thon, Jan-Noël.
2016
. Transmedial Narratology and Contemporary Media Culture
. Lincoln
: University of Nebraska Press
.Wildfeuer, Janina.
2014
. Film Discourse Interpretation: Towards a New Paradigm for Multimodal Film Analysis
. New York
: Routledge
.Copyright © 2019 by Porter Institute for Poetics and Semiotics
2019
This content is made freely available by the publisher. It may not be redistributed or altered. All rights reserved.
Issue Section:
Multimodal Media
