Introduced here by its guest editors, this special issue of Poetics Today focuses on multimodal media. Its purpose is twofold. On the one hand, it aims to explore the multimodal combination of semiotic resources in a range of primarily aesthetic media forms that until now have attracted comparatively little attention in multimodality studies, including not only multimodal novels, comics, and films but also current television programs, video games, and other forms of digital media. On the other hand, and no less importantly, the articles collected here engage with previously under-explored dimensions of multimodality and thus expand our understanding of what multimodality can mean, including not only perceptual and semiotic but also referential and participatory multimodality.

References

References
Barthes
Roland
.
1977
.
Image—Music—Text
.
London
:
Fontana
.
Bateman
John A.
2008
.
Multimodality and Genre: A Foundation for the Systematic Analysis of Multimodal Documents
.
Basingstoke, UK
:
Palgrave Macmillan
.
Bateman
John A.
2014
.
Text and Image: A Critical Introduction to the Visual/Verbal Divide
.
New York
:
Routledge
.
Bateman
John A.
Schmidt
Karl-Heinrich
.
2012
.
Multimodal Film Analysis: How Films Mean
.
New York
:
Routledge
.
Bateman
John A.
Wildfeuer
Janina
.
2014
. “
A Multimodal Discourse Theory of Visual Narrative
.”
Journal of Pragmatics
74
:
180
208
.
Bolter
Jay David
Grusin
Richard
.
1998
.
Remediation: Understanding New Media
.
Cambridge, MA
:
MIT Press
.
Cohn
Neil
.
2013
.
The Visual Language of Comics: Introduction to the Structure and Cognition of Sequential Images
.
London
:
Bloomsbury
.
Elleström
Lars
.
2010
. “
The Modalitites of Media: A Model for Understanding Intermedial Relations
.” In
Media Borders, Multimodality, and Intermediality
, edited by
Elleström
Lars
,
11
50
.
Basingstoke, K
:
Palgrave Macmillan
.
Forceville
Charles
.
2006
. “
Non-verbal and Multimodal Metaphor in a Cognitivist Framework: Agendas for Research
.” In
Cognitive Linguistics: Current Applications and Future Perspectives
, edited by
Kristiansen
Gitte
Achard
Michel
Dirven
René
Ruiz de Mendoza Ibáñez
Francisco J.
,
379
402
.
Berlin
:
De Gruyter
.
Forceville
Charles
Urios-Aparisi
Eduardo
, eds.
2009
.
Multimodal Metaphor
.
Berlin
:
De Gruyter
.
Fricke
Ellen
.
2012
.
Grammatik multimodal: Wie Wörter und Gesten zusammenwirken
.
Berlin
:
De Gruyter
.
Gibbons
Alison
.
2012
.
Multimodality, Cognition, and Experimental Literature
.
New York
:
Routledge
.
Hallet
Wolfgang
.
2014
. “
The Rise of the Multimodal Novel: Generic Change and Its Narratological Implications
.” In
Storyworlds across Media: Toward a Media-Conscious Narratology
, edited by
Ryan
Marie-Laure
Thon
Jan-Noël
,
151
72
.
Lincoln
:
University of Nebraska Press
.
Jewitt
Carey
.
2009a
. “
An Introduction to Multimodality
.” In
Jewitt
2009b
,
14
27
.
Jewitt
Carey
, ed.
2009b
.
The Routledge Handbook of Multimodal Analysis
.
London
:
Routledge
.
Kress
Gunther
.
2009
. “
What Is Mode?
” In
Jewitt
2009b
,
54
67
.
Kress
Gunther
.
2010
.
Multimodality: A Social Semiotic Approach to Contemporary Communication
.
Abingdon, UK
:
Routledge
.
Kress
Gunther
Leeuwen
Theo van
.
1996
.
Reading Images: The Grammar of Visual Design
.
Abingdon, UK
:
Routledge
.
Kress
Gunther
Leeuwen
Theo van
.
2001
.
Multimodal Discourse: The Modes and Media of Contemporary Communication
.
London
:
Arnold
.
Levine
Philip
Scollon
Ronald
, eds.
2004
.
Discourse and Technology: Multimodal Discourse Analysis
.
Washington, DC
:
Georgetown University Press
.
Manovich
Lev
.
2001
.
The Language of New Media
.
Cambridge, MA
:
MIT Press
.
McLuhan
Marshall
.
1964
.
Understanding Media: The Extensions of Men
.
New York
:
McGraw-Hill
.
Mittelberg
Irene
.
2006
. “
Metaphor and Metonymy in Language and Gesture: Discourse Evidence for Multimodal Models of Grammar
.”
PhD diss
.,
Cornell University
.
Norris
Sigrid
.
2011
.
Identity in (Inter)Action: Introducing Multimodal (Inter)Action Analysis
.
Berlin
:
De Gruyter
.
O’Halloran
Kay L.
, ed.
2004
.
Multimodal Discourse Analysis
.
London
:
Continuum
.
O’Halloran
Kay L.
2005
.
Mathematical Discourse: Language, Symbolism, and Visual Images
.
London
:
Continuum
.
O’Toole
Michael
.
1994
.
The Language of Displayed Art
.
Rutherford, NJ
:
Fairleigh Dickinson University Press
.
Page
Ruth
.
2010a
. “
Introduction
.” In
Page
2010b
,
1
13
.
Page
Ruth
, ed.
2010b
.
New Perspectives on Narrative and Multimodality
.
New York
:
Routledge
.
Ryan
Marie-Laure
.
2006
.
Avatars of Story
.
Minneapolis
:
University of Minnesota Press
.
Sachs-Hombach
Klaus
.
2003
.
Das Bild als kommunikatives Medium: Elemente einer allgemeinen Bildwissenschaft
.
Cologne
:
Herbert von Halem
.
Sachs-Hombach
Klaus
Bateman
John A.
Curtis
Robin
Ochsner
Beate
Thies
Sebastian
.
2018
. “
Medienwissenschaftliche Multimodalitätsforschung
.”
MEDIENwissenschaft
1
/
2018
:
8
26
.
Schmidt
Siegfried J.
2000
.
Kalte Faszination: Medien—Kultur—Wissenschaft in der Mediengesellschaft
.
Weilerswist, Germany
:
Velbrück Wissenschaft
.
Schneider
Jan G.
Stöckl
Hartmut
, eds.
2011
.
Medientheorien und Multimodalität: Ein TV-Werbespot—Sieben methodische Beschreibungsansätze
.
Cologne
:
Herbert von Halem
.
Stöckl
Hartmut
.
1997
.
Werbung in Wort und Bild: Textstil und Semiotik englischsprachiger Anzeigenwerbung
.
Frankfurt am Main
:
Lang
.
Thon
Jan-Noël
.
2016
.
Transmedial Narratology and Contemporary Media Culture
.
Lincoln
:
University of Nebraska Press
.
van Leeuwen
Theo
.
2005
.
Introducing Social Semiotics
.
Abingdon, UK
:
Routledge
.
Wildfeuer
Janina
.
2014
.
Film Discourse Interpretation: Towards a New Paradigm for Multimodal Film Analysis
.
New York
:
Routledge
.
This content is only available as a PDF.
This content is made freely available by the publisher. It may not be redistributed or altered. All rights reserved.