Multimodal Communication Exam 12 June 15h
Week 1 - Chapter 1. Introduction: the challenge of multimodality
Way of characterizing communicative situations which rely upon combinations of
different forms of communication to be effective (meaning makings)
It’s a research orientationthat seeks to address how different modes are combined in
the service of making meaning
E.g. Tv programmes using spoken language pictures + texts // book uses written language +
pictures + diagrams
Inter-/ Transdisciplinary Challenge
Each of these diverse situations draws
potentially on different disciplinary
backgrounds
➢ We cannot predict the combinations of modes which we will be confronted with —-- So,
we need methods and conceptual tools that will support us wherever we need to go to
discover what the “multi” in multimodality might be referring to
Example of multimodality:
Each pair is engaged in face-to-face interaction +
discussing information that is displayed on a variety
of electronic devices (smartphone, tablets).
● Multimodal turn: willingness and perceived need to examine combinations of
expressive resources explicitly and systematically.
○ Multimodality in the media: examples of tweets being
multimodal by featuring a photo posted together with
some verbal text and hashtags.
, ○ Media convergence: combination and distribution of different forms of
expression, allowed by digital technologies = super-media – cultural phenomena
E.g. an Ipad showing a film or a newspaper
Curricula: many national school curricula now include the requirement of competencies in
dealing with several media techniques, genres and text types
How meanings can function collectively combining activities of communication:
● Multiplying meanings
○ Emphasize that multimodality is more than just putting two or more modes
together — more emerges from the combination than a simple sum of the parts
(a central issue for multimodal research has been what this “more” might be)
● Semiotic modes
○ Mode = socially shaped and culturally given resource for making meaning (image,
layout, gesture, speech, etc); modes presented together need to be interpreted
with respect to one another and cannot be considered independently =
interdependence
● Communicative situations and media
○ Knowing how to go about investigating how such ensembles of expression work
( What are the activities and media involved? // Who is doing what and how?)
Week 2/3 - Chapter 2. Recognizing Multimodality: origins and inspirations
Problem Space of Multimodality
Provide the basis for multimodality
Materials (physician events/objects in the world)
Senses (acts of interpretation)
Week 1 - Chapter 1. Introduction: the challenge of multimodality
Way of characterizing communicative situations which rely upon combinations of
different forms of communication to be effective (meaning makings)
It’s a research orientationthat seeks to address how different modes are combined in
the service of making meaning
E.g. Tv programmes using spoken language pictures + texts // book uses written language +
pictures + diagrams
Inter-/ Transdisciplinary Challenge
Each of these diverse situations draws
potentially on different disciplinary
backgrounds
➢ We cannot predict the combinations of modes which we will be confronted with —-- So,
we need methods and conceptual tools that will support us wherever we need to go to
discover what the “multi” in multimodality might be referring to
Example of multimodality:
Each pair is engaged in face-to-face interaction +
discussing information that is displayed on a variety
of electronic devices (smartphone, tablets).
● Multimodal turn: willingness and perceived need to examine combinations of
expressive resources explicitly and systematically.
○ Multimodality in the media: examples of tweets being
multimodal by featuring a photo posted together with
some verbal text and hashtags.
, ○ Media convergence: combination and distribution of different forms of
expression, allowed by digital technologies = super-media – cultural phenomena
E.g. an Ipad showing a film or a newspaper
Curricula: many national school curricula now include the requirement of competencies in
dealing with several media techniques, genres and text types
How meanings can function collectively combining activities of communication:
● Multiplying meanings
○ Emphasize that multimodality is more than just putting two or more modes
together — more emerges from the combination than a simple sum of the parts
(a central issue for multimodal research has been what this “more” might be)
● Semiotic modes
○ Mode = socially shaped and culturally given resource for making meaning (image,
layout, gesture, speech, etc); modes presented together need to be interpreted
with respect to one another and cannot be considered independently =
interdependence
● Communicative situations and media
○ Knowing how to go about investigating how such ensembles of expression work
( What are the activities and media involved? // Who is doing what and how?)
Week 2/3 - Chapter 2. Recognizing Multimodality: origins and inspirations
Problem Space of Multimodality
Provide the basis for multimodality
Materials (physician events/objects in the world)
Senses (acts of interpretation)
