Human Media Interaction Theory
Literature summary
Lecture 1 User engagement
Clicking, Assessing, Immersing, and Sharing: An Empirical Model of User
Engagement with Interactive Media p. 2
Lecture 2
Serious games for people with mental disorders: State of the art of practices
to maintain engagement and accessibility p. 5
A serious game to improve engagement with web accessibility guidelines
p. 7
Lecture 3 Perception and attention
Smartphones and attention, curse or blessing? – A review on the effects of
smartphone usage on attention inhibition, and working memory p. 8
Assessing dimensions of perceived visual aesthetics of websites
p. 10
Lecture 4 Attention and cognitive load
Measurement of cognitive load in multimedia learning: a comparison of
different objective measures p. 11
Lecture 5 Memory in the digital age
Socio-technical lifelogging: deriving design principles for a future proof
digital past p. 14
Lecture 6 Learning and digital games
Digital game-based learning: Towards an experiential gaming model
p. 16
Lecture 7 Emotion and motivation
Emotional design in digital media for learning
p. 21
1
,Uses and grats 2.0: new gratifications for new media p.
28
Lecture 8 Media multitasking
Minds and brains of media multitaskers: Current findings and future
Directions p. 32
Media multitasking and cognitive control: A systematic review of
Interventions p.
33
Lecture 9 Social cognition and embodied cognition in VR
The effect of embodied experiences on self-other merging, attitude, and
helping behavior p. 35
Lecture 10 New media and addiction
Social networking sites and addiction: Ten lessons learned
p. 37
Lecture 1 User engagement
Clicking, Assessing, Immersing, and Sharing: An Empirical Model of
User Engagement with Interactive Media
The current focus with user engagement is toward more active outcomes where users can
make their presence felt via various activities, including spreading and sharing media content,
as has become common in online social media.
User engagement
Has become an essential outcome of active user-system interaction afforded by unique
technological features such as interactivity.
The term engagement seems to have two common factors:
1. To enter into a contact and to occupy attention or involve effort for a long period of
time view the concept of engagement as a process including both the point of
engagement and the period of engagement.
2. Distinguishing the psychological dimension from the behavioral dimension.
Also a meaningful way of defining user engagement:
Users’ actual behavior, such as clicking hidden content and exploring interactive
features online advertising industry
Previous definitions of user engagement:
A strong cognitive and emotional focus on media content that completely immerses
users in a mediated experience.
A phenomenon where viewers or readers are completely invested in the unfolding of
the media content, often oblivious to the surrounding environment.
A closely related term = absorption
Refers to a state of deep involvement with media.
2
,Slater and Rouner (2002) suggest that engagement, absorption, and transportation refer to the
same phenomenon:
The degree to which a message recipient is cognitively and affectively involved in the
vicarious experience of media interaction.
A conceptual model of user engagement with interactive media should include both users’
attraction of interest toward the medium (interface assessment), as well as subsequent
absorption with content.
User engagement as a behavioral experience: physical interaction and digital outreach
We propose that user engagement as a behavioral experience includes both physical
interaction with interface as well as taking further actions on the content such as managing
and sharing it (digital outreach):
An important facet of user engagement as a behavioral experience includes the many
tangible ways in which users voluntarily interact with an interface: physical
interaction.
A related form of user engagement in interactive media is the triaging and organizing
of content for future use.
The most important aspect of user engagement is social outreach that extends their
experience with media into the offline realm “viral”
o Virality of messages is based on users’ voluntary behavior of forwarding the
brand message to other users.
New definition of user engagement
A form of user experience which includes both
1. a psychological state where the user appraises the quality of media and
becomes absorbed in media content and
2. a behavioral experience in which the user physically interacts with the
interface and also socially distributes and manages the content.
Conceptual model of user engagement
Four critical components:
1. Physical interaction;
2. Interface assessment;
3. Absorption;
4. Digital outreach.
3
, Physical interaction
The amount of observable activity of users with the interface.
o Eye-tracking software can be applied to directly measure this type of viewer
engagement
Interface assessment
Users’ initial evaluation of the interface.
Pervious literature suggests that three criteria for evaluating the interface can dominate the
user’s preliminary perceptual assessment of the interface:
1. Natural mapping ability;
o The ability of a system to map its control to changes in the mediated
environment in a natural and predictable manner.
An ideal natural mapping strategy follows the natural actions as
closely as possible;
Can function as a precursor for further engaging experiences such as
a touch screen with gravity or inertia.
2. Intuitiveness;
o The extent to which it allows the user to unconsciously utilize stored
experiential knowledge that can lead to effective interaction.
3. Ease of use;
o A system that is easy to use requires little physical or mental effort.
It’s a significant predictor of user attitudes and behavioral intentions
toward interactive technologies;
Natural mapping and intuitiveness are closely related to the
perception of ease of use.
Interface assessment, as a preliminary stage of user engagement, can be operationalized as the
extent to which the user perceives the interface as natural, intuitive, and easy to use, which
would lead to further psychological involvement with media content.
Absorption
Signals deeper involvement with the content.
4
Literature summary
Lecture 1 User engagement
Clicking, Assessing, Immersing, and Sharing: An Empirical Model of User
Engagement with Interactive Media p. 2
Lecture 2
Serious games for people with mental disorders: State of the art of practices
to maintain engagement and accessibility p. 5
A serious game to improve engagement with web accessibility guidelines
p. 7
Lecture 3 Perception and attention
Smartphones and attention, curse or blessing? – A review on the effects of
smartphone usage on attention inhibition, and working memory p. 8
Assessing dimensions of perceived visual aesthetics of websites
p. 10
Lecture 4 Attention and cognitive load
Measurement of cognitive load in multimedia learning: a comparison of
different objective measures p. 11
Lecture 5 Memory in the digital age
Socio-technical lifelogging: deriving design principles for a future proof
digital past p. 14
Lecture 6 Learning and digital games
Digital game-based learning: Towards an experiential gaming model
p. 16
Lecture 7 Emotion and motivation
Emotional design in digital media for learning
p. 21
1
,Uses and grats 2.0: new gratifications for new media p.
28
Lecture 8 Media multitasking
Minds and brains of media multitaskers: Current findings and future
Directions p. 32
Media multitasking and cognitive control: A systematic review of
Interventions p.
33
Lecture 9 Social cognition and embodied cognition in VR
The effect of embodied experiences on self-other merging, attitude, and
helping behavior p. 35
Lecture 10 New media and addiction
Social networking sites and addiction: Ten lessons learned
p. 37
Lecture 1 User engagement
Clicking, Assessing, Immersing, and Sharing: An Empirical Model of
User Engagement with Interactive Media
The current focus with user engagement is toward more active outcomes where users can
make their presence felt via various activities, including spreading and sharing media content,
as has become common in online social media.
User engagement
Has become an essential outcome of active user-system interaction afforded by unique
technological features such as interactivity.
The term engagement seems to have two common factors:
1. To enter into a contact and to occupy attention or involve effort for a long period of
time view the concept of engagement as a process including both the point of
engagement and the period of engagement.
2. Distinguishing the psychological dimension from the behavioral dimension.
Also a meaningful way of defining user engagement:
Users’ actual behavior, such as clicking hidden content and exploring interactive
features online advertising industry
Previous definitions of user engagement:
A strong cognitive and emotional focus on media content that completely immerses
users in a mediated experience.
A phenomenon where viewers or readers are completely invested in the unfolding of
the media content, often oblivious to the surrounding environment.
A closely related term = absorption
Refers to a state of deep involvement with media.
2
,Slater and Rouner (2002) suggest that engagement, absorption, and transportation refer to the
same phenomenon:
The degree to which a message recipient is cognitively and affectively involved in the
vicarious experience of media interaction.
A conceptual model of user engagement with interactive media should include both users’
attraction of interest toward the medium (interface assessment), as well as subsequent
absorption with content.
User engagement as a behavioral experience: physical interaction and digital outreach
We propose that user engagement as a behavioral experience includes both physical
interaction with interface as well as taking further actions on the content such as managing
and sharing it (digital outreach):
An important facet of user engagement as a behavioral experience includes the many
tangible ways in which users voluntarily interact with an interface: physical
interaction.
A related form of user engagement in interactive media is the triaging and organizing
of content for future use.
The most important aspect of user engagement is social outreach that extends their
experience with media into the offline realm “viral”
o Virality of messages is based on users’ voluntary behavior of forwarding the
brand message to other users.
New definition of user engagement
A form of user experience which includes both
1. a psychological state where the user appraises the quality of media and
becomes absorbed in media content and
2. a behavioral experience in which the user physically interacts with the
interface and also socially distributes and manages the content.
Conceptual model of user engagement
Four critical components:
1. Physical interaction;
2. Interface assessment;
3. Absorption;
4. Digital outreach.
3
, Physical interaction
The amount of observable activity of users with the interface.
o Eye-tracking software can be applied to directly measure this type of viewer
engagement
Interface assessment
Users’ initial evaluation of the interface.
Pervious literature suggests that three criteria for evaluating the interface can dominate the
user’s preliminary perceptual assessment of the interface:
1. Natural mapping ability;
o The ability of a system to map its control to changes in the mediated
environment in a natural and predictable manner.
An ideal natural mapping strategy follows the natural actions as
closely as possible;
Can function as a precursor for further engaging experiences such as
a touch screen with gravity or inertia.
2. Intuitiveness;
o The extent to which it allows the user to unconsciously utilize stored
experiential knowledge that can lead to effective interaction.
3. Ease of use;
o A system that is easy to use requires little physical or mental effort.
It’s a significant predictor of user attitudes and behavioral intentions
toward interactive technologies;
Natural mapping and intuitiveness are closely related to the
perception of ease of use.
Interface assessment, as a preliminary stage of user engagement, can be operationalized as the
extent to which the user perceives the interface as natural, intuitive, and easy to use, which
would lead to further psychological involvement with media content.
Absorption
Signals deeper involvement with the content.
4
