INF4820
Human Computer Interaction
Student 69484139
,
,Chapter 1: Introduction
User experience involves a person interacting with a product, system, or interface. It
encompasses the entire interaction, including thoughts, feelings, and perceptions.
While usability focuses on task success, UX takes a broader view of the complete
interaction experience.
UX Metrics Fundamentals
Metrics are quantifiable measurements
that reveal insights about user interactions
Must be observable (directly/indirectly) and measurable
Evaluate aspects like efficiency, satisfaction, and effectiveness
Help answer questions about product recommendations, efficiency improvements,
and competitive advantages
Value of UX Metrics
1. Adds structure to design and evaluation processes
2. Provides insights into findings
3. Informs decision-makers
4. Reveals patterns that might be otherwise invisible
5. Demonstrates improvements between product iterations
Modern Technologies
Eye tracking (e.g., Tobii, SMI) for field studies
Affective computing (e.g., Affectiva) combining skin conductance sensors with
facial recognition
Common Misconceptions (Debunked)
1. Metrics require extensive testing - Simple metrics can be collected quickly
2. Too expensive - Can be collected in-house with free tools
3. Not useful for small improvements - Valuable for projects of all sizes
4. Don't show causes - Can reveal problem sources through analysis
5. Too noisy - Data can be cleaned and standardized
6. Gut feeling is enough - Data reduces guesswork
7. Don't work for new products - Essential for establishing baselines
8. Limited applicability - Can measure various aspects (stress, emotions, awareness)
9. Management won't understand - Provides credibility and ROI calculations
10. Requires large sample size - Even 8-10 participants can provide meaningful data
Key Takeaway
UX metrics provide structured, quantifiable insights that improve product
development, user satisfaction, and business decisions. They're adaptable, scalable,
and valuable for organizations of any size.
, Measuring the User Experience: A Study Guide Chapter 1
Short Answer Questions (Answer in 2-3 sentences each)
1. What are the three defining characteristics of user experience (UX)?
2. What is the distinction between usability and user experience?
3. Provide an example of how poor UX design can have serious consequences.
4. Explain how UX metrics differ from other types of metrics.
5. Describe three key questions that UX metrics can help answer.
6. How can UX metrics help in calculating the ROI of a design?
7. Explain the myth that UX metrics are not useful when focusing on small
improvements and why it is incorrect.
8. What are some strategies for mitigating "noise" in UX data?
9. Why is it important to establish baseline UX metrics when evaluating a new product?
10. What are some new technologies impacting the collection and analysis of UX data?
II. Short Answer Question Key
1. UX involves a human user interacting with a product or system with an interface, and
their experience during this interaction is observable and measurable.
2. Usability refers specifically to a user's ability to use a product successfully to
complete tasks, while UX encompasses the broader spectrum of a user's thoughts,
feelings, and perceptions during the entire interaction with the product.
3. In the healthcare industry, poorly designed medical devices or unclear instructions can
lead to patients receiving incorrect medication, potentially resulting in serious health
consequences or even fatalities.
4. UX metrics specifically measure aspects of the human experience when interacting
with a product or system, focusing on effectiveness, efficiency, and satisfaction.
5. UX metrics can answer questions such as: Will users recommend the product? Is the
new design more efficient? How does the product's UX compare to competitors?
6. By measuring improvements in task completion time, error reduction, and customer
satisfaction, UX metrics can be used to quantify cost savings and revenue increases
resulting from a new design, enabling ROI calculations.
7. Even small design improvements can significantly impact user experience. Metrics like
usability issue severity and frequency can guide resource allocation during iterative
design processes, optimizing both time and budget.
8. Strategies to reduce noise include cleaning extreme values from data, choosing
specific metrics that minimize variability, employing well-defined procedures, and
using validated questionnaires.
9. Baseline metrics for a new product provide a point of comparison for future
iterations, allowing designers to track improvements and ensure the design meets
target UX standards before release.
10. Emerging technologies like field-deployable eye-tracking goggles, affective computing
with skin conductance and facial recognition, and sophisticated unmoderated testing
tools are transforming UX data collection and analysis.
Human Computer Interaction
Student 69484139
,
,Chapter 1: Introduction
User experience involves a person interacting with a product, system, or interface. It
encompasses the entire interaction, including thoughts, feelings, and perceptions.
While usability focuses on task success, UX takes a broader view of the complete
interaction experience.
UX Metrics Fundamentals
Metrics are quantifiable measurements
that reveal insights about user interactions
Must be observable (directly/indirectly) and measurable
Evaluate aspects like efficiency, satisfaction, and effectiveness
Help answer questions about product recommendations, efficiency improvements,
and competitive advantages
Value of UX Metrics
1. Adds structure to design and evaluation processes
2. Provides insights into findings
3. Informs decision-makers
4. Reveals patterns that might be otherwise invisible
5. Demonstrates improvements between product iterations
Modern Technologies
Eye tracking (e.g., Tobii, SMI) for field studies
Affective computing (e.g., Affectiva) combining skin conductance sensors with
facial recognition
Common Misconceptions (Debunked)
1. Metrics require extensive testing - Simple metrics can be collected quickly
2. Too expensive - Can be collected in-house with free tools
3. Not useful for small improvements - Valuable for projects of all sizes
4. Don't show causes - Can reveal problem sources through analysis
5. Too noisy - Data can be cleaned and standardized
6. Gut feeling is enough - Data reduces guesswork
7. Don't work for new products - Essential for establishing baselines
8. Limited applicability - Can measure various aspects (stress, emotions, awareness)
9. Management won't understand - Provides credibility and ROI calculations
10. Requires large sample size - Even 8-10 participants can provide meaningful data
Key Takeaway
UX metrics provide structured, quantifiable insights that improve product
development, user satisfaction, and business decisions. They're adaptable, scalable,
and valuable for organizations of any size.
, Measuring the User Experience: A Study Guide Chapter 1
Short Answer Questions (Answer in 2-3 sentences each)
1. What are the three defining characteristics of user experience (UX)?
2. What is the distinction between usability and user experience?
3. Provide an example of how poor UX design can have serious consequences.
4. Explain how UX metrics differ from other types of metrics.
5. Describe three key questions that UX metrics can help answer.
6. How can UX metrics help in calculating the ROI of a design?
7. Explain the myth that UX metrics are not useful when focusing on small
improvements and why it is incorrect.
8. What are some strategies for mitigating "noise" in UX data?
9. Why is it important to establish baseline UX metrics when evaluating a new product?
10. What are some new technologies impacting the collection and analysis of UX data?
II. Short Answer Question Key
1. UX involves a human user interacting with a product or system with an interface, and
their experience during this interaction is observable and measurable.
2. Usability refers specifically to a user's ability to use a product successfully to
complete tasks, while UX encompasses the broader spectrum of a user's thoughts,
feelings, and perceptions during the entire interaction with the product.
3. In the healthcare industry, poorly designed medical devices or unclear instructions can
lead to patients receiving incorrect medication, potentially resulting in serious health
consequences or even fatalities.
4. UX metrics specifically measure aspects of the human experience when interacting
with a product or system, focusing on effectiveness, efficiency, and satisfaction.
5. UX metrics can answer questions such as: Will users recommend the product? Is the
new design more efficient? How does the product's UX compare to competitors?
6. By measuring improvements in task completion time, error reduction, and customer
satisfaction, UX metrics can be used to quantify cost savings and revenue increases
resulting from a new design, enabling ROI calculations.
7. Even small design improvements can significantly impact user experience. Metrics like
usability issue severity and frequency can guide resource allocation during iterative
design processes, optimizing both time and budget.
8. Strategies to reduce noise include cleaning extreme values from data, choosing
specific metrics that minimize variability, employing well-defined procedures, and
using validated questionnaires.
9. Baseline metrics for a new product provide a point of comparison for future
iterations, allowing designers to track improvements and ensure the design meets
target UX standards before release.
10. Emerging technologies like field-deployable eye-tracking goggles, affective computing
with skin conductance and facial recognition, and sophisticated unmoderated testing
tools are transforming UX data collection and analysis.
