HLTH 434 FINAL QUESTIONS AND
ANSWERS
Describe-the-difference-between-validity-and-reliability---ans-✔✔Reliability-means-that-
there-is-a-consistency-of-measurement-either:-
a)-over-time-(e.g.,-pre‐test/post‐test),-
b)-between-forms-or-versions-of-the-questionnaire,-
c)-across-items,-or-
d)-between-raters-or-observers.
Validity-means-there-is-evidence-that-the-inferences-[or-the-conclusions]-that-are-made-
from
the-scores-on-a-scale-can-be-supported.
Describe-the-four-different-sources-of-reliability-estimates.-What-are-you-looking-for-with-
each-estimate?---ans-✔✔1)-stability-(over-time)-
2)-internal-consistency-(over-items-or-sets-of-items-in-scale)
3)-equivalence-(between-forms-or-versions-of-scale)-
4)-inter‐rater-(between-raters-or-observers)
Describe-reasons-that-validity-and-reliability-are-important-for-evaluation.---ans-✔✔One-
reason-it
is-important-to-know-about-validity-and-reliability,-so-you-can-make-correct-choices-for-
data-collection
instruments.
If-we-are-using-data-collection-instruments-that-will-not-result-in-valid-or-reliable-data-we-
will-not-be-able
to-make-any-conclusions-about-the-effectiveness-of-our-intervention.
What-is-the-difference-between-true-score-and-error.-What-is-the-reason-it-is-important-for-
evaluation?---ans-✔✔Think-of-true-score-as
the-actual-value-or-level-of-a-characteristic,-trait-or-attribute-that-you-are-trying-to-measure.
Error"-is-comprised-of-things-that-may-mask-the-true-level-of-an-attribute,-behavior
we-are-measuring
Know-where-to-go-to-look-for-existing-instruments---ans-✔✔You-find-scales-and-
instruments-by-looking-in-the
, peer‐reviewed-literature.-You-can-do-a-search-on-Google-scholar.-You-can-also-search-
the-BYU-Library
website-and-talk-to-a-university-librarian.-Another-good-place-to-find-questions,-scales-
and-instruments-is
on-government‐based-websites-such-as-cdc.gov,-nih.gov,-and-cancer.gov
Terms-to-know-definition-for:-scale,-item,-questionnaire---ans-✔✔Item-=-a-question-that-
the-respondent-will-answer
Scale-=-a-set-of-items-that-are-related-and-when-combined-measure-a-trait,-attribute-or-
behavior.
Questionnaire-or-survey-instrument-=-items-and-scales-that-are-compiled-and-then-given-
to-respondents
through-various-data-collection-methods,-including-self‐administered-survey,-electronic-
survey,-or
interviewer‐administered-survey.-This-may-also-be-referred-to-as-a-test.-A-questionnaire-
may-contain
many-scales;-it-may-contain-no-scales-but-several-items.
In-what-situations-would-you-create-your-own-questions-versus-finding-existing-scales-or-
questionnaires?---ans-✔✔On-some-occasions,
you-will-create-your-own-questions.-This-is-most-common-as-you-work-on-process-
evaluations,-both-mid‐
course-and-summative.-The-reason-that-it-is-most-common-for-process-evaluations-is-that-
you-are
evaluating-the-program-or-intervention-and-that-is-unique-to-your-agency-or-organization.
In-contrast,-to-measure-impact-or-outcome-objectives-during-a-summative-evaluation-we-
want-to-say-we
made-a-difference-in-changing-knowledge,-attitudes,-behaviors,-illness-or-death.-
Measuring-these
indicators-accurately-can-be-difficult.-You-will-want-to-use-items-and/or-scales-that-have-
been-used-by
other-researchers
define-quality-improvement---ans-✔✔Quality-improvement-techniques-are-specifically-
developed-to-help-close-gaps-between-current-and-desired-performances-for-care-
populations.-The-application-of-quality-improvement-methods-in-general-practice-is-
resulting-in-measurable-improvement-in-population-health-services,-which-translates-to-
enhanced-health-status-of-populations.-
-
-
-Quality-improvement-in-population-health-is-defined-as-the-application-of-quality-
improvement-methods-and-techniques-to-improve-a-specific-process-with-a-defined-
beginning-and-end,-using-an-identified-quality-improvement-model
ANSWERS
Describe-the-difference-between-validity-and-reliability---ans-✔✔Reliability-means-that-
there-is-a-consistency-of-measurement-either:-
a)-over-time-(e.g.,-pre‐test/post‐test),-
b)-between-forms-or-versions-of-the-questionnaire,-
c)-across-items,-or-
d)-between-raters-or-observers.
Validity-means-there-is-evidence-that-the-inferences-[or-the-conclusions]-that-are-made-
from
the-scores-on-a-scale-can-be-supported.
Describe-the-four-different-sources-of-reliability-estimates.-What-are-you-looking-for-with-
each-estimate?---ans-✔✔1)-stability-(over-time)-
2)-internal-consistency-(over-items-or-sets-of-items-in-scale)
3)-equivalence-(between-forms-or-versions-of-scale)-
4)-inter‐rater-(between-raters-or-observers)
Describe-reasons-that-validity-and-reliability-are-important-for-evaluation.---ans-✔✔One-
reason-it
is-important-to-know-about-validity-and-reliability,-so-you-can-make-correct-choices-for-
data-collection
instruments.
If-we-are-using-data-collection-instruments-that-will-not-result-in-valid-or-reliable-data-we-
will-not-be-able
to-make-any-conclusions-about-the-effectiveness-of-our-intervention.
What-is-the-difference-between-true-score-and-error.-What-is-the-reason-it-is-important-for-
evaluation?---ans-✔✔Think-of-true-score-as
the-actual-value-or-level-of-a-characteristic,-trait-or-attribute-that-you-are-trying-to-measure.
Error"-is-comprised-of-things-that-may-mask-the-true-level-of-an-attribute,-behavior
we-are-measuring
Know-where-to-go-to-look-for-existing-instruments---ans-✔✔You-find-scales-and-
instruments-by-looking-in-the
, peer‐reviewed-literature.-You-can-do-a-search-on-Google-scholar.-You-can-also-search-
the-BYU-Library
website-and-talk-to-a-university-librarian.-Another-good-place-to-find-questions,-scales-
and-instruments-is
on-government‐based-websites-such-as-cdc.gov,-nih.gov,-and-cancer.gov
Terms-to-know-definition-for:-scale,-item,-questionnaire---ans-✔✔Item-=-a-question-that-
the-respondent-will-answer
Scale-=-a-set-of-items-that-are-related-and-when-combined-measure-a-trait,-attribute-or-
behavior.
Questionnaire-or-survey-instrument-=-items-and-scales-that-are-compiled-and-then-given-
to-respondents
through-various-data-collection-methods,-including-self‐administered-survey,-electronic-
survey,-or
interviewer‐administered-survey.-This-may-also-be-referred-to-as-a-test.-A-questionnaire-
may-contain
many-scales;-it-may-contain-no-scales-but-several-items.
In-what-situations-would-you-create-your-own-questions-versus-finding-existing-scales-or-
questionnaires?---ans-✔✔On-some-occasions,
you-will-create-your-own-questions.-This-is-most-common-as-you-work-on-process-
evaluations,-both-mid‐
course-and-summative.-The-reason-that-it-is-most-common-for-process-evaluations-is-that-
you-are
evaluating-the-program-or-intervention-and-that-is-unique-to-your-agency-or-organization.
In-contrast,-to-measure-impact-or-outcome-objectives-during-a-summative-evaluation-we-
want-to-say-we
made-a-difference-in-changing-knowledge,-attitudes,-behaviors,-illness-or-death.-
Measuring-these
indicators-accurately-can-be-difficult.-You-will-want-to-use-items-and/or-scales-that-have-
been-used-by
other-researchers
define-quality-improvement---ans-✔✔Quality-improvement-techniques-are-specifically-
developed-to-help-close-gaps-between-current-and-desired-performances-for-care-
populations.-The-application-of-quality-improvement-methods-in-general-practice-is-
resulting-in-measurable-improvement-in-population-health-services,-which-translates-to-
enhanced-health-status-of-populations.-
-
-
-Quality-improvement-in-population-health-is-defined-as-the-application-of-quality-
improvement-methods-and-techniques-to-improve-a-specific-process-with-a-defined-
beginning-and-end,-using-an-identified-quality-improvement-model
