PH 4800 Exam 2 Questions With
Correct Answers
validity - ANSWER when instruments accurately measure what they are intended to
measure
reliability - ANSWER when instruments consistently measure the same thing that's being
measured
face validity - ANSWER when you and a few colleagues read survey items and make a
subjective judgement if you think the survey items seem to be measuring what you want
the items to measure
construct validity - ANSWER when your survey items accurately measure a concept,
and the items are based on existing knowledge that tells us what characteristics define
that concept
content validity - ANSWER the survey items cover all aspects of the construct being
measured
criterion validity - ANSWER survey items correlate an outside rigorous criterion
internal consistency reliability - ANSWER survey items have strong correlations with
each other
inter-rater reliability - ANSWER when two or more researchers compare and correlate
their observations of something
preliminary review - ANSWER - colleagues review the instrument and give feedback
- achieves face validity
cognitive pretest - ANSWER 1 person from the program's priority population talks out
loud as they complete the survey, saying what they're thinking, and give feedback
pre-pilot - ANSWER 5-6 people from the program's priority population complete the
survey and give feedback
pilot test - ANSWER representative sample of the priority population complete the
survey
simple random sampling - ANSWER random numbers select from a sampling frame
systematic sampling - ANSWER people selected at an equal interval from a sampling
frame
, satisfied sampling - ANSWER make population subgroups and then simple/systematic
sample from each other
cluster sampling - ANSWER randomly select clusters (ex: neighborhoods) and then
simple/systematic sample from each
convenience sampling - ANSWER sampling people who are convenient to recruit
voluntary response sampling - ANSWER sampling people that choose to participate
after seeing an ad
purposive sampling - ANSWER sampling specific people for the purpose of the study
snowball sampling - ANSWER - we ask participants to tell us who else would be
appropriate to be interviewed/surveyed for the study
- useful for when it's hard to recruit certain groups of people
internal validity - ANSWER changes to participants are from the program and not
outside forces
external validity - ANSWER the program can create similar change in other populations
("generalizability")
threat to ex/in validity: history - ANSWER unanticipated event not related to the program
threat to ex/in validity: maturation - ANSWER participants' change due to growth (not the
program)
threat to ex/in validity: testing - ANSWER repeated surveys cause change (not the
program)
threat to ex/in validity: instrumentation - ANSWER instruments/researchers change after
pretest
threat to ex/in validity: selection - ANSWER non-random assignment, or participants
self-select
threat to ex/in validity: social desirability - ANSWER participants tell researchers what
they want
threat to ex/in validity: attrition - ANSWER participants drop out after pretest
threat to ex/in validity: hawthorne - ANSWER people act different when aware of being
watched
threat to ex/in validity: interaction of history and treatment - ANSWER program at a
specific time might not have the same results during a different time
threat to ex/in validity: highly tailored programs - ANSWER programs that have been
developed for niche population
Correct Answers
validity - ANSWER when instruments accurately measure what they are intended to
measure
reliability - ANSWER when instruments consistently measure the same thing that's being
measured
face validity - ANSWER when you and a few colleagues read survey items and make a
subjective judgement if you think the survey items seem to be measuring what you want
the items to measure
construct validity - ANSWER when your survey items accurately measure a concept,
and the items are based on existing knowledge that tells us what characteristics define
that concept
content validity - ANSWER the survey items cover all aspects of the construct being
measured
criterion validity - ANSWER survey items correlate an outside rigorous criterion
internal consistency reliability - ANSWER survey items have strong correlations with
each other
inter-rater reliability - ANSWER when two or more researchers compare and correlate
their observations of something
preliminary review - ANSWER - colleagues review the instrument and give feedback
- achieves face validity
cognitive pretest - ANSWER 1 person from the program's priority population talks out
loud as they complete the survey, saying what they're thinking, and give feedback
pre-pilot - ANSWER 5-6 people from the program's priority population complete the
survey and give feedback
pilot test - ANSWER representative sample of the priority population complete the
survey
simple random sampling - ANSWER random numbers select from a sampling frame
systematic sampling - ANSWER people selected at an equal interval from a sampling
frame
, satisfied sampling - ANSWER make population subgroups and then simple/systematic
sample from each other
cluster sampling - ANSWER randomly select clusters (ex: neighborhoods) and then
simple/systematic sample from each
convenience sampling - ANSWER sampling people who are convenient to recruit
voluntary response sampling - ANSWER sampling people that choose to participate
after seeing an ad
purposive sampling - ANSWER sampling specific people for the purpose of the study
snowball sampling - ANSWER - we ask participants to tell us who else would be
appropriate to be interviewed/surveyed for the study
- useful for when it's hard to recruit certain groups of people
internal validity - ANSWER changes to participants are from the program and not
outside forces
external validity - ANSWER the program can create similar change in other populations
("generalizability")
threat to ex/in validity: history - ANSWER unanticipated event not related to the program
threat to ex/in validity: maturation - ANSWER participants' change due to growth (not the
program)
threat to ex/in validity: testing - ANSWER repeated surveys cause change (not the
program)
threat to ex/in validity: instrumentation - ANSWER instruments/researchers change after
pretest
threat to ex/in validity: selection - ANSWER non-random assignment, or participants
self-select
threat to ex/in validity: social desirability - ANSWER participants tell researchers what
they want
threat to ex/in validity: attrition - ANSWER participants drop out after pretest
threat to ex/in validity: hawthorne - ANSWER people act different when aware of being
watched
threat to ex/in validity: interaction of history and treatment - ANSWER program at a
specific time might not have the same results during a different time
threat to ex/in validity: highly tailored programs - ANSWER programs that have been
developed for niche population
