Chapter 6
Research Validity
Multiple choice questions
1. Which of the following may compromise the statistical
conclusion validity of an experiment?
a. if the researcher uses poor operational definitions of his
variables
*b. if the experiment has too few participants, thus reducing
power
c. if the experimental findings are limited to a particular
group of participants
d. if the research participants have a positive self-
presentation motive
2. Dr. Gomez completed her study investigating the effect of
stress on consumption of carbohydrates and, based on her
analysis of the data, concluded that increasing a person’s stress
level leads to an increase consumption of carbohydrates. If this
inference is correct, the study has achieved
a. statistical significance.
b. the correct conclusion.
c. an advancement in knowledge.* d. statistical
conclusion validity.
3. Using operational definitions to define research participants,
the experimental setting, the independent or dependent variable
is equal to which type of validity?
a. statistical conclusion validity
* b. construct validity
c. discriminant validity
d. projective validity
,4. Whether experimental research is conducting in the laboratory,
a doctor’s office, or at the mall is considered the
a. resear
ch participants.
b. indepe
ndent variable.*
c.
experimental
setting.
d. dependent variable.
5. Which of the following is an example of the construct of
research participants?
* a. individuals with ADHD
b. a laboratory observation room
c. reaction time of the participants
d. the experimenter
6. Which of the following is an example of the phenomenon of
"demand characteristics" acting in an experiment?
a. when participants complete the experiment, they are
instructed not to tell anyone else about what they have
experienced
b. participants in one study report only once, for half an hour,
to the research lab, but participants in another study have
to report three times, for an hour each time, and resent
having to spend so much time
* c. participants in a study are drawn from the large
Introductory Psychology classes, and students who have
already participated pass rumors to others about what the
experiment is trying to "prove” and try to determine what
, the experiment is about from the equipment in the
laboratory
d. in one psychology experiment, the researcher does not
allow participants to withdraw from the study, even if they
do not like the kinds of tasks they are asked to perform
7. For her senior thesis, Nancy surveys fellow students about
cheating. Her findings suggest that cheating is virtually non-
existent on her campus. This is not consistent with the fact that,
in the past semester, two dozen students have been found guilty
by the Honor Board of cheating.
Which of the following explanations would fall under the heading
of “reactivity?”
a. Nancy's data were a "one shot" picture, and therefore
could not be too accurate
b. the questions on Nancy's survey probably were not
phrased well enough to collect
accurate data
* c. it is known that participants in research like to present
themselves as positively as possible, so students that
cheated probably lied and did not report their cheating on
the survey
d. Nancy’s survey was confounded by being too demanding
for personal information
8. We like to believe that the only major influence on participant
performance in an experiment is the manipulation of the
independent variable. In fact, some research has shown that
* a. performance can be influenced by the participants'
perceptions of what the experimenter "wants" them to do.
b. human behavior is relatively uninfluenced by manipulation
of environmental conditions.
c. human participants are very good at figuring out the
purpose of an experiment, and enjoy subverting the
research by giving data that disconfirm the hypothesis.
d. manipulations of environmental conditions affect only a
certain subtype of participant.
Research Validity
Multiple choice questions
1. Which of the following may compromise the statistical
conclusion validity of an experiment?
a. if the researcher uses poor operational definitions of his
variables
*b. if the experiment has too few participants, thus reducing
power
c. if the experimental findings are limited to a particular
group of participants
d. if the research participants have a positive self-
presentation motive
2. Dr. Gomez completed her study investigating the effect of
stress on consumption of carbohydrates and, based on her
analysis of the data, concluded that increasing a person’s stress
level leads to an increase consumption of carbohydrates. If this
inference is correct, the study has achieved
a. statistical significance.
b. the correct conclusion.
c. an advancement in knowledge.* d. statistical
conclusion validity.
3. Using operational definitions to define research participants,
the experimental setting, the independent or dependent variable
is equal to which type of validity?
a. statistical conclusion validity
* b. construct validity
c. discriminant validity
d. projective validity
,4. Whether experimental research is conducting in the laboratory,
a doctor’s office, or at the mall is considered the
a. resear
ch participants.
b. indepe
ndent variable.*
c.
experimental
setting.
d. dependent variable.
5. Which of the following is an example of the construct of
research participants?
* a. individuals with ADHD
b. a laboratory observation room
c. reaction time of the participants
d. the experimenter
6. Which of the following is an example of the phenomenon of
"demand characteristics" acting in an experiment?
a. when participants complete the experiment, they are
instructed not to tell anyone else about what they have
experienced
b. participants in one study report only once, for half an hour,
to the research lab, but participants in another study have
to report three times, for an hour each time, and resent
having to spend so much time
* c. participants in a study are drawn from the large
Introductory Psychology classes, and students who have
already participated pass rumors to others about what the
experiment is trying to "prove” and try to determine what
, the experiment is about from the equipment in the
laboratory
d. in one psychology experiment, the researcher does not
allow participants to withdraw from the study, even if they
do not like the kinds of tasks they are asked to perform
7. For her senior thesis, Nancy surveys fellow students about
cheating. Her findings suggest that cheating is virtually non-
existent on her campus. This is not consistent with the fact that,
in the past semester, two dozen students have been found guilty
by the Honor Board of cheating.
Which of the following explanations would fall under the heading
of “reactivity?”
a. Nancy's data were a "one shot" picture, and therefore
could not be too accurate
b. the questions on Nancy's survey probably were not
phrased well enough to collect
accurate data
* c. it is known that participants in research like to present
themselves as positively as possible, so students that
cheated probably lied and did not report their cheating on
the survey
d. Nancy’s survey was confounded by being too demanding
for personal information
8. We like to believe that the only major influence on participant
performance in an experiment is the manipulation of the
independent variable. In fact, some research has shown that
* a. performance can be influenced by the participants'
perceptions of what the experimenter "wants" them to do.
b. human behavior is relatively uninfluenced by manipulation
of environmental conditions.
c. human participants are very good at figuring out the
purpose of an experiment, and enjoy subverting the
research by giving data that disconfirm the hypothesis.
d. manipulations of environmental conditions affect only a
certain subtype of participant.
