, NCE Research & Program Evaluation Prep PDF 2026 |
Questions & Correct Answers | Graded A+
1. Which sampling technique would be most appropriate to create an unbiased
sample of 60% female and 40% male to match the target population?
Systematic sampling
Simple random sampling
Convenience sampling
Stratified random sampling
2. With the pressure for accountability, many mental health agencies ask their
clients to complete evaluation forms following counseling. In assessing this
self-report data, it is important to be aware of
interrater reliability
scale deficiencies
normative comparisons.
'halo' effect
3. Tina is conducting a research study about underage drinking habits on
college campuses on football game days. As she's scoring her collected
data, she notices the test group is primarily made up of freshman students
and the control group is primarily made up of sophomore students. What
does Tina realize about this distinction?
it may confound her results
it won't make a difference if she runs enough ANOVA tests
it should be tabulated in chi-square cross section
it's to be expected
,4. What is the most important difference between quasi-experimental and
experimental methods?
Experimental methods involve the use of inferential statistics, quasi-
experimental methods don't.
There are no significant differences between the two methods.
Experimental methods involve the use of a laboratory, quasi-
experimental methods don't.
Experimental methods involve data triangulation and covariance of
subjective matrices, quasi-experimental methods don't.
Experimental methods involve random assignment of participants
to conditions, quasi-experimental methods don't.
5. In a program designed to improve college students' access to mental health
resources, a evaluation would describe whether access to mental
health improved after the program had been implemented.
summative
gendered
formative
large-scale
6. If the principal wants to determine if the posttest scores of Classroom B
significantly differ from those of Classroom A and C after adjusting for pretest
scores, which statistical procedure should be used?
t-test
multiple regression
analysis of covariance
analysis of variance
, 7. A doctoral student is curious about how bilingual kindergarten children
interact verbally with monolingual children of a different racial group. She
decides to study this for her doctoral research. A research method which may
be most appropriate to consider is...
survey
experimental
ethnographic
analogue
8. Describe the implications of committing a type 1 error in research.
Committing a type 1 error means concluding that there is an effect
or difference when none actually exists.
Committing a type 1 error means accepting the null hypothesis when it
is false.
Committing a type 1 error means failing to detect an effect that is
present.
Committing a type 1 error means correctly identifying a true null
hypothesis.
9. A researcher notes changes in the outdoor temperature over a one-month
period. The recorded temperatures are an examples of what type of
measure?
ordinal
nominal
interval
ratio
Questions & Correct Answers | Graded A+
1. Which sampling technique would be most appropriate to create an unbiased
sample of 60% female and 40% male to match the target population?
Systematic sampling
Simple random sampling
Convenience sampling
Stratified random sampling
2. With the pressure for accountability, many mental health agencies ask their
clients to complete evaluation forms following counseling. In assessing this
self-report data, it is important to be aware of
interrater reliability
scale deficiencies
normative comparisons.
'halo' effect
3. Tina is conducting a research study about underage drinking habits on
college campuses on football game days. As she's scoring her collected
data, she notices the test group is primarily made up of freshman students
and the control group is primarily made up of sophomore students. What
does Tina realize about this distinction?
it may confound her results
it won't make a difference if she runs enough ANOVA tests
it should be tabulated in chi-square cross section
it's to be expected
,4. What is the most important difference between quasi-experimental and
experimental methods?
Experimental methods involve the use of inferential statistics, quasi-
experimental methods don't.
There are no significant differences between the two methods.
Experimental methods involve the use of a laboratory, quasi-
experimental methods don't.
Experimental methods involve data triangulation and covariance of
subjective matrices, quasi-experimental methods don't.
Experimental methods involve random assignment of participants
to conditions, quasi-experimental methods don't.
5. In a program designed to improve college students' access to mental health
resources, a evaluation would describe whether access to mental
health improved after the program had been implemented.
summative
gendered
formative
large-scale
6. If the principal wants to determine if the posttest scores of Classroom B
significantly differ from those of Classroom A and C after adjusting for pretest
scores, which statistical procedure should be used?
t-test
multiple regression
analysis of covariance
analysis of variance
, 7. A doctoral student is curious about how bilingual kindergarten children
interact verbally with monolingual children of a different racial group. She
decides to study this for her doctoral research. A research method which may
be most appropriate to consider is...
survey
experimental
ethnographic
analogue
8. Describe the implications of committing a type 1 error in research.
Committing a type 1 error means concluding that there is an effect
or difference when none actually exists.
Committing a type 1 error means accepting the null hypothesis when it
is false.
Committing a type 1 error means failing to detect an effect that is
present.
Committing a type 1 error means correctly identifying a true null
hypothesis.
9. A researcher notes changes in the outdoor temperature over a one-month
period. The recorded temperatures are an examples of what type of
measure?
ordinal
nominal
interval
ratio
