ll ll ll ll ll ll
,Chapter 1: The New Statistics ll ll ll ll
Multiple Choice l
1. A variable that is statistically controlled in an analysis is a(n)
ll ll ll ll ll ll ll ll ll ll .
a. an independent variable ll ll
b. a dependent variable
ll ll
c. a covariate
ll
d. a manipulated
ll
variableAns: C
ll l ll
Cognitive Domain: Knowledge ll ll
Answer Location: 1.1: Required BackgroundDifficultyll ll ll ll l
Level: Easy
ll ll
2. In past years, many investigators have failed to report
ll ll ll ll ll ll ll ll .
a. the effect size ll ll
b. the sample sizes ll ll
c. descriptive statistics ll
d. obtained p ll
valuesAns: A
ll l ll
Cognitive Domain: Knowledge ll ll
Answer Location: 1.2: What is the “New ll ll ll ll ll ll
Statistics”?Difficulty Level: Easy
ll l ll ll
3. A primary concern of investigators has been, and often still is, obtaining a p value of
ll
ll ll ll ll ll ll ll ll ll ll ll ll ll ll ll
. l
a. .10ll
b. .05ll
c. .01ll
d. .000
ll
Ans: B ll
Cognitive Domain: Knowledge ll ll
Answer Location: 1.2: What Is the “New ll ll ll ll ll ll
Statistics”?Difficulty Level: Easy
ll l ll ll
4. A major change advocated by New Statistics is
ll ll ll ll ll ll ll .
a. reduced emphasis on effect size ll ll ll ll
b. focus on the results of single studies ll ll ll ll ll ll
c. not reporting confidence intervals
ll ll ll
d. understanding the limitations of significance ll ll ll ll
testsAns: D
ll l ll
,Cognitive Domain: Knowledge ll ll
Answer Location: 1.2: What is the “New
ll ll ll ll ll ll
Statistics”?Difficulty Level: Easy
ll l ll ll
5. A primary change proposed by advocates of New Statistics involves
ll ll ll ll ll ll ll ll ll
summarizingeffect sizes from a number of studies using
ll . l ll ll ll ll ll ll ll
a. Bayesian statistics ll
b. meta-analysis
c. multivariate analysis ll
d. descriptive
statisticsAns: B
ll l ll
Cognitive Domain: Knowledge ll ll
Answer Location: 1.2: What Is the “New
ll ll ll ll ll ll
Statistics”?Difficulty Level: Easy
ll l ll ll
6. An emphasis of New Statistics is
ll . ll ll ll ll
a. using increasingly precise p values
ll ll ll ll
b. developing new methods of statistical analysis ll ll ll ll ll
c. reducing emphasis on confidence interval interpretation ll ll ll ll ll
d. adopting a more critical perspective when considering ll ll ll ll ll ll
significanceAns: D
ll l ll
Cognitive Domain: Knowledge ll ll
Answer Location: 1.2: What Is the “New
ll ll ll ll ll ll
Statistics”?Difficulty Level: Easy
ll l ll ll
7. Which of the following types of information is provided to investigators by NHST?
ll ll ll ll ll ll ll ll ll ll ll ll
a. whether the hypothesis of the study has been proven ll ll ll ll ll ll ll ll
b. the probability that the research hypothesis is true
ll ll ll ll ll ll ll
c. the probability of obtaining results about the H0 based on one sample
ll ll ll ll ll ll ll ll ll ll ll
d. the exact probability of obtaining the same results on
ll ll ll ll ll ll ll ll
replicationAns: C
ll l ll
Cognitive Domain: Analysis ll ll
Answer Location: 1.3: Common Misinterpretations of p
ll ll ll ll ll ll
ValuesDifficulty Level: Hard
ll l ll ll
8. When reading an article that reports the results of multiple statistical tests,
ll ll ll ll ll ll ll ll ll ll ll
readersshould remember that multiple tests .
ll l ll ll ll ll
a. provide inaccurate information about the risks of Type I errors
ll ll ll ll ll ll ll ll ll
b. provide inaccurate information about the risks of Type II errors
ll ll ll ll ll ll ll ll ll
c. enhance understanding of cause and effect relationships ll ll ll ll ll ll
d. provide reliable information about the size and importance of
ll ll ll ll ll ll ll ll
effectsAns: A
ll l ll
Cognitive Domain: Application ll ll
Answer Location: 1.3: Common Misinterpretations of p
ll ll ll ll ll ll
ValuesDifficulty Level: Medium
ll l ll ll
, 9. An advocate of New Statistics would object to a research report that included
ll ll ll ll ll ll ll ll ll ll ll ll
astatement like the
ll l . ll ll
a. results of our study are consistent with a recent meta-analysis ll ll ll ll ll ll ll ll ll
b. significant results should be interpreted cautiously due to the large sample size ll ll ll ll ll ll ll ll ll ll ll
c. results of our study approached statistical significance ll ll ll ll ll ll
d. results of our study provide support for our initial ll ll ll ll ll ll ll ll
hypothesisAns: C
ll l ll
Cognitive Domain: Application ll ll
Answer Location: 1.3: Common Misinterpretations of p ll ll ll ll ll ll
ValuesDifficulty Level: Medium
ll l ll ll
10. If a statistical analysis yields p = .03, a research report can include a statement like
ll ll ll ll ll ll ll ll ll ll ll ll ll ll ll
ll .
a. the results of our study are likely to be replicated
ll ll ll ll ll ll ll ll ll
b. the evidence is consistent with the hypothesis of our study
ll ll ll ll ll ll ll ll ll
c. there is a 97% chance that the null hypothesis of our study is falsell ll ll ll ll ll ll ll ll ll ll ll ll
d. the results of our study cannot be explained by
ll ll ll ll ll ll ll ll
chanceAns: B
ll l ll
Cognitive Domain: Application ll ll
Answer Location: 1.3: Common Misinterpretations of p ll ll ll ll ll ll
ValuesDifficulty Level: Medium
ll l ll ll
11. An advocate of New Statistics would support a p value reported as
ll ll ll ll ll ll ll ll ll ll ll
.a. p = .0000 l ll ll ll
b. p < .01ll ll ll
c. p < .05ll ll ll
d. p = .025ll ll ll
Ans: D ll
Cognitive Domain: Knowledge ll ll
Answer Location: 1.4: Problems with NHST ll ll ll ll ll
LogicDifficulty Level: Easy
ll l ll ll
12. A problem with NHST logic is that it
ll . ll ll ll ll ll ll
a. eliminates the need to think in terms of double negatives ll ll ll ll ll ll ll ll ll
b. encourages investigators to describe study results in terms of uncertainty ll ll ll ll ll ll ll ll ll
c. cannot tell investigators what they want to know ll ll ll ll ll ll ll
d. is used consistently and correctly in the majority of
ll ll ll ll ll ll ll ll
studiesAns: C
ll l ll
Cognitive Domain: Comprehension ll ll
Answer Location: 1.4: Problems with NHST ll ll ll ll ll
LogicDifficulty Level: Medium
ll l ll ll
13. An important assumption underlying the use of an independent samples t test
ll ll ll ll ll ll ll ll ll ll ll
orone-way ANOVA is that
ll l . ll ll ll
a. the grouping variables are normally distributed in the population
ll ll ll ll ll ll ll ll