,Chapter 1: The New Statistics
Multiple Choice
1. A variable that is statistically controlled in an analysis is a(n) .
a. an independent variable
b. a dependent variable
c. a covariate
d. a manipulated variable
Ans: C
Cognitive Domain: Knowledge
Answer Location: 1.1: Required Background
Difficulty Level: Easy
2. In past years, many investigators have failed to report .
a. the effect size
b. the sample sizes
c. descriptive statistics
d. obtained p values
Ans: A
Cognitive Domain: Knowledge
Answer Location: 1.2: What is the “New Statistics”?
Difficulty Level: Easy
3. A primary concern of investigators has been, and often still is, obtaining a p value of
.
a. .10
b. .05
c. .01
d. .000
Ans: B
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
4. A major change advocated by New Statistics is .
a. reduced emphasis on effect size
b. focus on the results of single studies
c. not reporting confidence intervals
d. understanding the limitations of significance tests
Ans: D
,Cognitive Domain: Knowledge
Answer Location: 1.2: What is the “New Statistics”?
Difficulty Level: Easy
5. A primary change proposed by advocates of New Statistics involves summarizing
effect sizes from a number of studies using .
a. Bayesian statistics
b. meta-analysis
c. multivariate analysis
d. descriptive statistics
Ans: B
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
6. An emphasis of New Statistics is .
a. using increasingly precise p values
b. developing new methods of statistical analysis
c. reducing emphasis on confidence interval interpretation
d. adopting a more critical perspective when considering significance
Ans: D
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
7. Which of the following types of information is provided to investigators by NHST?
a. whether the hypothesis of the study has been proven
b. the probability that the research hypothesis is true
c. the probability of obtaining results about the H0 based on one sample
d. the exact probability of obtaining the same results on replication
Ans: C
Cognitive Domain: Analysis
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Hard
8. When reading an article that reports the results of multiple statistical tests, readers
should remember that multiple tests .
a. provide inaccurate information about the risks of Type I errors
b. provide inaccurate information about the risks of Type II errors
c. enhance understanding of cause and effect relationships
d. provide reliable information about the size and importance of effects
Ans: A
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
, 9. An advocate of New Statistics would object to a research report that included a st
hj hj hj hj hj hj hj hj hj hj hj hj hj hj
atement like the . hj hj hj
a. results of our study are consistent with a recent meta-analysis
hj hj hj hj hj hj hj hj hj
b. significant results should be interpreted cautiously due to the large sample size
hj hj hj hj hj hj hj hj hj hj hj
c. results of our study approached statistical significance
hj hj hj hj hj hj
d. results of our study provide support for our initial hypothesis A
hj hj hj hj hj hj hj hj hj hj
ns: C
hj
Cognitive Domain: Application hj hj
Answer Location: 1.3: Common Misinterpretations of p Values Diff
hj hj hj hj hj hj hj hj
iculty Level: Medium hj hj
10. If a statistical analysis yields p = .03, a research report can include a statement like
hj hj hj hj hj hj hj hj hj hj hj hj hj hj hj
.
a. the results of our study are likely to be replicated
hj hj hj hj hj hj hj hj hj
b. the evidence is consistent with the hypothesis of our study
hj hj hj hj hj hj hj hj hj
c. there is a 97% chance that the null hypothesis of our study is false
hj hj hj hj hj hj hj hj hj hj hj hj hj
d. the results of our study cannot be explained by chance A
hj hj hj hj hj hj hj hj hj hj
ns: B
hj
Cognitive Domain: Application hj hj
Answer Location: 1.3: Common Misinterpretations of p Values Diff
hj hj hj hj hj hj hj hj
iculty Level: Medium hj hj
11. An advocate of New Statistics would support a p value reported as
hj hj hj hj hj hj hj hj hj hj hj hj .
a. p = .0000
hj hj
b. p < .01
hj hj
c. p < .05
hj hj
d. p = .025
hj hj
Ans: D hj
Cognitive Domain: Knowledge hj hj
Answer Location: 1.4: Problems with NHST Logic Diff
hj hj hj hj hj hj hj
iculty Level: Easy hj hj
12. A problem with NHST logic is that it
hj . hj hj hj hj hj hj hj
a. eliminates the need to think in terms of double negatives hj hj hj hj hj hj hj hj hj
b. encourages investigators to describe study results in terms of uncertainty hj hj hj hj hj hj hj hj hj
c. cannot tell investigators what they want to know hj hj hj hj hj hj hj
d. is used consistently and correctly in the majority of studies A
hj hj hj hj hj hj hj hj hj hj
ns: C
hj
Cognitive Domain: Comprehension hj hj
Answer Location: 1.4: Problems with NHST Logic Diff
hj hj hj hj hj hj hj
iculty Level: Medium hj hj
13. An important assumption underlying the use of an independent samples t test or on
hj hj hj hj hj hj hj hj hj hj hj hj hj
e-way ANOVA is that .
hj hj hj hj
a. the grouping variables are normally distributed in the population
hj hj hj hj hj hj hj hj