Chapter 1: The New Statistics cc cc cc cc
Multiple Choice cc
1. A variable that is statistically controlled in an analysis is a(n)
cc cc cc cc cc cc cc cc cc cc .
a. an independent variable
cc cc
b. a dependent variable
cc cc
c. a covariate
cc
d. a manipulated
cc
variableAns: C
cc c cc
Cognitive Domain: Knowledge cc cc
Answer Location: 1.1: Required cc cc cc
BackgroundDifficulty Level: Easy
cc c cc cc
2. In past years, many investigators have failed to report
cc cc cc cc cc cc cc cc .
a. the effect size cc cc
b. the sample sizes cc cc
c. descriptive statistics cc
d. obtained p cc
valuesAns: A
cc c cc
Cognitive Domain: Knowledge cc cc
Answer Location: 1.2: What is the “New
cc cc cc cc cc cc
Statistics”?Difficulty Level: Easy
cc c cc cc
3. A primary concern of investigators has been, and often still is, obtaining a p value of
cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
. c
a. .10
cc
b. .05
cc
c. .01
cc
d. .000
cc
Ans: B cc
Cognitive Domain: Knowledge cc cc
Answer Location: 1.2: What Is the “New
cc cc cc cc cc cc
Statistics”?Difficulty Level: Easy
cc c cc cc
4. A major change advocated by New Statistics is
cc cc cc cc cc cc cc .
a. reduced emphasis on effect size cc cc cc cc
b. focus on the results of single studies
cc cc cc cc cc cc
c. not reporting confidence intervals
cc cc cc
d. understanding the limitations of significance cc cc cc cc
testsAns: D
cc c cc
,Cognitive Domain: Knowledge cc cc
Answer Location: 1.2: What is the “New
cc cc cc cc cc cc
Statistics”?Difficulty Level: Easy
cc c cc cc
5. A primary change proposed by advocates of New Statistics involves
cc cc cc cc cc cc cc cc cc
summarizingeffect sizes from a number of studies using
cc . c cc cc cc cc cc cc cc
a. Bayesian statistics cc
b. meta-analysis
c. multivariate analysis cc
d. descriptive
statisticsAns: B
cc c cc
Cognitive Domain: Knowledge cc cc
Answer Location: 1.2: What Is the “New
cc cc cc cc cc cc
Statistics”?Difficulty Level: Easy
cc c cc cc
6. An emphasis of New Statistics is
cc . cc cc cc cc
a. using increasingly precise p values
cc cc cc cc
b. developing new methods of statistical analysis cc cc cc cc cc
c. reducing emphasis on confidence interval interpretation
cc cc cc cc cc
d. adopting a more critical perspective when considering
cc cc cc cc cc cc
significanceAns: D
cc c cc
Cognitive Domain: Knowledge cc cc
Answer Location: 1.2: What Is the “New
cc cc cc cc cc cc
Statistics”?Difficulty Level: Easy
cc c cc cc
7. Which of the following types of information is provided to investigators by NHST?
cc cc cc cc cc cc cc cc cc cc cc cc
a. whether the hypothesis of the study has been proven
cc cc cc cc cc cc cc cc
b. the probability that the research hypothesis is true
cc cc cc cc cc cc cc
c. the probability of obtaining results about the H0 based on one sample
cc cc cc cc cc cc cc cc cc cc cc
d. the exact probability of obtaining the same results on
cc cc cc cc cc cc cc cc
replicationAns: C
cc c cc
Cognitive Domain: Analysis cc cc
Answer Location: 1.3: Common Misinterpretations of p
cc cc cc cc cc cc
ValuesDifficulty Level: Hard
cc c cc cc
8. When reading an article that reports the results of multiple statistical tests,
cc cc cc cc cc cc cc cc cc cc cc
readersshould remember that multiple tests.
cc c cc cc cc cc
a. provide inaccurate information about the risks of Type I errors
cc cc cc cc cc cc cc cc cc
b. provide inaccurate information about the risks of Type II errors
cc cc cc cc cc cc cc cc cc
c. enhance understanding of cause and effect relationships
cc cc cc cc cc cc
d. provide reliable information about the size and importance of
cc cc cc cc cc cc cc cc
effectsAns: A
cc c cc
Cognitive Domain: Application cc cc
Answer Location: 1.3: Common Misinterpretations of p
cc cc cc cc cc cc
ValuesDifficulty Level: Medium
cc c cc cc
,9. An advocate of New Statistics would object to a research report that included
cc cc cc cc cc cc cc cc cc cc cc cc
astatement like the
cc c . cc cc
a. results of our study are consistent with a recent meta-analysis
cc cc cc cc cc cc cc cc cc
b. significant results should be interpreted cautiously due to the large sample size
cc cc cc cc cc cc cc cc cc cc cc
c. results of our study approached statistical significance
cc cc cc cc cc cc
d. results of our study provide support for our initial
cc cc cc cc cc cc cc cc
hypothesisAns: C
cc c cc
Cognitive Domain: Application cc cc
Answer Location: 1.3: Common Misinterpretations of p
cc cc cc cc cc cc
ValuesDifficulty Level: Medium
cc c cc cc
10. If a statistical analysis yields p = .03, a research report can include a statement like
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
cc .
a. the results of our study are likely to be replicated
cc cc cc cc cc cc cc cc cc
b. the evidence is consistent with the hypothesis of our study
cc cc cc cc cc cc cc cc cc
c. there is a 97% chance that the null hypothesis of our study is false
cc cc cc cc cc cc cc cc cc cc cc cc cc
d. the results of our study cannot be explained by
cc cc cc cc cc cc cc cc
chanceAns: B
cc c cc
Cognitive Domain: Application cc cc
Answer Location: 1.3: Common Misinterpretations of p
cc cc cc cc cc cc
ValuesDifficulty Level: Medium
cc c cc cc
11. An advocate of New Statistics would support a p value reported as
cc cc cc cc cc cc cc cc cc cc cc
.a. p = .0000
c cc cc cc
b. p < .01
cc cc cc
c. p < .05
cc cc cc
d. p = .025
cc cc cc
Ans: D cc
Cognitive Domain: Knowledge cc cc
Answer Location: 1.4: Problems with NHSTcc cc cc cc cc
LogicDifficulty Level: Easy
cc c cc cc
12. A problem with NHST logic is that it
cc . cc cc cc cc cc cc
a. eliminates the need to think in terms of double negatives cc cc cc cc cc cc cc cc cc
b. encourages investigators to describe study results in terms of uncertainty cc cc cc cc cc cc cc cc cc
c. cannot tell investigators what they want to know cc cc cc cc cc cc cc
d. is used consistently and correctly in the majority of
cc cc cc cc cc cc cc cc
studiesAns: C
cc c cc
Cognitive Domain: Comprehension cc cc
Answer Location: 1.4: Problems with NHSTcc cc cc cc cc
LogicDifficulty Level: Medium
cc c cc cc
13. An important assumption underlying the use of an independent samples t test
cc cc cc cc cc cc cc cc cc cc cc
orone-way ANOVA is that
cc c . cc cc cc
a. the grouping variables are normally distributed in the population
cc cc cc cc cc cc cc cc
, b. the variances of the groups on the dependent variable are equal
cc cc cc cc cc cc cc cc cc cc
c. all participants respondents responded to both the pretest and the posttest
cc cc cc cc cc cc cc cc cc cc
d. all scores in each group lie within one standard deviation of the
cc cc cc cc cc cc cc cc cc cc cc
meanAns: B
cc c cc
Cognitive Domain: Comprehension cc cc
Answer Location: 1.5.1: Violations of
cc cc cc cc
AssumptionsDifficulty Level: Medium
cc c cc cc
14. An important assumption underlying the use of Pearson r is that
cc . cc cc cc cc cc cc cc cc cc
a. the relationship between the two variables is linear
cc cc cc cc cc cc cc
b. the variances of the X and Y scores are equal
cc cc cc cc cc cc cc cc cc
c. all participants respondents responded to both the pretest and the posttest
cc cc cc cc cc cc cc cc cc cc
d. all scores in each variable lie within one standard deviation of the variable
cc cc cc cc cc cc cc cc cc cc cc cc
meanAns: A
cc c cc
Cognitive Domain: Comprehension cc cc
Answer Location: 1.5.1: Violations of
cc cc cc cc
AssumptionsDifficulty Level: Medium
cc c cc cc
15. A frequent violation of the rules for using NHST is
cc . cc cc cc cc cc cc cc cc
a. performing only one significance test cc cc cc cc
b. selecting random samples from the population of interest
cc cc cc cc cc cc cc
c. selecting the statistical test after data collection
cc cc cc cc cc cc
d. selecting the criterion p value before analyzing the
cc cc cc cc cc cc cc
dataAns: C
cc c cc
Cognitive Domain: Analysis cc cc
Answer Location: 1.5.2: Violations of Rules for Use of
cc cc cc cc cc cc cc cc
NHSTDifficulty Level: Hard
cc c cc cc
16. If scores on an attitude scale can range from 0 to 60 with most scores lying
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
between20 and 45, scores of 7 and 57 could be
cc c cc . cc cc cc cc cc cc cc cc
a. likelihood errors cc
b. probability errors cc
c. extraneous variables cc
d. outliers c
Ans: D
cc
Cognitive Domain: Analysis cc cc
Answer Location: 1.5.2: Violations of Rules for Use of
cc cc cc cc cc cc cc cc
NHSTDifficulty Level: Hard
cc c cc cc
17. Another term describing the process of testing the reproducibility of research
cc cc cc cc cc cc cc cc cc cc
resultsby repeating studies in different settings with different participants is .
cc c cc cc cc cc cc cc cc cc cc
a. replication.
b. generalization
c. normalization
d. refutation c
Ans: A
cc