Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
Chapter 1: The New Statistics
Test Bank
Multiple Choice
1. A variable that is statistically controlled in an analysis is a(n) .
a. an independent variable
b. a dependent variable
c. a covariate
d. a manipulated variable
Ans: C
Cognitive Domain: Knowledge
Answer Location: 1.1: Required Background
Difficulty Level: Easy
2. In past years, many investigators have failed to report .
a. the effect size
b. the sample sizes
c. descriptive statistics
d. obtained p values
Ans: A
Cognitive Domain: Knowledge
Answer Location: 1.2: What is the “New Statistics”?
Difficulty Level: Easy
3. A primary concern of investigators has been, and often still is, obtaining a p value of
.
a. .10
b. .05
c. .01
d. .000
Ans: B
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
4. A major change advocated by New Statistics is .
a. reduced emphasis on effect size
b. focus on the results of single studies
c. not reporting confidence intervals
d. understanding the limitations of significance
tests Ans: D
, Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
Cognitive Domain: Knowledge
Answer Location: 1.2: What is the “New Statistics”?
Difficulty Level: Easy
5. A primary change proposed by advocates of New Statistics involves summarizing
effect sizes from a number of studies using .
a. Bayesian statistics
b. meta-analysis
c. multivariate analysis
d. descriptive statistics
Ans: B
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
6. An emphasis of New Statistics is .
a. using increasingly precise p values
b. developing new methods of statistical analysis
c. reducing emphasis on confidence interval interpretation
d. adopting a more critical perspective when considering
significance Ans: D
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
7. Which of the following types of information is provided to investigators by NHST?
a. whether the hypothesis of the study has been proven
b. the probability that the research hypothesis is true
c. the probability of obtaining results about the H0 based on one sample
d. the exact probability of obtaining the same results on
replication Ans: C
Cognitive Domain: Analysis
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Hard
8. When reading an article that reports the results of multiple statistical tests,
readers should remember that multiple tests .
a. provide inaccurate information about the risks of Type I errors
b. provide inaccurate information about the risks of Type II errors
c. enhance understanding of cause and effect relationships
d. provide reliable information about the size and importance of
effects Ans: A
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
, Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
9. An advocate of New Statistics would object to a research report that included
a statement like the .
a. results of our study are consistent with a recent meta-analysis
b. significant results should be interpreted cautiously due to the large sample size
c. results of our study approached statistical significance
d. results of our study provide support for our initial
hypothesis Ans: C
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
10. If a statistical analysis yields p = .03, a research report can include a statement like
.
a. the results of our study are likely to be replicated
b. the evidence is consistent with the hypothesis of our study
c. there is a 97% chance that the null hypothesis of our study is false
d. the results of our study cannot be explained by
chance Ans: B
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
11. An advocate of New Statistics would support a p value reported as .
a. p = .0000
b. p < .01
c. p < .05
d. p = .025
Ans: D
Cognitive Domain: Knowledge
Answer Location: 1.4: Problems with NHST Logic
Difficulty Level: Easy
12. A problem with NHST logic is that it .
a. eliminates the need to think in terms of double negatives
b. encourages investigators to describe study results in terms of uncertainty
c. cannot tell investigators what they want to know
d. is used consistently and correctly in the majority of
studies Ans: C
Cognitive Domain: Comprehension
Answer Location: 1.4: Problems with NHST Logic
Difficulty Level: Medium
13. An important assumption underlying the use of an independent samples t test
or one-way ANOVA is that .
a. the grouping variables are normally distributed in the population
, Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
b. the variances of the groups on the dependent variable are equal
c. all participants respondents responded to both the pretest and the posttest
d. all scores in each group lie within one standard deviation of the
mean Ans: B
Cognitive Domain: Comprehension
Answer Location: 1.5.1: Violations of Assumptions
Difficulty Level: Medium
14. An important assumption underlying the use of Pearson r is that .
a. the relationship between the two variables is linear
b. the variances of the X and Y scores are equal
c. all participants respondents responded to both the pretest and the posttest
d. all scores in each variable lie within one standard deviation of the variable
mean Ans: A
Cognitive Domain: Comprehension
Answer Location: 1.5.1: Violations of Assumptions
Difficulty Level: Medium
15. A frequent violation of the rules for using NHST is .
a. performing only one significance test
b. selecting random samples from the population of interest
c. selecting the statistical test after data collection
d. selecting the criterion p value before analyzing the
data Ans: C
Cognitive Domain: Analysis
Answer Location: 1.5.2: Violations of Rules for Use of NHST
Difficulty Level: Hard
16. If scores on an attitude scale can range from 0 to 60 with most scores lying
between 20 and 45, scores of 7 and 57 could be .
a. likelihood errors
b. probability errors
c. extraneous variables
d. outliers
Ans: D
Cognitive Domain: Analysis
Answer Location: 1.5.2: Violations of Rules for Use of NHST
Difficulty Level: Hard
17. Another term describing the process of testing the reproducibility of research
results by repeating studies in different settings with different participants is .
a. replication.
b. generalization
c. normalization
d. refutation
Ans: A
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
Chapter 1: The New Statistics
Test Bank
Multiple Choice
1. A variable that is statistically controlled in an analysis is a(n) .
a. an independent variable
b. a dependent variable
c. a covariate
d. a manipulated variable
Ans: C
Cognitive Domain: Knowledge
Answer Location: 1.1: Required Background
Difficulty Level: Easy
2. In past years, many investigators have failed to report .
a. the effect size
b. the sample sizes
c. descriptive statistics
d. obtained p values
Ans: A
Cognitive Domain: Knowledge
Answer Location: 1.2: What is the “New Statistics”?
Difficulty Level: Easy
3. A primary concern of investigators has been, and often still is, obtaining a p value of
.
a. .10
b. .05
c. .01
d. .000
Ans: B
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
4. A major change advocated by New Statistics is .
a. reduced emphasis on effect size
b. focus on the results of single studies
c. not reporting confidence intervals
d. understanding the limitations of significance
tests Ans: D
, Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
Cognitive Domain: Knowledge
Answer Location: 1.2: What is the “New Statistics”?
Difficulty Level: Easy
5. A primary change proposed by advocates of New Statistics involves summarizing
effect sizes from a number of studies using .
a. Bayesian statistics
b. meta-analysis
c. multivariate analysis
d. descriptive statistics
Ans: B
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
6. An emphasis of New Statistics is .
a. using increasingly precise p values
b. developing new methods of statistical analysis
c. reducing emphasis on confidence interval interpretation
d. adopting a more critical perspective when considering
significance Ans: D
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
7. Which of the following types of information is provided to investigators by NHST?
a. whether the hypothesis of the study has been proven
b. the probability that the research hypothesis is true
c. the probability of obtaining results about the H0 based on one sample
d. the exact probability of obtaining the same results on
replication Ans: C
Cognitive Domain: Analysis
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Hard
8. When reading an article that reports the results of multiple statistical tests,
readers should remember that multiple tests .
a. provide inaccurate information about the risks of Type I errors
b. provide inaccurate information about the risks of Type II errors
c. enhance understanding of cause and effect relationships
d. provide reliable information about the size and importance of
effects Ans: A
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
, Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
9. An advocate of New Statistics would object to a research report that included
a statement like the .
a. results of our study are consistent with a recent meta-analysis
b. significant results should be interpreted cautiously due to the large sample size
c. results of our study approached statistical significance
d. results of our study provide support for our initial
hypothesis Ans: C
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
10. If a statistical analysis yields p = .03, a research report can include a statement like
.
a. the results of our study are likely to be replicated
b. the evidence is consistent with the hypothesis of our study
c. there is a 97% chance that the null hypothesis of our study is false
d. the results of our study cannot be explained by
chance Ans: B
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
11. An advocate of New Statistics would support a p value reported as .
a. p = .0000
b. p < .01
c. p < .05
d. p = .025
Ans: D
Cognitive Domain: Knowledge
Answer Location: 1.4: Problems with NHST Logic
Difficulty Level: Easy
12. A problem with NHST logic is that it .
a. eliminates the need to think in terms of double negatives
b. encourages investigators to describe study results in terms of uncertainty
c. cannot tell investigators what they want to know
d. is used consistently and correctly in the majority of
studies Ans: C
Cognitive Domain: Comprehension
Answer Location: 1.4: Problems with NHST Logic
Difficulty Level: Medium
13. An important assumption underlying the use of an independent samples t test
or one-way ANOVA is that .
a. the grouping variables are normally distributed in the population
, Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
b. the variances of the groups on the dependent variable are equal
c. all participants respondents responded to both the pretest and the posttest
d. all scores in each group lie within one standard deviation of the
mean Ans: B
Cognitive Domain: Comprehension
Answer Location: 1.5.1: Violations of Assumptions
Difficulty Level: Medium
14. An important assumption underlying the use of Pearson r is that .
a. the relationship between the two variables is linear
b. the variances of the X and Y scores are equal
c. all participants respondents responded to both the pretest and the posttest
d. all scores in each variable lie within one standard deviation of the variable
mean Ans: A
Cognitive Domain: Comprehension
Answer Location: 1.5.1: Violations of Assumptions
Difficulty Level: Medium
15. A frequent violation of the rules for using NHST is .
a. performing only one significance test
b. selecting random samples from the population of interest
c. selecting the statistical test after data collection
d. selecting the criterion p value before analyzing the
data Ans: C
Cognitive Domain: Analysis
Answer Location: 1.5.2: Violations of Rules for Use of NHST
Difficulty Level: Hard
16. If scores on an attitude scale can range from 0 to 60 with most scores lying
between 20 and 45, scores of 7 and 57 could be .
a. likelihood errors
b. probability errors
c. extraneous variables
d. outliers
Ans: D
Cognitive Domain: Analysis
Answer Location: 1.5.2: Violations of Rules for Use of NHST
Difficulty Level: Hard
17. Another term describing the process of testing the reproducibility of research
results by repeating studies in different settings with different participants is .
a. replication.
b. generalization
c. normalization
d. refutation
Ans: A
