Statistical significance - Answers A result that probably did not happen by chance.
Sampling error - Answers The difference between a sample result and the true population value.
Significance level - Answers The probability level used to decide whether to reject the null
hypothesis, usually .05.
p value - Answers The probability of getting results this extreme if the null hypothesis is true.
p < .05 - Answers The result is statistically significant, so reject the null hypothesis.
p > .05 - Answers The result is not statistically significant, so fail to reject the null hypothesis.
Null hypothesis - Answers The statement that there is no difference, no relationship, or no effect.
Research hypothesis - Answers The statement that there is a difference, relationship, or effect.
Type I error - Answers Rejecting the null hypothesis when it is actually true.
Alpha - Answers The probability of making a Type I error.
Type II error - Answers Failing to reject the null hypothesis when it is actually false.
Beta - Answers The probability of making a Type II error.
Power - Answers The ability of a statistical test to detect a real effect when one exists.
Critical value - Answers The cutoff value used to decide whether the test statistic is extreme enough
to reject the null hypothesis.
Obtained value - Answers The test statistic value calculated from the sample data.
Inferential statistics - Answers Statistics used to make conclusions about a population based on a
sample.
Single-sample z test - Answers A test used to compare a sample mean to a population mean when
the population standard deviation is known.
Single-sample t test - Answers A test used to compare a sample mean to a population mean when the
population standard deviation is unknown.
Population mean - Answers The average score for the entire population.
Sample mean - Answers The average score for the sample.
Standard error of the mean - Answers The standard deviation of all possible sample means.
z value - Answers The test statistic used in a z test.
t value - Answers The test statistic used in a t test.
One-sample test - Answers A test that compares one sample to a known or hypothesized population
value.
Effect size - Answers A measure of how large or meaningful a difference is.
Cohen's d - Answers An effect size that shows how far apart two means are in standard deviation
units.
Independent t test - Answers A test used to compare the means of two unrelated groups.
Paired-samples t test - Answers A test used to compare two related means from the same group or
matched participants.
Dependent means - Answers Two means that are related, such as pretest and posttest scores from
the same people.
Independent means - Answers Two means that come from separate, unrelated groups.
Homogeneity of variance - Answers The assumption that two groups have about equal variability.
Degrees of freedom - Answers A value based on sample size that helps determine statistical
significance.
Two-tailed test - Answers A test used when the research hypothesis does not predict a specific
direction.
One-tailed test - Answers A test used when the research hypothesis predicts a specific direction.
Pretest-posttest design - Answers A design where the same group is measured before and after an
intervention.
Difference score - Answers The amount of change between two related scores.
Nonsignificant result - Answers A result where the evidence is not strong enough to reject the null
hypothesis.
ANOVA - Answers A statistical test used to compare means when there are more than two groups.
F value - Answers The test statistic used in ANOVA.
One-way ANOVA - Answers An ANOVA with one independent variable that has more than two levels.
Factor - Answers Another name for an independent variable in ANOVA.