Contents
Week 1 – Introduction + Frequentist statistics......................................................................................4
Frequentist statistics..........................................................................................................................4
Likelihood statistics............................................................................................................................4
Bayesian statistics..............................................................................................................................4
p-values.............................................................................................................................................4
Error rates..........................................................................................................................................4
Type 1 errors......................................................................................................................................4
Type 2 errors......................................................................................................................................5
Week 2 – Likelihoods & Bayesian statistics............................................................................................6
Likelihood ratio..................................................................................................................................6
Binomial likelihood function..............................................................................................................6
Binomial Bayesian inference..............................................................................................................6
Beta distributions in Bayesian statistics.............................................................................................6
Bayes factor.......................................................................................................................................6
Bayesian estimation...........................................................................................................................6
Nomogram.........................................................................................................................................7
Week 3 – Error control..........................................................................................................................8
Type 1 error in multiple testing.........................................................................................................8
Bonferroni correction....................................................................................................................8
Familywise error rate.....................................................................................................................8
Pre-registration..............................................................................................................................8
Holm correlation............................................................................................................................8
Type 1 error in optional stopping......................................................................................................8
Sequential analysis.........................................................................................................................8
Type 2 error and power.....................................................................................................................8
Pre-registration content....................................................................................................................9
Benefits of pre-registration............................................................................................................9
HARKing.............................................................................................................................................9
Confirmatory research.......................................................................................................................9
Week 4 – Effect sizes...........................................................................................................................10
Goals/ uses of effect sizes................................................................................................................10
Unstandardized effect sizes.............................................................................................................10
Standardized effect sizes.................................................................................................................10
r family of effect sizes / correlations................................................................................................10
, d family of effect sizes / Cohens’ d..................................................................................................10
dz.................................................................................................................................................11
ds.................................................................................................................................................11
dav...............................................................................................................................................11
Hedges’ g.....................................................................................................................................11
Variance in data explained by an effect...........................................................................................11
Total variance explained by an effect..........................................................................................11
Partial variance............................................................................................................................11
Cohens’ f......................................................................................................................................12
Generalized eta-squared..............................................................................................................12
Week 5 – Sample size justification, confidence intervals, p-curve analysis.........................................13
Confidence intervals........................................................................................................................13
Confidence interval calculation....................................................................................................13
Capture percentage.........................................................................................................................13
Credible intervals.............................................................................................................................13
Sample sizes.....................................................................................................................................13
Sample size justifications.............................................................................................................13
Small sample size problems.........................................................................................................13
Corridor of stability (Schönbrodt and Perugini)...........................................................................13
Sample size justification approaches...........................................................................................13
p-value distribution.........................................................................................................................14
p-curve analysis...............................................................................................................................14
Week 6 – Philosophy of science and theory........................................................................................15
Demarcation criteria........................................................................................................................15
Modus tollens..................................................................................................................................15
Affirming the consequent................................................................................................................15
Refutation or falsification of a theory..............................................................................................15
Alternative theory............................................................................................................................15
Progressive vs degenerative research line (Lakatos)........................................................................15
Objectivity of science.......................................................................................................................15
Criticism on null hypothesis testing.................................................................................................16
Random assignment vs measured variables....................................................................................16
Crud factor.......................................................................................................................................16
George Box on NHST........................................................................................................................16
Strong inference..............................................................................................................................16
Falsification of a theory...................................................................................................................16
, Scientific theory...............................................................................................................................16
Scientific cycle stages (Fiedler)........................................................................................................16
Loosening stage...........................................................................................................................16
Tightening stage...........................................................................................................................16
Week 7 – Open science & ethical code of conduct..............................................................................17
Replication study.............................................................................................................................17
Direct replication.............................................................................................................................17
Theoretical reproduction / conceptual replication..........................................................................17
Troubling trio (Lindley)....................................................................................................................17
Metadata studies.............................................................................................................................17
Replication and extension study......................................................................................................17
Publication bias................................................................................................................................17
Quantitative science and publication bias.......................................................................................17
Meta-analysis and publication bias..................................................................................................18
Trim and fail analysis...................................................................................................................18
Commutative meta-analysis........................................................................................................18
Failsafe N – not usable.................................................................................................................18
Meta-regression techniques........................................................................................................18
Open science...................................................................................................................................18
Gold open access.............................................................................................................................18
Green open access...........................................................................................................................18
Sci-hub.............................................................................................................................................18
Week 1 – Introduction + Frequentist statistics......................................................................................4
Frequentist statistics..........................................................................................................................4
Likelihood statistics............................................................................................................................4
Bayesian statistics..............................................................................................................................4
p-values.............................................................................................................................................4
Error rates..........................................................................................................................................4
Type 1 errors......................................................................................................................................4
Type 2 errors......................................................................................................................................5
Week 2 – Likelihoods & Bayesian statistics............................................................................................6
Likelihood ratio..................................................................................................................................6
Binomial likelihood function..............................................................................................................6
Binomial Bayesian inference..............................................................................................................6
Beta distributions in Bayesian statistics.............................................................................................6
Bayes factor.......................................................................................................................................6
Bayesian estimation...........................................................................................................................6
Nomogram.........................................................................................................................................7
Week 3 – Error control..........................................................................................................................8
Type 1 error in multiple testing.........................................................................................................8
Bonferroni correction....................................................................................................................8
Familywise error rate.....................................................................................................................8
Pre-registration..............................................................................................................................8
Holm correlation............................................................................................................................8
Type 1 error in optional stopping......................................................................................................8
Sequential analysis.........................................................................................................................8
Type 2 error and power.....................................................................................................................8
Pre-registration content....................................................................................................................9
Benefits of pre-registration............................................................................................................9
HARKing.............................................................................................................................................9
Confirmatory research.......................................................................................................................9
Week 4 – Effect sizes...........................................................................................................................10
Goals/ uses of effect sizes................................................................................................................10
Unstandardized effect sizes.............................................................................................................10
Standardized effect sizes.................................................................................................................10
r family of effect sizes / correlations................................................................................................10
, d family of effect sizes / Cohens’ d..................................................................................................10
dz.................................................................................................................................................11
ds.................................................................................................................................................11
dav...............................................................................................................................................11
Hedges’ g.....................................................................................................................................11
Variance in data explained by an effect...........................................................................................11
Total variance explained by an effect..........................................................................................11
Partial variance............................................................................................................................11
Cohens’ f......................................................................................................................................12
Generalized eta-squared..............................................................................................................12
Week 5 – Sample size justification, confidence intervals, p-curve analysis.........................................13
Confidence intervals........................................................................................................................13
Confidence interval calculation....................................................................................................13
Capture percentage.........................................................................................................................13
Credible intervals.............................................................................................................................13
Sample sizes.....................................................................................................................................13
Sample size justifications.............................................................................................................13
Small sample size problems.........................................................................................................13
Corridor of stability (Schönbrodt and Perugini)...........................................................................13
Sample size justification approaches...........................................................................................13
p-value distribution.........................................................................................................................14
p-curve analysis...............................................................................................................................14
Week 6 – Philosophy of science and theory........................................................................................15
Demarcation criteria........................................................................................................................15
Modus tollens..................................................................................................................................15
Affirming the consequent................................................................................................................15
Refutation or falsification of a theory..............................................................................................15
Alternative theory............................................................................................................................15
Progressive vs degenerative research line (Lakatos)........................................................................15
Objectivity of science.......................................................................................................................15
Criticism on null hypothesis testing.................................................................................................16
Random assignment vs measured variables....................................................................................16
Crud factor.......................................................................................................................................16
George Box on NHST........................................................................................................................16
Strong inference..............................................................................................................................16
Falsification of a theory...................................................................................................................16
, Scientific theory...............................................................................................................................16
Scientific cycle stages (Fiedler)........................................................................................................16
Loosening stage...........................................................................................................................16
Tightening stage...........................................................................................................................16
Week 7 – Open science & ethical code of conduct..............................................................................17
Replication study.............................................................................................................................17
Direct replication.............................................................................................................................17
Theoretical reproduction / conceptual replication..........................................................................17
Troubling trio (Lindley)....................................................................................................................17
Metadata studies.............................................................................................................................17
Replication and extension study......................................................................................................17
Publication bias................................................................................................................................17
Quantitative science and publication bias.......................................................................................17
Meta-analysis and publication bias..................................................................................................18
Trim and fail analysis...................................................................................................................18
Commutative meta-analysis........................................................................................................18
Failsafe N – not usable.................................................................................................................18
Meta-regression techniques........................................................................................................18
Open science...................................................................................................................................18
Gold open access.............................................................................................................................18
Green open access...........................................................................................................................18
Sci-hub.............................................................................................................................................18
