01-11-2021 1
Table of content
Lecture 8 – Interpretation of results.......................................................................................................1
Individual NPA results.........................................................................................................................1
Evaluating scientific results.................................................................................................................3
Open science......................................................................................................................................6
Summary 8 – Interpretation of test results............................................................................................7
Brooks et al. (2011) – Psychometric foundations for the interpretation of neuropsychological test
results.................................................................................................................................................7
Gelman & Geurts (2017) – The statistical crisis in science: How is it relevant to clinical
neuropsychology?............................................................................................................................11
Making & Orban de Xivry (2019) – Ten common statistical mistakes to watch out for when writing
or reviewing a manuscript................................................................................................................12
Lecture 8 – Interpretation of results
Individual NPA results
Psychometrics: ‘The art of imposing measurement and number upon operations of the mind’
APA: ‘The branch of psychology concerned with the quantification and measurement of mental attributes,
behavior, performance, as well as with the design, analysis, and improvement of the tests, questionnaires, and
other instruments used in such measurement’
This also really includes the evaluation of the test and the resulting measures.
An important factor in evaluating the test quality: reliability.
Inter-rater reliability: The degree of agreement between different
people that are observing or assessing the same thing
Test-retest reliability: Measure the consistency of the result when
you repeat the measure the same thing at a different point of
time.
Parallel-forms reliability: Measures the correlation between two
equivalent versions of a test. This can help to avoid practice
effects, but the versions should be equivalent.
Internal consistency reliability: The correlation between items
within a test that are mean to measure the same construct.
, 01-11-2021 2
Another important factor of test quality is validity.
Validity is the degree to which a test is measuring what is was intended to measure
Translation validity – non-statistical
Face validity: Does the content of the test appear to be suitable towards its aims?
Content validity: Is the test fully representative of what it aims to measure?
Criterion-related validity: Do the results of the test correspond to a different test of the same thing?
Predictive validity: The degree of whether operationalisation can predict other measure of the same
construct that are measured at another time.
Concurrent validity: The degree of whether operationalisation can predict other measure of the same
construct that are measured at the same time
Construct validity: Does the test measure the concept that it is intended to measure?
Convergent validity: The test measures are associated with that it should be associated with.
Discriminant validity: The test measures are not associated with that it should not be associated with
Reliability vs. validity
Test quality – Sensitivity
Sensitivity is the probability of a positive test, given that the person is affected. Will the test detect deficiencies
that actually exist?
Test quality – Specificity
The probability of a negative test, given that a person is healthy. Will the test differentiate specific deficiencies
from related/more global deficiencies.
Sensitivity vs. specificity
Comparative information
Table of content
Lecture 8 – Interpretation of results.......................................................................................................1
Individual NPA results.........................................................................................................................1
Evaluating scientific results.................................................................................................................3
Open science......................................................................................................................................6
Summary 8 – Interpretation of test results............................................................................................7
Brooks et al. (2011) – Psychometric foundations for the interpretation of neuropsychological test
results.................................................................................................................................................7
Gelman & Geurts (2017) – The statistical crisis in science: How is it relevant to clinical
neuropsychology?............................................................................................................................11
Making & Orban de Xivry (2019) – Ten common statistical mistakes to watch out for when writing
or reviewing a manuscript................................................................................................................12
Lecture 8 – Interpretation of results
Individual NPA results
Psychometrics: ‘The art of imposing measurement and number upon operations of the mind’
APA: ‘The branch of psychology concerned with the quantification and measurement of mental attributes,
behavior, performance, as well as with the design, analysis, and improvement of the tests, questionnaires, and
other instruments used in such measurement’
This also really includes the evaluation of the test and the resulting measures.
An important factor in evaluating the test quality: reliability.
Inter-rater reliability: The degree of agreement between different
people that are observing or assessing the same thing
Test-retest reliability: Measure the consistency of the result when
you repeat the measure the same thing at a different point of
time.
Parallel-forms reliability: Measures the correlation between two
equivalent versions of a test. This can help to avoid practice
effects, but the versions should be equivalent.
Internal consistency reliability: The correlation between items
within a test that are mean to measure the same construct.
, 01-11-2021 2
Another important factor of test quality is validity.
Validity is the degree to which a test is measuring what is was intended to measure
Translation validity – non-statistical
Face validity: Does the content of the test appear to be suitable towards its aims?
Content validity: Is the test fully representative of what it aims to measure?
Criterion-related validity: Do the results of the test correspond to a different test of the same thing?
Predictive validity: The degree of whether operationalisation can predict other measure of the same
construct that are measured at another time.
Concurrent validity: The degree of whether operationalisation can predict other measure of the same
construct that are measured at the same time
Construct validity: Does the test measure the concept that it is intended to measure?
Convergent validity: The test measures are associated with that it should be associated with.
Discriminant validity: The test measures are not associated with that it should not be associated with
Reliability vs. validity
Test quality – Sensitivity
Sensitivity is the probability of a positive test, given that the person is affected. Will the test detect deficiencies
that actually exist?
Test quality – Specificity
The probability of a negative test, given that a person is healthy. Will the test differentiate specific deficiencies
from related/more global deficiencies.
Sensitivity vs. specificity
Comparative information
