CONCEPTS DIGITAL
METHODS
Class 2
1) Social desirability problems (cf. non-reactive)
Problems of self-report
2) Imperfect estimates These imperfections can lead to bias
Progrestination “Uitstelgedrag”
Reliability refers to how consistently a method measures something. If the same
Reliability result can be consistently achieved by using the same methods under the same
circumstances, the measurement is considered reliable.
Validity refers to how accurately a method measures what it is intended to
measure. If research has high validity, that means it produces results that
Validity
correspond to real properties, characteristics, and variations in the physical or
social world.
You should not collect more data than necessary. Do not keep track of irrelevant
Data minimization
things.
Replicability refers to whether the results from your test or experiment can be
replicated if repeated exactly the same way. In order to demonstrate replicability,
Replicability
you must provide statistical evidence that shows your results can be used to predict
outcomes in other experiments.
Statistically significant findings are more likely to get published than non-significant
ones.
Publication bias Publication bias refers to the phenomenon that studies published in peer-refereed
journals are much more likely to report statistically significant results than are
studies that report a nonsignificant conclusion, especially for smaller studies.
HARKing is defined as presenting a post hoc hypothesis (i.e., one based on or
HARKing informed by one's results) in one's research report as if it were, in fact, an a priori
hypotheses.
The ability of an experiment or calculation to be duplicated by other researchers
Reproducibility
working independently.
Preregistration involves an a priori specification of hypotheses, methods, and
Preregistration analyses, formally registered on a public website, with a time stamp → can be
viewed by the scientific community .
Class 3
reregistration involves an a priori specification of hypotheses, methods, and
analyses, formally registered on a public website, with a timestamp can be viewed
Preregistration by the scientific community. You make a document beforehand about what you are
going to do, so that people don't start doing it too. You already write down your
hypotheses, etc.
FAIR principles Principles if you want to collect data yourself and how to open it up.
Findable (metadata: give it a name, provide clarity, keywords, who made it, for
what purpose...)
Accessible (be clear to the user, clearly show how they can use it, the DOI is
important for this, you can link a DOI to a dataset, you can also apply for a
licence to create clarity, sometimes you can also put something up and then ask
the user for access first)
Interoperable (be able to reuse data files yourself, use a common data format
(txt and tnt files))
1
CONCEPTS DIGITAL METHODS
METHODS
Class 2
1) Social desirability problems (cf. non-reactive)
Problems of self-report
2) Imperfect estimates These imperfections can lead to bias
Progrestination “Uitstelgedrag”
Reliability refers to how consistently a method measures something. If the same
Reliability result can be consistently achieved by using the same methods under the same
circumstances, the measurement is considered reliable.
Validity refers to how accurately a method measures what it is intended to
measure. If research has high validity, that means it produces results that
Validity
correspond to real properties, characteristics, and variations in the physical or
social world.
You should not collect more data than necessary. Do not keep track of irrelevant
Data minimization
things.
Replicability refers to whether the results from your test or experiment can be
replicated if repeated exactly the same way. In order to demonstrate replicability,
Replicability
you must provide statistical evidence that shows your results can be used to predict
outcomes in other experiments.
Statistically significant findings are more likely to get published than non-significant
ones.
Publication bias Publication bias refers to the phenomenon that studies published in peer-refereed
journals are much more likely to report statistically significant results than are
studies that report a nonsignificant conclusion, especially for smaller studies.
HARKing is defined as presenting a post hoc hypothesis (i.e., one based on or
HARKing informed by one's results) in one's research report as if it were, in fact, an a priori
hypotheses.
The ability of an experiment or calculation to be duplicated by other researchers
Reproducibility
working independently.
Preregistration involves an a priori specification of hypotheses, methods, and
Preregistration analyses, formally registered on a public website, with a time stamp → can be
viewed by the scientific community .
Class 3
reregistration involves an a priori specification of hypotheses, methods, and
analyses, formally registered on a public website, with a timestamp can be viewed
Preregistration by the scientific community. You make a document beforehand about what you are
going to do, so that people don't start doing it too. You already write down your
hypotheses, etc.
FAIR principles Principles if you want to collect data yourself and how to open it up.
Findable (metadata: give it a name, provide clarity, keywords, who made it, for
what purpose...)
Accessible (be clear to the user, clearly show how they can use it, the DOI is
important for this, you can link a DOI to a dataset, you can also apply for a
licence to create clarity, sometimes you can also put something up and then ask
the user for access first)
Interoperable (be able to reuse data files yourself, use a common data format
(txt and tnt files))
1
CONCEPTS DIGITAL METHODS
