Possible open-ended questions
GRP
1) What is p-hacking?
- It is an exploitation of data analysis to discover patterns which could be
presented as statistically significant, when in reality there is no underlying effect.
Basically, running statistical tests until some statistically significant results arise.
2) Main drawbacks of p values?
- Inability to quantify evidence in favor of the null hypothesis, the sensitivity to
optional stopping and the tendency to overestimate the support in favor of the
alternative hypothesis.
3) What is exploratory behavior the result of?
- It is the result of ambiguity in how best to make these decisions and the
researcher’s desire to find a statistically significant result.
4) What are the common degrees of freedom?
- The 4 are choosing among DVS, choosing the sample size, using covariates and
reporting subsets of experimental conditions.
5) Requirements for authors?
- Authors should decide the rules for terminating data collection prior to the study
beginning; at least 20 observations per cell must be collected; all variables and
experimental conditions collected must be listed; if observations are eliminated,
the results if they were included should be reported; and if a covariate is
included, results without it should be reported.
6) What is preregistration?
- The process where one’s hypotheses, research design and analysis plan are
publicly documented before the study is conducted.
7) What does transparency help with?
- It helps with boosting the efficiency of scientific discovery, protects data loss,
citation benefit, and research designed to be shared is more efficient and
sustainable.
8) What to consider when choosing a repository?
- Whether it uses unique identifiers for products, accommodated structure
metadata, tracks data reuse, accommodates licensing, features access controls
and guarantees long-term access.
9) Describe the 5 principles in the code of conduct.
- Honesty with reporting accurately, not making unfounded claims or fabricating
results. Responsibility to the test subjects in your research by keeping their
interests in mind and conducting scientifically relevant research. Transparency
with being clear about how the research, data and results were obtained and
making sure that the research process is verifiable. Scrupulousness where you
take the best possible care in designing the research and using scientific
methods. Independence with not allowing choices of methods and alternate
statements to be non-scientific. It’s okay in the design, conduct and reporting but
not in the topic and question of research.
10) Explain reproducibility, robustness and replicability.
GRP
1) What is p-hacking?
- It is an exploitation of data analysis to discover patterns which could be
presented as statistically significant, when in reality there is no underlying effect.
Basically, running statistical tests until some statistically significant results arise.
2) Main drawbacks of p values?
- Inability to quantify evidence in favor of the null hypothesis, the sensitivity to
optional stopping and the tendency to overestimate the support in favor of the
alternative hypothesis.
3) What is exploratory behavior the result of?
- It is the result of ambiguity in how best to make these decisions and the
researcher’s desire to find a statistically significant result.
4) What are the common degrees of freedom?
- The 4 are choosing among DVS, choosing the sample size, using covariates and
reporting subsets of experimental conditions.
5) Requirements for authors?
- Authors should decide the rules for terminating data collection prior to the study
beginning; at least 20 observations per cell must be collected; all variables and
experimental conditions collected must be listed; if observations are eliminated,
the results if they were included should be reported; and if a covariate is
included, results without it should be reported.
6) What is preregistration?
- The process where one’s hypotheses, research design and analysis plan are
publicly documented before the study is conducted.
7) What does transparency help with?
- It helps with boosting the efficiency of scientific discovery, protects data loss,
citation benefit, and research designed to be shared is more efficient and
sustainable.
8) What to consider when choosing a repository?
- Whether it uses unique identifiers for products, accommodated structure
metadata, tracks data reuse, accommodates licensing, features access controls
and guarantees long-term access.
9) Describe the 5 principles in the code of conduct.
- Honesty with reporting accurately, not making unfounded claims or fabricating
results. Responsibility to the test subjects in your research by keeping their
interests in mind and conducting scientifically relevant research. Transparency
with being clear about how the research, data and results were obtained and
making sure that the research process is verifiable. Scrupulousness where you
take the best possible care in designing the research and using scientific
methods. Independence with not allowing choices of methods and alternate
statements to be non-scientific. It’s okay in the design, conduct and reporting but
not in the topic and question of research.
10) Explain reproducibility, robustness and replicability.
