Inhoud
HOORCOLLEGE 1: WAAROM DOEN WE ONDERZOEK? ......................................................................... 6
A. DE GROOT – METHODOLOGIE §1.3 & §1.4 ................................................................................ 6
B. MARUYAMA & RYAN H1 ............................................................................................................ 7
HOORCOLLEGE 2: ROL VAN THEORIE................................................................................................... 11
A. KENNISCLIPS ............................................................................................................................. 11
1. CONCEPTUAL MODELS 1 ...................................................................................................... 11
2. CONCEPTUAL MODELS 2 ...................................................................................................... 14
3. CRITERIA: VALIDITY & RELIABILITY ...................................................................................... 14
B. VERSCHUREN & DOOREWAARD: CONCEPTUEEL MODEL ....................................................... 15
1. Samenstelling ....................................................................................................................... 15
2. Soorten relaties en relatiepatronen .................................................................................... 16
C. MARUYAMA & RYAN H2: DOING SOCIAL SCIENCE RESEARCH ............................................... 18
1. The nature of social science theories and hypotheses ....................................................... 18
2. What makes a theory productive? ...................................................................................... 18
3. The functions of research in constructing theories............................................................. 19
4. Criteria for evaluating social science research .................................................................... 20
5. Maximizing construct validity .............................................................................................. 21
6. Maximizing internal validity ................................................................................................ 21
7. Maximizing external validity ................................................................................................ 22
8. Basic and applied research................................................................................................... 22
HOORCOLLEGE 3: ETHIEK ..................................................................................................................... 23
A. KENNISCLIPS ............................................................................................................................. 23
1. UNETHICAL STUDIES ............................................................................................................. 23
2. ETHICS TOWARDS PARTICIPANTS ........................................................................................ 23
3. EXPERIMENTATIE EN METAWETENSCHAP .......................................................................... 25
B. MARUYAMA & RYAN – HOOFDSTUK 3 .................................................................................... 26
1. The Belmont Report ............................................................................................................. 26
2. Focus on ethical issues in experimental research: deception ............................................ 28
3. Using deception in an ethical manner ................................................................................. 29
4. Focus on ethical issues in non-experimental research: participant observation .............. 29
5. Is not doing a study ethical? ................................................................................................ 30
6. The ethical review process ................................................................................................... 30
C. SHADISH, COOK & CAMPBELL PART 2 ..................................................................................... 31
1. The Kuhnian Critique ............................................................................................................ 31
, 2. Modern social psychological critiques ................................................................................. 31
3. Science & trust...................................................................................................................... 32
4. Implications for experiments ............................................................................................... 32
HOORCOLLEGE 4: EXTERNE VALIDITEIT ............................................................................................... 33
A. KENNISCLIPS ............................................................................................................................. 33
1. LABORATORY SETTING 1 ...................................................................................................... 33
2. LABORATORY SETTING 2 ...................................................................................................... 34
3. GOALS ................................................................................................................................... 34
B. MARUYAMA & RYAN – HOOFDSTUK 5 .................................................................................... 36
1. When should the laboratory be used? ................................................................................ 36
2. Types of laboratory study .................................................................................................... 39
3. Artifact and artificiality ........................................................................................................ 40
4. “Artificiality” of the laboratory ............................................................................................ 42
5. Elements of a laboratory study ............................................................................................ 44
HOORCOLLEGE 5: EXTERNE VALIDITEIT ............................................................................................... 49
A. KENNISCLIP ............................................................................................................................... 49
B. MARUYAMA & RYAN – HOOFDSTUK 6 .................................................................................... 50
1. Levels of analysis .................................................................................................................. 50
2. Randomization: pro and con ................................................................................................ 51
3. Illustrations of non-laboratory research ............................................................................. 52
4. Can we afford not to do applied research? ......................................................................... 53
5. Conducting research in community settings ....................................................................... 53
6. Cultural issues....................................................................................................................... 54
7. Control of extraneous factors, statistical and otherwise.................................................... 54
C. MARUYAMA & RYAN – HOOFDSTUK 4 .................................................................................... 55
1. Roles of researchers in work with practitioners, policy makers, and participants in social
research ........................................................................................................................................ 55
2. Importance of work that engages practitioners and is relevant to policy ......................... 56
3. Applied vs translational research ........................................................................................ 59
4. Practical suggestions for developing relations with policy makers, practitioners &
communities ................................................................................................................................. 59
HOORCOLLEGE 6: CONSTRUCTVALIDITEIT .......................................................................................... 63
A. KENNISCLIPS ............................................................................................................................. 63
1. OPERATIONALIZATION ......................................................................................................... 63
2. MEASUREMENT LEVELS........................................................................................................ 64
3. BETROUWBAARHEID ............................................................................................................ 65
, B. MARUYAMA & RYAN – HOOFDSTUK 7 .................................................................................... 69
1. From abstract concepts to concrete representations ......................................................... 69
2. Operational definitions are necessary but rarely sufficient ............................................... 70
3. Measurement presupposes a clearly defined construct..................................................... 71
4. Developing questionnaire items .......................................................................................... 71
5. Question structure ............................................................................................................... 73
6. Question sequence ............................................................................................................... 74
7. Item wording for sensitive questions .................................................................................. 75
8. Creating multiple-item scales .............................................................................................. 75
9. Levels of measurement ........................................................................................................ 76
10. Types of multiple-item scales .......................................................................................... 77
11. Reliability and sources of unreliability ............................................................................ 80
HOORCOLLEGE 7: CONSTRUCTVALIDITEIT .......................................................................................... 84
A. KENNISCLIPS ............................................................................................................................. 84
1. MEASUREMENT VALIDITY .................................................................................................... 84
B. MARUYAMA & RYAN HOOFDSTUK 8 ....................................................................................... 85
1. Using multiple methods of measurement ........................................................................... 85
2. Indirect methods of measurement ...................................................................................... 85
3. Evaluating construct validity ................................................................................................ 87
4. Validity and the nomological net ......................................................................................... 88
5. The multitrait-multimethod matrix ..................................................................................... 88
6. Exploratory and confirmatory factor analyses .................................................................... 89
7. Cultural issues in measurement .......................................................................................... 90
HOORCOLLEGE 8: EXTERNE VALIDITEIT ............................................................................................... 92
A. KENNISCLIPS ............................................................................................................................. 92
1. SAMPLING CONCEPTS .......................................................................................................... 92
2. COMPLEX PROBABILITY SAMPLING ..................................................................................... 92
3. NON-PROBABILITY SAMPLING ............................................................................................. 94
B. MARUYAMA & RYAN – HOOFDSTUK 9 .................................................................................... 95
1. Some basic definitions and concepts................................................................................... 95
2. Nonprobability sampling...................................................................................................... 96
3. Probability sampling............................................................................................................. 96
4. Sampling elements other than people ................................................................................ 99
HOORCOLLEGE 9: INTERNE VALIDITEIT ............................................................................................. 100
A. KENNISCLIPS ........................................................................................................................... 100
1. RANDOMIZED EXPERIMENT ............................................................................................... 100
, 2. Randomized experiment – designs .................................................................................... 101
3. Factorial designs ................................................................................................................. 102
4. INUS condition .................................................................................................................... 103
B. SHADISH, COOK & CAMPBELL (2002) – EXPERIMENTAL AND QUASI-EXPERIMENTAL
DESIGNS FOR GENERALIZED CAUSAL INFERENCE ......................................................................... 103
1. Cause ................................................................................................................................... 103
2. Effect ................................................................................................................................... 103
3. Causal relationship ............................................................................................................. 103
4. Causation, correlation and confounds .............................................................................. 103
5. Manipulable and nonmanipulable causes......................................................................... 104
6. Causal description and causal explanation ....................................................................... 104
C. MARUYAMA & RYAN – HOOFDSTUK 10 ................................................................................ 105
1. Controlling and manipulating variables ............................................................................ 105
2. Random assignment ........................................................................................................... 105
3. Independent variables that vary within and between participants ................................. 105
4. Threats to internal validity................................................................................................. 106
5. Illustrating threats to internal validity with a research example ..................................... 107
6. Construct validity of independent variables in a randomized experiment...................... 107
7. Alternative experimental designs ...................................................................................... 108
8. Repeated measures designs .............................................................................................. 109
9. Analyzing data from experimental designs ....................................................................... 109
10. Strengths and weaknesses of randomized experiments .............................................. 109
HOORCOLLEGE 10: INTERNE VALIDITEIT ........................................................................................... 111
A. KENNISCLIPS ........................................................................................................................... 111
1. MATCHING .......................................................................................................................... 111
B. MARUYAMA & RYAN – HOORDSTUK 11 ............................................................................... 111
1. Conditions for causality...................................................................................................... 111
2. Illustrative nonrandomized designs .................................................................................. 111
3. Single case / single subject designs ................................................................................... 113
4. Regression effects: challenges of matching in quasi-experimentation ............................ 114
HOORCOLLEGE 11: INTERNE VALIDITEIT ........................................................................................... 115
A. KENNISCLIPS ........................................................................................................................... 115
1. OTHER MEASUREMENT TYPES ........................................................................................... 115
B. MARUYAMA & RYAN – HOOFDSTUK 12 ................................................................................ 116
1. Types of non-experimental research ................................................................................. 116
2. Analyzing non-experimental quantitative data ................................................................ 116
HOORCOLLEGE 1: WAAROM DOEN WE ONDERZOEK? ......................................................................... 6
A. DE GROOT – METHODOLOGIE §1.3 & §1.4 ................................................................................ 6
B. MARUYAMA & RYAN H1 ............................................................................................................ 7
HOORCOLLEGE 2: ROL VAN THEORIE................................................................................................... 11
A. KENNISCLIPS ............................................................................................................................. 11
1. CONCEPTUAL MODELS 1 ...................................................................................................... 11
2. CONCEPTUAL MODELS 2 ...................................................................................................... 14
3. CRITERIA: VALIDITY & RELIABILITY ...................................................................................... 14
B. VERSCHUREN & DOOREWAARD: CONCEPTUEEL MODEL ....................................................... 15
1. Samenstelling ....................................................................................................................... 15
2. Soorten relaties en relatiepatronen .................................................................................... 16
C. MARUYAMA & RYAN H2: DOING SOCIAL SCIENCE RESEARCH ............................................... 18
1. The nature of social science theories and hypotheses ....................................................... 18
2. What makes a theory productive? ...................................................................................... 18
3. The functions of research in constructing theories............................................................. 19
4. Criteria for evaluating social science research .................................................................... 20
5. Maximizing construct validity .............................................................................................. 21
6. Maximizing internal validity ................................................................................................ 21
7. Maximizing external validity ................................................................................................ 22
8. Basic and applied research................................................................................................... 22
HOORCOLLEGE 3: ETHIEK ..................................................................................................................... 23
A. KENNISCLIPS ............................................................................................................................. 23
1. UNETHICAL STUDIES ............................................................................................................. 23
2. ETHICS TOWARDS PARTICIPANTS ........................................................................................ 23
3. EXPERIMENTATIE EN METAWETENSCHAP .......................................................................... 25
B. MARUYAMA & RYAN – HOOFDSTUK 3 .................................................................................... 26
1. The Belmont Report ............................................................................................................. 26
2. Focus on ethical issues in experimental research: deception ............................................ 28
3. Using deception in an ethical manner ................................................................................. 29
4. Focus on ethical issues in non-experimental research: participant observation .............. 29
5. Is not doing a study ethical? ................................................................................................ 30
6. The ethical review process ................................................................................................... 30
C. SHADISH, COOK & CAMPBELL PART 2 ..................................................................................... 31
1. The Kuhnian Critique ............................................................................................................ 31
, 2. Modern social psychological critiques ................................................................................. 31
3. Science & trust...................................................................................................................... 32
4. Implications for experiments ............................................................................................... 32
HOORCOLLEGE 4: EXTERNE VALIDITEIT ............................................................................................... 33
A. KENNISCLIPS ............................................................................................................................. 33
1. LABORATORY SETTING 1 ...................................................................................................... 33
2. LABORATORY SETTING 2 ...................................................................................................... 34
3. GOALS ................................................................................................................................... 34
B. MARUYAMA & RYAN – HOOFDSTUK 5 .................................................................................... 36
1. When should the laboratory be used? ................................................................................ 36
2. Types of laboratory study .................................................................................................... 39
3. Artifact and artificiality ........................................................................................................ 40
4. “Artificiality” of the laboratory ............................................................................................ 42
5. Elements of a laboratory study ............................................................................................ 44
HOORCOLLEGE 5: EXTERNE VALIDITEIT ............................................................................................... 49
A. KENNISCLIP ............................................................................................................................... 49
B. MARUYAMA & RYAN – HOOFDSTUK 6 .................................................................................... 50
1. Levels of analysis .................................................................................................................. 50
2. Randomization: pro and con ................................................................................................ 51
3. Illustrations of non-laboratory research ............................................................................. 52
4. Can we afford not to do applied research? ......................................................................... 53
5. Conducting research in community settings ....................................................................... 53
6. Cultural issues....................................................................................................................... 54
7. Control of extraneous factors, statistical and otherwise.................................................... 54
C. MARUYAMA & RYAN – HOOFDSTUK 4 .................................................................................... 55
1. Roles of researchers in work with practitioners, policy makers, and participants in social
research ........................................................................................................................................ 55
2. Importance of work that engages practitioners and is relevant to policy ......................... 56
3. Applied vs translational research ........................................................................................ 59
4. Practical suggestions for developing relations with policy makers, practitioners &
communities ................................................................................................................................. 59
HOORCOLLEGE 6: CONSTRUCTVALIDITEIT .......................................................................................... 63
A. KENNISCLIPS ............................................................................................................................. 63
1. OPERATIONALIZATION ......................................................................................................... 63
2. MEASUREMENT LEVELS........................................................................................................ 64
3. BETROUWBAARHEID ............................................................................................................ 65
, B. MARUYAMA & RYAN – HOOFDSTUK 7 .................................................................................... 69
1. From abstract concepts to concrete representations ......................................................... 69
2. Operational definitions are necessary but rarely sufficient ............................................... 70
3. Measurement presupposes a clearly defined construct..................................................... 71
4. Developing questionnaire items .......................................................................................... 71
5. Question structure ............................................................................................................... 73
6. Question sequence ............................................................................................................... 74
7. Item wording for sensitive questions .................................................................................. 75
8. Creating multiple-item scales .............................................................................................. 75
9. Levels of measurement ........................................................................................................ 76
10. Types of multiple-item scales .......................................................................................... 77
11. Reliability and sources of unreliability ............................................................................ 80
HOORCOLLEGE 7: CONSTRUCTVALIDITEIT .......................................................................................... 84
A. KENNISCLIPS ............................................................................................................................. 84
1. MEASUREMENT VALIDITY .................................................................................................... 84
B. MARUYAMA & RYAN HOOFDSTUK 8 ....................................................................................... 85
1. Using multiple methods of measurement ........................................................................... 85
2. Indirect methods of measurement ...................................................................................... 85
3. Evaluating construct validity ................................................................................................ 87
4. Validity and the nomological net ......................................................................................... 88
5. The multitrait-multimethod matrix ..................................................................................... 88
6. Exploratory and confirmatory factor analyses .................................................................... 89
7. Cultural issues in measurement .......................................................................................... 90
HOORCOLLEGE 8: EXTERNE VALIDITEIT ............................................................................................... 92
A. KENNISCLIPS ............................................................................................................................. 92
1. SAMPLING CONCEPTS .......................................................................................................... 92
2. COMPLEX PROBABILITY SAMPLING ..................................................................................... 92
3. NON-PROBABILITY SAMPLING ............................................................................................. 94
B. MARUYAMA & RYAN – HOOFDSTUK 9 .................................................................................... 95
1. Some basic definitions and concepts................................................................................... 95
2. Nonprobability sampling...................................................................................................... 96
3. Probability sampling............................................................................................................. 96
4. Sampling elements other than people ................................................................................ 99
HOORCOLLEGE 9: INTERNE VALIDITEIT ............................................................................................. 100
A. KENNISCLIPS ........................................................................................................................... 100
1. RANDOMIZED EXPERIMENT ............................................................................................... 100
, 2. Randomized experiment – designs .................................................................................... 101
3. Factorial designs ................................................................................................................. 102
4. INUS condition .................................................................................................................... 103
B. SHADISH, COOK & CAMPBELL (2002) – EXPERIMENTAL AND QUASI-EXPERIMENTAL
DESIGNS FOR GENERALIZED CAUSAL INFERENCE ......................................................................... 103
1. Cause ................................................................................................................................... 103
2. Effect ................................................................................................................................... 103
3. Causal relationship ............................................................................................................. 103
4. Causation, correlation and confounds .............................................................................. 103
5. Manipulable and nonmanipulable causes......................................................................... 104
6. Causal description and causal explanation ....................................................................... 104
C. MARUYAMA & RYAN – HOOFDSTUK 10 ................................................................................ 105
1. Controlling and manipulating variables ............................................................................ 105
2. Random assignment ........................................................................................................... 105
3. Independent variables that vary within and between participants ................................. 105
4. Threats to internal validity................................................................................................. 106
5. Illustrating threats to internal validity with a research example ..................................... 107
6. Construct validity of independent variables in a randomized experiment...................... 107
7. Alternative experimental designs ...................................................................................... 108
8. Repeated measures designs .............................................................................................. 109
9. Analyzing data from experimental designs ....................................................................... 109
10. Strengths and weaknesses of randomized experiments .............................................. 109
HOORCOLLEGE 10: INTERNE VALIDITEIT ........................................................................................... 111
A. KENNISCLIPS ........................................................................................................................... 111
1. MATCHING .......................................................................................................................... 111
B. MARUYAMA & RYAN – HOORDSTUK 11 ............................................................................... 111
1. Conditions for causality...................................................................................................... 111
2. Illustrative nonrandomized designs .................................................................................. 111
3. Single case / single subject designs ................................................................................... 113
4. Regression effects: challenges of matching in quasi-experimentation ............................ 114
HOORCOLLEGE 11: INTERNE VALIDITEIT ........................................................................................... 115
A. KENNISCLIPS ........................................................................................................................... 115
1. OTHER MEASUREMENT TYPES ........................................................................................... 115
B. MARUYAMA & RYAN – HOOFDSTUK 12 ................................................................................ 116
1. Types of non-experimental research ................................................................................. 116
2. Analyzing non-experimental quantitative data ................................................................ 116
