PYC480-7
Table of Contents
Table of Contents .................................................................................................................................... 1
1. INTRODUCTION ............................................................................................................................... 3
Developing a psychological measure .................................................................................................. 3
1.1 Phase 1: Planning ................................................................................................................ 3
1.2 Phase 2: Item Writing .......................................................................................................... 4
1.3 Phase 3: Assembling and pre-testing the experiential version of a measure .................... 4
1.4 Phase 4: Item Analysis ......................................................................................................... 5
1.5 Phase 5: Revising and standardizing the final version of the measure ............................... 5
1.6 Phase 6: Technical evaluation and establishing norms ....................................................... 6
2. ADAPTATION OF ASSESSMENT........................................................................................................ 6
2.1 Enhancing fairness ............................................................................................................... 6
2.2 Reducing the time and costs ............................................................................................... 6
2.3 Steps in the adaptation process .............................................................................................. 7
2.3.1 Suitability of the instrument ........................................................................................... 7
2.3.1.2 Language ......................................................................................................................... 7
2.3.2 Culture ............................................................................................................................. 7
2.3.4 Environment .................................................................................................................... 8
3. TEST RELIABILITY ............................................................................................................................. 8
3.1 Types of reliability ......................................................................................................................... 9
3.1.1 Test retest reliability............................................................................................................... 9
3.1.1 Disadvantages of test retest reliability ............................................................................ 9
3.1.2 Alternate- Form reliability ............................................................................................... 9
3.1.2.1 Disadvantages of alternate form reliability .................................................................... 9
3.1.3 Split Half reliability .......................................................................................................... 9
3.1.4 Inter Item consistency ..................................................................................................... 9
3.1.5 Inter Rater reliability ....................................................................................................... 9
3.1.6 Intra rater reliability ...................................................................................................... 10
3.2 Possible factors that might affect reliability. ........................................................................ 10
3.2.1 Responded error............................................................................................................ 10
3.2.1.1 Non- Response error: .................................................................................................... 10
3.2.1.2 Response bias ................................................................................................................ 10
3.3 Generalizability theory .......................................................................................................... 10
1
, PYC480-7
4 VALIDITY ........................................................................................................................................ 10
4.1 Definition: ............................................................................................................................. 10
4.2 Types of validity: ................................................................................................................... 10
4.2.1 Face Validity: ........................................................................................................................ 10
4.2.2 Content validity: ................................................................................................................... 11
4.2.3 Construct Validity: ................................................................................................................ 11
4.2.4 Criterion predicted validity................................................................................................... 11
4.2.5 Concurrent validity: .............................................................................................................. 11
4.2.6 Predictive Validity:................................................................................................................ 11
5 NORMS .......................................................................................................................................... 11
5.1 Standard normal distribution ................................................................................................ 12
Figure 1 .............................................................................................................................................. 12
5.2 Establishing group norm........................................................................................................ 12
5.2.1 Types of norms .................................................................................................................. 12
5.2.1.1 Developmental scales:................................................................................................... 12
5.2.1.2 mental age ..................................................................................................................... 12
5.2.1.3 Grade equivalence......................................................................................................... 12
5.2.1.4 Percentiles ..................................................................................................................... 12
5.2.2 Standard scores ............................................................................................................. 12
5.2.2.1 Z Scores ......................................................................................................................... 12
5.2.2.2 Deviation IQ Scale.......................................................................................................... 12
6. CONCLUSION ................................................................................................................................. 13
6 REFERENCES .................................................................................................................................. 13
2
Table of Contents
Table of Contents .................................................................................................................................... 1
1. INTRODUCTION ............................................................................................................................... 3
Developing a psychological measure .................................................................................................. 3
1.1 Phase 1: Planning ................................................................................................................ 3
1.2 Phase 2: Item Writing .......................................................................................................... 4
1.3 Phase 3: Assembling and pre-testing the experiential version of a measure .................... 4
1.4 Phase 4: Item Analysis ......................................................................................................... 5
1.5 Phase 5: Revising and standardizing the final version of the measure ............................... 5
1.6 Phase 6: Technical evaluation and establishing norms ....................................................... 6
2. ADAPTATION OF ASSESSMENT........................................................................................................ 6
2.1 Enhancing fairness ............................................................................................................... 6
2.2 Reducing the time and costs ............................................................................................... 6
2.3 Steps in the adaptation process .............................................................................................. 7
2.3.1 Suitability of the instrument ........................................................................................... 7
2.3.1.2 Language ......................................................................................................................... 7
2.3.2 Culture ............................................................................................................................. 7
2.3.4 Environment .................................................................................................................... 8
3. TEST RELIABILITY ............................................................................................................................. 8
3.1 Types of reliability ......................................................................................................................... 9
3.1.1 Test retest reliability............................................................................................................... 9
3.1.1 Disadvantages of test retest reliability ............................................................................ 9
3.1.2 Alternate- Form reliability ............................................................................................... 9
3.1.2.1 Disadvantages of alternate form reliability .................................................................... 9
3.1.3 Split Half reliability .......................................................................................................... 9
3.1.4 Inter Item consistency ..................................................................................................... 9
3.1.5 Inter Rater reliability ....................................................................................................... 9
3.1.6 Intra rater reliability ...................................................................................................... 10
3.2 Possible factors that might affect reliability. ........................................................................ 10
3.2.1 Responded error............................................................................................................ 10
3.2.1.1 Non- Response error: .................................................................................................... 10
3.2.1.2 Response bias ................................................................................................................ 10
3.3 Generalizability theory .......................................................................................................... 10
1
, PYC480-7
4 VALIDITY ........................................................................................................................................ 10
4.1 Definition: ............................................................................................................................. 10
4.2 Types of validity: ................................................................................................................... 10
4.2.1 Face Validity: ........................................................................................................................ 10
4.2.2 Content validity: ................................................................................................................... 11
4.2.3 Construct Validity: ................................................................................................................ 11
4.2.4 Criterion predicted validity................................................................................................... 11
4.2.5 Concurrent validity: .............................................................................................................. 11
4.2.6 Predictive Validity:................................................................................................................ 11
5 NORMS .......................................................................................................................................... 11
5.1 Standard normal distribution ................................................................................................ 12
Figure 1 .............................................................................................................................................. 12
5.2 Establishing group norm........................................................................................................ 12
5.2.1 Types of norms .................................................................................................................. 12
5.2.1.1 Developmental scales:................................................................................................... 12
5.2.1.2 mental age ..................................................................................................................... 12
5.2.1.3 Grade equivalence......................................................................................................... 12
5.2.1.4 Percentiles ..................................................................................................................... 12
5.2.2 Standard scores ............................................................................................................. 12
5.2.2.1 Z Scores ......................................................................................................................... 12
5.2.2.2 Deviation IQ Scale.......................................................................................................... 12
6. CONCLUSION ................................................................................................................................. 13
6 REFERENCES .................................................................................................................................. 13
2
