🪸
THEME 1: Steps in developing a
psychological
measure
TO-DO LIST LINKS
insert link(s) of your school
page/lecture videos/helpful videos
etc
PM: Chapter 6
QUESTIONS
CONCISE NOTES
It takes three to five years to develop a new measure from the point at which
the idea is conceived to the moment when the measure is published and
becomes available to the consumer.
In-depth, advanced psychometric knowledge and test-development expertise
are required by those who initiate and guide the development process.
THEME 1: Steps in developing a psychological measure 1
, 1. LO1: Describe the planning phase of test development
🧠 6.2.1 The Planning Phase of Test Development
THEME 1: Steps in developing a psychological measure 2
, “A test without a plan is like a building without a blueprint.” – Adapted
from Foxcroft (2004)
🎯 Purpose of the Planning Phase
To create a blueprint that guides the development, design, and
administration of a psychological measure.
Especially important for multicultural and multilingual contexts, where
bias and cultural relevance are key concerns.
It is a dynamic process — earlier steps may need revision as new
decisions are made.
📌 Key Steps in the Planning Phase
1. 🧑🔬 Establish a Test Development Team
A diverse and competent team is essential. Members may include:
Team Member Role/Expertise
Psychometric expertise, test development
Project Leader
oversight
Deep knowledge of the attribute/construct being
Construct Domain Experts
measured
Psychometricians &
Ensure reliability, validity, and item analysis
Statisticians
Ensure relevance and fairness in
Cultural & Linguistic Experts
multilingual/multicultural contexts
Ensure practical applicability in real-world
Psychology Field Experts
contexts
Designers/Developers For tech-based/performance-based assessments
Administrative Support Manage logistics and coordination
✅ Efficient approach: Start with a core team, then consult specialist teams
as needed throughout development.
2. 📘 Specify the Aim, Target Population, and Nature of the Measure
The test plan must clearly describe:
Aim/Purpose (e.g., screening, diagnosis, selection)
Construct to be measured (e.g., emotional intelligence, memory)
THEME 1: Steps in developing a psychological measure 3
, Population: Age, culture, education level, etc.
Administration mode: Individual vs group; paper-based, digital, or
performance-based
Normative vs Ipsative vs Criterion-Referenced
Budget/Cost considerations
Technology-related impact: Psychometric fairness, accessibility,
delivery platforms, etc.
THEME 1: Steps in developing a psychological measure 4
THEME 1: Steps in developing a
psychological
measure
TO-DO LIST LINKS
insert link(s) of your school
page/lecture videos/helpful videos
etc
PM: Chapter 6
QUESTIONS
CONCISE NOTES
It takes three to five years to develop a new measure from the point at which
the idea is conceived to the moment when the measure is published and
becomes available to the consumer.
In-depth, advanced psychometric knowledge and test-development expertise
are required by those who initiate and guide the development process.
THEME 1: Steps in developing a psychological measure 1
, 1. LO1: Describe the planning phase of test development
🧠 6.2.1 The Planning Phase of Test Development
THEME 1: Steps in developing a psychological measure 2
, “A test without a plan is like a building without a blueprint.” – Adapted
from Foxcroft (2004)
🎯 Purpose of the Planning Phase
To create a blueprint that guides the development, design, and
administration of a psychological measure.
Especially important for multicultural and multilingual contexts, where
bias and cultural relevance are key concerns.
It is a dynamic process — earlier steps may need revision as new
decisions are made.
📌 Key Steps in the Planning Phase
1. 🧑🔬 Establish a Test Development Team
A diverse and competent team is essential. Members may include:
Team Member Role/Expertise
Psychometric expertise, test development
Project Leader
oversight
Deep knowledge of the attribute/construct being
Construct Domain Experts
measured
Psychometricians &
Ensure reliability, validity, and item analysis
Statisticians
Ensure relevance and fairness in
Cultural & Linguistic Experts
multilingual/multicultural contexts
Ensure practical applicability in real-world
Psychology Field Experts
contexts
Designers/Developers For tech-based/performance-based assessments
Administrative Support Manage logistics and coordination
✅ Efficient approach: Start with a core team, then consult specialist teams
as needed throughout development.
2. 📘 Specify the Aim, Target Population, and Nature of the Measure
The test plan must clearly describe:
Aim/Purpose (e.g., screening, diagnosis, selection)
Construct to be measured (e.g., emotional intelligence, memory)
THEME 1: Steps in developing a psychological measure 3
, Population: Age, culture, education level, etc.
Administration mode: Individual vs group; paper-based, digital, or
performance-based
Normative vs Ipsative vs Criterion-Referenced
Budget/Cost considerations
Technology-related impact: Psychometric fairness, accessibility,
delivery platforms, etc.
THEME 1: Steps in developing a psychological measure 4
