Psychological Survey Development - PYC2616
Note 1
Module Overview
● Module Title: Psychological Survey Development PYC2616.
● Focus: Development of survey questionnaires in psychological research.
● Key Topics:
● Identifying research aims and goals.
● Defining target respondents.
● Developing effective questions.
● Choosing appropriate question types.
● Designing questions and overall layout.
● Conducting pilot studies to evaluate questions.
● Reporting results and compiling manuals.
● Importance: Helps in asking the right questions and collecting relevant data for psychological studies.
Note 2
Contextual Understanding of Questionnaire Design
● Psychological Assessment: Originates from the need to quantify human behavior through questionnaires.
● Cultural Sensitivity: Design must reflect sensitivity to diversity and local contexts.
● Controversy in Application: Psychological questionnaires have a history of misuse in non-Western contexts,
particularly South Africa, where they perpetuated racial discrimination.
● Decolonisation: Involves critiquing Eurocentric ideologies and developing culturally relevant psychological
practices.
● Recommendations: Develop contextually appropriate, fair, and unbiased questionnaires that consider individual
factors (e.g., language, race, age).
Note 3
Bias and Equivalence in Questionnaire Design
● Types of Bias:
1. Construct Bias: The construct may not hold the same meaning across cultures.
2. Method Bias: Bias arising from measurement methods or processes.
3. Item Bias: Items may have different meanings across cultures.
● Strategies to Reduce Bias:
● Construct Bias: Develop instruments in multiple cultures (decentering).
● Method Bias: Train administrators, provide detailed guidelines, and consider cultural context.
● Item Bias: Use judgmental methods for item bias detection.
Note 4
,Learning Outcomes and Assessment
● Key Learning Outcomes:
● Ability to design and evaluate measurement items for multicultural settings.
● Understanding psychometric properties of measurement items and questionnaires.
● Awareness of cross-cultural differences in survey relevance and saliency.
● Assessment Criteria:
● Technical correctness of measurement items.
● Appraisal of psychometric properties.
● Sensitivity to respondents' cultural frameworks.
● Activities: Each lesson includes self-tests and exercises to reinforce learning.
Note 5
Assessment Overview
● The assignments (Assignment 01 and Assignment 02) are designed to align with the examination's outcomes
and criteria, providing a clear understanding of the exam format.
● Practical advice for assignments includes carefully unpacking assessment scenarios by considering various
components such as:
● Assessment context
● Concern raised
● Owner of the concern
● Consultant and their intention
● Test user and their intention
● Target group for assessment
● Questionnaire and its intention.
Note 6
Feedback Mechanism
● Students will receive detailed feedback on Assignments 01 and 02, which will help evaluate their learning
progress.
● The feedback will include answers to questions, discussions, and explanations for correct and incorrect options.
● It is crucial to review mistakes and refer back to the study guide sections for clarification.
Note 7
Study Hours and Thematic Approach
● A 12-credit module equates to 120 notional hours of study.
● This time is allocated for reading, familiarization with content, and completing assignments, excluding
examination preparation.
● Students are encouraged to follow the thematic approach presented in the study guide, completing activities
sequentially to acquire desired skills and knowledge necessary for developing questionnaires and manuals.
Note 8
, Research Process Overview
● The research process consists of five main steps:
4. Research question or idea
5. Choosing and designing research
6. Collecting data
7. Analyzing data
8. Publishing data
● Key research methods utilized in psychology include:
● Observation
● Experiment
● Case study
● Survey (questionnaires)
● Consideration of cross-cultural aspects and decolonization in methodological approaches is essential.
Note 9
Questionnaire Design Components
● The module will cover various components of questionnaire design, including:
9. Identifying a suitable content domain
10. Designing a questionnaire
11. Writing questionnaire items
12. Pilot-testing a questionnaire
13. Evaluating reliability and validity
14. Compiling a manual
15. Reviewing a questionnaire and a manual
16. Accessing resource material
● Establishing cultural equivalence is key, which involves understanding shared norms, beliefs, and values.
Note 10
Content Domain Definition and Importance
● A content domain is defined as the body of knowledge, skills, or abilities being measured in a research study.
● It is crucial for ensuring that the questionnaire accurately measures its intended subject.
● Experimental validity is highlighted as crucial for questionnaires, evidenced by the example of a depression
questionnaire that effectively covers the content domain of depression.
● Reliability and validity are essential characteristics; a test must be consistent in its results (reliable) and
measure what it aims to measure (valid).
Note 11
Characteristics of a Good Questionnaire
● A good questionnaire should have a clearly defined purpose, centered around key questions such as:
Note 1
Module Overview
● Module Title: Psychological Survey Development PYC2616.
● Focus: Development of survey questionnaires in psychological research.
● Key Topics:
● Identifying research aims and goals.
● Defining target respondents.
● Developing effective questions.
● Choosing appropriate question types.
● Designing questions and overall layout.
● Conducting pilot studies to evaluate questions.
● Reporting results and compiling manuals.
● Importance: Helps in asking the right questions and collecting relevant data for psychological studies.
Note 2
Contextual Understanding of Questionnaire Design
● Psychological Assessment: Originates from the need to quantify human behavior through questionnaires.
● Cultural Sensitivity: Design must reflect sensitivity to diversity and local contexts.
● Controversy in Application: Psychological questionnaires have a history of misuse in non-Western contexts,
particularly South Africa, where they perpetuated racial discrimination.
● Decolonisation: Involves critiquing Eurocentric ideologies and developing culturally relevant psychological
practices.
● Recommendations: Develop contextually appropriate, fair, and unbiased questionnaires that consider individual
factors (e.g., language, race, age).
Note 3
Bias and Equivalence in Questionnaire Design
● Types of Bias:
1. Construct Bias: The construct may not hold the same meaning across cultures.
2. Method Bias: Bias arising from measurement methods or processes.
3. Item Bias: Items may have different meanings across cultures.
● Strategies to Reduce Bias:
● Construct Bias: Develop instruments in multiple cultures (decentering).
● Method Bias: Train administrators, provide detailed guidelines, and consider cultural context.
● Item Bias: Use judgmental methods for item bias detection.
Note 4
,Learning Outcomes and Assessment
● Key Learning Outcomes:
● Ability to design and evaluate measurement items for multicultural settings.
● Understanding psychometric properties of measurement items and questionnaires.
● Awareness of cross-cultural differences in survey relevance and saliency.
● Assessment Criteria:
● Technical correctness of measurement items.
● Appraisal of psychometric properties.
● Sensitivity to respondents' cultural frameworks.
● Activities: Each lesson includes self-tests and exercises to reinforce learning.
Note 5
Assessment Overview
● The assignments (Assignment 01 and Assignment 02) are designed to align with the examination's outcomes
and criteria, providing a clear understanding of the exam format.
● Practical advice for assignments includes carefully unpacking assessment scenarios by considering various
components such as:
● Assessment context
● Concern raised
● Owner of the concern
● Consultant and their intention
● Test user and their intention
● Target group for assessment
● Questionnaire and its intention.
Note 6
Feedback Mechanism
● Students will receive detailed feedback on Assignments 01 and 02, which will help evaluate their learning
progress.
● The feedback will include answers to questions, discussions, and explanations for correct and incorrect options.
● It is crucial to review mistakes and refer back to the study guide sections for clarification.
Note 7
Study Hours and Thematic Approach
● A 12-credit module equates to 120 notional hours of study.
● This time is allocated for reading, familiarization with content, and completing assignments, excluding
examination preparation.
● Students are encouraged to follow the thematic approach presented in the study guide, completing activities
sequentially to acquire desired skills and knowledge necessary for developing questionnaires and manuals.
Note 8
, Research Process Overview
● The research process consists of five main steps:
4. Research question or idea
5. Choosing and designing research
6. Collecting data
7. Analyzing data
8. Publishing data
● Key research methods utilized in psychology include:
● Observation
● Experiment
● Case study
● Survey (questionnaires)
● Consideration of cross-cultural aspects and decolonization in methodological approaches is essential.
Note 9
Questionnaire Design Components
● The module will cover various components of questionnaire design, including:
9. Identifying a suitable content domain
10. Designing a questionnaire
11. Writing questionnaire items
12. Pilot-testing a questionnaire
13. Evaluating reliability and validity
14. Compiling a manual
15. Reviewing a questionnaire and a manual
16. Accessing resource material
● Establishing cultural equivalence is key, which involves understanding shared norms, beliefs, and values.
Note 10
Content Domain Definition and Importance
● A content domain is defined as the body of knowledge, skills, or abilities being measured in a research study.
● It is crucial for ensuring that the questionnaire accurately measures its intended subject.
● Experimental validity is highlighted as crucial for questionnaires, evidenced by the example of a depression
questionnaire that effectively covers the content domain of depression.
● Reliability and validity are essential characteristics; a test must be consistent in its results (reliable) and
measure what it aims to measure (valid).
Note 11
Characteristics of a Good Questionnaire
● A good questionnaire should have a clearly defined purpose, centered around key questions such as:
