PSY 334 test 2 || A+ Guaranteed.
What is the question we're asking when when we refer to validity? correct answers "Are the
inferences I am going to draw from a person's score on a test appropriate?"
Do the scores on an achievement test indicate how well an individual has mastered the content of
a course or training program?
Do the scores on an aptitude test accurately predict a person's ability to perform a task or
activity?
Do the results of an employment test predict future performance on the job?
What is wrong with the older definition of validity which asked the question "Does the test
measure what it was designed to measure" correct answers a test can measure exactly what it was
designed to measure and yet not be valid if the inferences that are made from the test scores are
not supportable
What are the 5 sources of evidence of validity according to the Standards for Educational and
Psychological testing (1999)? correct answers Evidence based on test content
Evidence based on response process
Evidence based on internal structure
Evidence based on relations with other variables
Evidence based on the consequences of testing
Previously, more traditional views of validity:
Content Validity
Criterion-Related Validity
Construct Validity
Which lead us to believe what? and how does the current view differ? correct answers That there
were different "types" of validity. The current view is that validity is a single concept with
multiple sources of evidence to demonstrate it
The first evidence of validity which is "evidence based on test content" focuses on what? correct
answers Focuses on how well the test items sample the behaviors or subject matter the test is
designed to measure.
A classroom math achievement test shows validity evidence based on test content when..?
correct answers the proportion and type of math questions on the exam represent the proportion
and type of material covered in class
An employment interview shows evidence of validity based on content when..? correct answers
it contains questions directly associated with the knowledge, skills, or abilities needed to
successfully perform the job
The second evidence of validity is "evidence based on response process" which involves what?
correct answers Involves an analysis of the fit between the performance and actions the
examinees actually engage in and the construct being measured
, There are several ways of collecting this type of validity evidence based on response process
like? correct answers Interviewing examinees about their response processes and strategies
Recording behavioral indicators such as response times and eye movements
Analyzing the types of errors committed
Evidence based on internal structure can be found by..? correct answers By examining the
internal structure of the test, we can determine if its actual structure is consistent with the
hypothesized structure of the construct it measures
What is an example of evidence based on internal structure? correct answers If a test was
designed to measure a single concept (extraversion) we would analyze the test results to find out
how many underlying concepts account for the variations in the test taker scores. Factor analysis
would be used
Evidence Based on Relationships with External Criteria (Criterion-related Validity ) is? correct
answers The extent to which test scores are systematically related to a relevant criterion
Two types of research designs used to demonstrate criterion-related validity evidence? correct
answers Predictive and concurrent methods
Predictive method correct answers The test is administered, there is an intervening time interval,
and then the criterion is measured
concurrent method correct answers The test is administered and the criterion is measured at
about the same time
Evidence Based on Relations Other Variables (Construct Validity ) involves? correct answers
Involves accumulating evidence that a test is based on sound psychological theory
What are the two strategies for measuring evidence of construct validity? correct answers
convergent and discriminate validity
Convergent evidence of validity correct answers shows that other or similar constructs that
theoretically should be related to the construct measured by the test are indeed related
discriminate evidence of validity correct answers evidence that test scores are not correlated with
unrelated constructs
When should evidence based on the content of the test be used as a validation strategy? correct
answers for achievement tests and tests used in the selection of employees
When should Evidence based on relations with external criteria be used as a validation strategy?
correct answers For tests that predict outcomes
When should Evidence based on relations with other constructs be used as a validation strategy?
correct answers For tests that measure abstract constructs
What is the question we're asking when when we refer to validity? correct answers "Are the
inferences I am going to draw from a person's score on a test appropriate?"
Do the scores on an achievement test indicate how well an individual has mastered the content of
a course or training program?
Do the scores on an aptitude test accurately predict a person's ability to perform a task or
activity?
Do the results of an employment test predict future performance on the job?
What is wrong with the older definition of validity which asked the question "Does the test
measure what it was designed to measure" correct answers a test can measure exactly what it was
designed to measure and yet not be valid if the inferences that are made from the test scores are
not supportable
What are the 5 sources of evidence of validity according to the Standards for Educational and
Psychological testing (1999)? correct answers Evidence based on test content
Evidence based on response process
Evidence based on internal structure
Evidence based on relations with other variables
Evidence based on the consequences of testing
Previously, more traditional views of validity:
Content Validity
Criterion-Related Validity
Construct Validity
Which lead us to believe what? and how does the current view differ? correct answers That there
were different "types" of validity. The current view is that validity is a single concept with
multiple sources of evidence to demonstrate it
The first evidence of validity which is "evidence based on test content" focuses on what? correct
answers Focuses on how well the test items sample the behaviors or subject matter the test is
designed to measure.
A classroom math achievement test shows validity evidence based on test content when..?
correct answers the proportion and type of math questions on the exam represent the proportion
and type of material covered in class
An employment interview shows evidence of validity based on content when..? correct answers
it contains questions directly associated with the knowledge, skills, or abilities needed to
successfully perform the job
The second evidence of validity is "evidence based on response process" which involves what?
correct answers Involves an analysis of the fit between the performance and actions the
examinees actually engage in and the construct being measured
, There are several ways of collecting this type of validity evidence based on response process
like? correct answers Interviewing examinees about their response processes and strategies
Recording behavioral indicators such as response times and eye movements
Analyzing the types of errors committed
Evidence based on internal structure can be found by..? correct answers By examining the
internal structure of the test, we can determine if its actual structure is consistent with the
hypothesized structure of the construct it measures
What is an example of evidence based on internal structure? correct answers If a test was
designed to measure a single concept (extraversion) we would analyze the test results to find out
how many underlying concepts account for the variations in the test taker scores. Factor analysis
would be used
Evidence Based on Relationships with External Criteria (Criterion-related Validity ) is? correct
answers The extent to which test scores are systematically related to a relevant criterion
Two types of research designs used to demonstrate criterion-related validity evidence? correct
answers Predictive and concurrent methods
Predictive method correct answers The test is administered, there is an intervening time interval,
and then the criterion is measured
concurrent method correct answers The test is administered and the criterion is measured at
about the same time
Evidence Based on Relations Other Variables (Construct Validity ) involves? correct answers
Involves accumulating evidence that a test is based on sound psychological theory
What are the two strategies for measuring evidence of construct validity? correct answers
convergent and discriminate validity
Convergent evidence of validity correct answers shows that other or similar constructs that
theoretically should be related to the construct measured by the test are indeed related
discriminate evidence of validity correct answers evidence that test scores are not correlated with
unrelated constructs
When should evidence based on the content of the test be used as a validation strategy? correct
answers for achievement tests and tests used in the selection of employees
When should Evidence based on relations with external criteria be used as a validation strategy?
correct answers For tests that predict outcomes
When should Evidence based on relations with other constructs be used as a validation strategy?
correct answers For tests that measure abstract constructs
