3006PSY Week 3: Chapter 5 Reliability || very Flawless.
alternate forms correct answers Different versions of the same test or measure; contrast with
parallel forms
alternate-forms reliability correct answers An estimate of the extent to which item sampling and
other errors have affected scores on two versions of the same test; contrast with parallel-forms
reliability
average proportional distance (APD) correct answers A measure used to evaluate the internal
consistency of a test that focuses on the degree of difference that exists between item scores
classical test theory (CTT) correct answers Also known as
true score theory and the true score model, a system of assumptions about measurement that
includes the notion that a test score (and even a response to an individual item) is composed of a
relatively stable component that actually is what the test or individual item is designed to
measure, as well as a component that is error
coefficient alpha correct answers Also referred to as Cronbach's alpha and alpha, a statistic
widely employed in test construction and used to assist in deriving an estimate of reliability;
more technically, it is equal to the mean of all split-half reliabilities
coefficient of equivalence correct answers An estimate of parallel-forms reliability or alternate-
forms reliability
coefficient of generalizability correct answers In generalizability theory, an index of the
influence that particular facets have on a test score
coefficient of inter-scorer reliability correct answers Determines the degree of consistency
among scores in the soring of a test
coefficient of stability correct answers An estimate of test- retest reliability obtained during time
intervals of six months or longer,
confidence interval correct answers A range or band of test scores that is likely to contain the
"true score,
content sampling correct answers The variety of the subject matter contained in the items;
frequently referred to in the context of the variation between individual test items in a test or
between test items in two or more tests and also referred to as item sampling
criterion-referenced test correct answers Also referred to as domain- referenced testing and
assessment and content-referenced testing and assessment, a method of evaluation and a way of
deriving meaning from test scores by evaluating an individual's score with reference to a set
standard (or criterion); contrast with norm-referenced testing and assessment
, decision study correct answers Conducted at the conclusion
of a generalizability study, this research is designed to explore the utility and value of test scores
in making decisions
dichotomous test item correct answers A test item or question that can be answered with only
one of two response options, such as true-false or yes-no
discrimination correct answers In IRT, the degree to which an item differentiates among people
with higher or lower levels of the trait, ability, or whatever it is that is being measured by a test
domain sampling theory correct answers a system of assumptions about measurement that
includes the notion that a test score (and even a response to an individual item) consists of a
relatively stable component that actually is what the test or individual item is designed to
measure as well as relatively unstable components that collectively can be accounted for as error
dynamic characteristic correct answers A trait, state, or
ability presumed to be ever-changing as a function of situational and cognitive experiences;
contrast with static characteristic
error variance correct answers In the true score model, the component of variance attributable to
random sources irrelevant to the trait or ability the test purports to measure in an observed score
or distribution of scores; common sources of error variance include those related to test
construction (including item or content sampling), test administration, and test scoring and
interpretation
estimate of inter-item consistency correct answers An estimate of the reliability of a test obtained
from a measure of inter-item consistency
facet correct answers In generalizability theory, variables of interest in the universe including,
for example, the number of items in the test, the amount of training the test scorers have had, and
the purpose of the test administration
generalizability study correct answers In the context of
generalizability theory, research conducted to explore the impact of different facets of the
universe on a test score,
generalizability theory correct answers Also referred to as domain sampling theory, a system of
assumptions about measurement that includes the notion that a test score (and even a response to
an individual item) consists of a relatively stable component that actually is what the test or
individual item is designed to measure as well as relatively unstable components that collectively
can be accounted for as error,
heterogeneity correct answers Describes the degree to which
a test measures different factors
homogeneity correct answers Describes the degree to which a
alternate forms correct answers Different versions of the same test or measure; contrast with
parallel forms
alternate-forms reliability correct answers An estimate of the extent to which item sampling and
other errors have affected scores on two versions of the same test; contrast with parallel-forms
reliability
average proportional distance (APD) correct answers A measure used to evaluate the internal
consistency of a test that focuses on the degree of difference that exists between item scores
classical test theory (CTT) correct answers Also known as
true score theory and the true score model, a system of assumptions about measurement that
includes the notion that a test score (and even a response to an individual item) is composed of a
relatively stable component that actually is what the test or individual item is designed to
measure, as well as a component that is error
coefficient alpha correct answers Also referred to as Cronbach's alpha and alpha, a statistic
widely employed in test construction and used to assist in deriving an estimate of reliability;
more technically, it is equal to the mean of all split-half reliabilities
coefficient of equivalence correct answers An estimate of parallel-forms reliability or alternate-
forms reliability
coefficient of generalizability correct answers In generalizability theory, an index of the
influence that particular facets have on a test score
coefficient of inter-scorer reliability correct answers Determines the degree of consistency
among scores in the soring of a test
coefficient of stability correct answers An estimate of test- retest reliability obtained during time
intervals of six months or longer,
confidence interval correct answers A range or band of test scores that is likely to contain the
"true score,
content sampling correct answers The variety of the subject matter contained in the items;
frequently referred to in the context of the variation between individual test items in a test or
between test items in two or more tests and also referred to as item sampling
criterion-referenced test correct answers Also referred to as domain- referenced testing and
assessment and content-referenced testing and assessment, a method of evaluation and a way of
deriving meaning from test scores by evaluating an individual's score with reference to a set
standard (or criterion); contrast with norm-referenced testing and assessment
, decision study correct answers Conducted at the conclusion
of a generalizability study, this research is designed to explore the utility and value of test scores
in making decisions
dichotomous test item correct answers A test item or question that can be answered with only
one of two response options, such as true-false or yes-no
discrimination correct answers In IRT, the degree to which an item differentiates among people
with higher or lower levels of the trait, ability, or whatever it is that is being measured by a test
domain sampling theory correct answers a system of assumptions about measurement that
includes the notion that a test score (and even a response to an individual item) consists of a
relatively stable component that actually is what the test or individual item is designed to
measure as well as relatively unstable components that collectively can be accounted for as error
dynamic characteristic correct answers A trait, state, or
ability presumed to be ever-changing as a function of situational and cognitive experiences;
contrast with static characteristic
error variance correct answers In the true score model, the component of variance attributable to
random sources irrelevant to the trait or ability the test purports to measure in an observed score
or distribution of scores; common sources of error variance include those related to test
construction (including item or content sampling), test administration, and test scoring and
interpretation
estimate of inter-item consistency correct answers An estimate of the reliability of a test obtained
from a measure of inter-item consistency
facet correct answers In generalizability theory, variables of interest in the universe including,
for example, the number of items in the test, the amount of training the test scorers have had, and
the purpose of the test administration
generalizability study correct answers In the context of
generalizability theory, research conducted to explore the impact of different facets of the
universe on a test score,
generalizability theory correct answers Also referred to as domain sampling theory, a system of
assumptions about measurement that includes the notion that a test score (and even a response to
an individual item) consists of a relatively stable component that actually is what the test or
individual item is designed to measure as well as relatively unstable components that collectively
can be accounted for as error,
heterogeneity correct answers Describes the degree to which
a test measures different factors
homogeneity correct answers Describes the degree to which a
