PSYCH 440 Final/Psychology 440 Exam 3/Psychology 440 Final Exam - Iowa State University

PSYCH 440 Final/Psychology 440 Exam 3/Psychology 440 Final Exam - Iowa State University What historical event was the impetus for the awarding of federal funds to schools in an effort to identify gifted and talented students? The launch of Sputnik The Chinese testing program between 1115 BC and 1905 BC is most similar to what? Civil Service In everyday practice, responsibility for appropriate test administration, scoring and interpretation lies with who? Test users What is the definition of psychometrics? The science of psychological measurement A psychological test almost always involves an analysis of what? A sample of behavior What is the primary use of tests in a counseling setting? To assist the client with life choices The privilege referred to in the term "privileged communication" belongs to who? The test taker If a distribution of scores has extremely low scores and no corresponding high scores, the mean would be what? The mean would be smaller than the median The mean takes into the account the exact mathematical size of what? Every score in the distribution A distribution that is relatively flat is referred to as what? Platykeuric The t-score for an IQ score of 115 on an IQ test that has a mean of 100 and a SD of 15 is what? 60 Why can intelligence test scores not be considered a ratio scale of measurement? A score of zero does not represent an absence of intelligence If the results of an examination are positively skewed, the exam questions were likely to be what? Difficult What did Wundt focus on? How individuals were the same rather than different Who develops ethical standards in the field of psychological testing and assessment? Professional organizations Across cultures, decisions regarding mental health/illness are most influenced by what? Societal standards When is the Pearson correlation coefficient used? Only when the relations between variables are linear What is the error in psychological measurement? An expected component of measurement A test is considered standardized it if includes what three things? Clearly specified procedures for administration, clearly specified procedures for scoring, normative data What is an example of the most appropriate for the use of criterion-referenced tests? Testing knowledge of basic traffic signs and signals for a driver's license What is the type of scaling exemplified in the measurement of temperature with a Fahrenheit thermometer? Interval Frequency distribution of test scores are frequently illustrated by which kind of graph? A histogram What statistic can be used for all scales of measurement? Mode What statistic conveys the least precise measure of dispersion? Range Measurement can be defined as what? The assignment of numbers or symbols to characteristics of objects/people What is the purpose of psychological testing and assessment? To predict future behavior Norms refer to what? Scores with which the results of measurement can be compared to What time of test is an applicant for a job with the postal service scores in the top 5? Norm-referenced The 20th percentile represents what? The score at or below which 20% of the scores in the distribution fall What is the most important issue when using a norm-referenced test? Whom the test taker is being compared to The actual raw score difference between the 50th and 55th percentiles compared with the 90th and 95th percentiles is likely to be what? Smaller A sample of all different subgroups within a population is what type of a sampling? Stratified sampling A test with a mean of 70, SD of 12, and score equal to 2 SD above the mean is what score? 94 A psychologist is interested in predicting suicide risk from severity of depression, duration of depression, and number of previous suicide attempts. The most appropriate statistical technique would be what? Multiple regression Explain what is meant by the following equation: X = T + E X = observed score on some test, T = true score on some construct, E = error effecting the observed score What is Cronbach's Alpha calculated? Take the average of all the split-half reliabilities If the reliability of a test increases, what would happen to the Standard Error of Measure? Decreases What does the Standard Error of Measurement measure? It is a score's standard deviation used to determine the extent to which an observed score deviates from a true score The standard error of measurement of a particular test of anxiety is 15. A student earns a score of 55. What is the confidence interval for this test score at the 95% level? (Z-score is 1.96) 84 to 26 Face validity Judgement by test-taker about how relevant the test items appear to be Concurrent validity An index of the degree to which a test score is related to a criterion measure obtained at the same time Predictive validity The degree to which a test score predicts scores on some future criterion Validity How well a test measures what it purports to measure Most test-takers score high on a particular test. What effect is most likely occurring? Ceiling effect Order the difficulty of the following indexes from most to least difficult: 0.57, 1.00, 0.35, 0.72, 0.18 0.18, 0.35, 0.57, 0.72, 1.00 Four scales of measurement Nominal, ordinal, interval, and ratio Measures of central tendency Mean, median, and mode Measures of variability Variance, range, deviation score, and standard deviation A student takes an IQ test and gets a 115. The standard deviation is 15 and the mean is 100. What is the student's t-score? 90 A test designed to yield information about whether or not a student has mastered the ability to multiply two-digit numbers would be referred to as what? Criterion-referenced norms What are two main characteristics of a test that makes it "good"? Reliability and validity What tells us how much variance in one variable is accounted for by another? Coefficient of determination When a sample is selected based on the arbitrary belief that it is representative of the population, it is called what? Purposive sampling Define the following equation, including what each variable is, as well as what it is used for: Y = a + b1x1 + b2x2 Y = the predictive variable, a = y-intercept, b1b2 and b2x2 = slopes related to the predictor variables, and this is the equation for a multiple regression used to predict y given values of x When Ryan took the S.M.R.T. IQ test today, his score was 130. Last week, his score on the same test was 70. The S.M.R.T. test seems to lack what? Reliability Your correlation for a test is 0.90 with a standard deviation of 15. What is the standard error of measurement for this measure, and what does this mean? SEM = 15 √(1-0.90) = 4.74, this means that the average distance this score is from the mean of all test scores if 4.74 points How could a Cronbach's alpha of 0.78 be interpreted? 78% of the variance in the scores is true variance, and this test is highly reliable What are some ways you can manipulate scores to change test bias? Addition of points, differential scoring of items, elimination of items based on differential item functioning, differential cutoffs, separate lists, within-group norming, banding, preference policies What are some pieces of evidence of construct validity? Homogenous, scores increase of decrease as a function of age, time, or experimental manipulation as predicted, post-test scores differ from pretest scores, scores obtained by people from distinct groups vary as predicted, test scores correlate with scores on other tests as precited In what commonly used self-report procedure do participants rate a series of statements, typically using a scale of 1 to 5? Likert scale A student is taking the 440 final and starts picking items at random. are they guessing or faking? What is the difference? Guessing, this occurs when there is a correct answer present d = -3.97, what is this measuring and what does it means? It is the discrimination index, the negative symbol indicates that the group expected to be "novices" actually performed better than the "expert" group What are five stages of test development? Test conceptualization, test construction, test tryout, item analysis, test revision What individual developed a diagnostic test to identify mental retardation in school aged children? Alfred Binet What intelligence structure does the Standard-Binet intelligence test operate under? Three-level hierarchical structure What is one example of support for the nature side of intelligence and one example of support for the nurture side? Nature: heritability index is approximately .50, nurture: perinatal factors resulting low birth weights tend to be associated with lower IQ What are points of agreement. Knowledge-based thinking, apprehension, adaptive purpose striving, fluid-analytic reasoning, mental playfulness, idiosyncratic learning A child is taking a test that measures the ability to follow rules and recognizing letters and numbers. Which test are they taking? Kaufman Assessment Battery for Children What are the reasons that people are leaning toward the ACT over the SAT? Gender gap in math, ESL students under-perform on the SAT, parental education and income effects, racial/ethnic minority group differences An individual is feeling a little down in the dumps. Is this a trait or a state? State What is a test that measures "normal" personality? NEO or MBTI What ways are personality assessments used? Employment matching, adjustment issues for decisions about military service, academic opportunities, employment mobility, diagnoses or degree of impact from some trauma, inform treatments, research and validation of theory What is an example of how to detect dishonesty in a standardized personality test? Validity scales, infrequent responses, lie scales, impression management What are the differences between clinical and counseling psychology? Clinical: focuses on prevention, diagnoses and treatment of abnormal behavior in hospitals, public and private mental health centers, independent practice, and academia, counseling: focuses on everyday problems in living in school/colleges, university counseling centers, and community mental health centers What are the five axes on the DSM-IV-TR? Age-related disorders, mental retardation and personality disorders, physical conditions that may affect mental functioning, stress, and global rating of overall functioning What are some indicators of child abuse? Fear of adults, reluctance to remove outer garments, unusual reactions to other children crying, low self-esteem, extreme or inappropriate moods, aggressiveness or social withdrawal, nail biting, and other habit disorders What aspects of a parent would you need to assess in a custody evaluation? Measures of child-rearing behaviors, desire to have custody, other marital adjustment phenomena Which degree makes the most money? PhD What identifies patterns of interest that are associated with people who work in particular occupations? Strong Interest Inventory What are the survey methods used in business? Opinion polls, consumer panels, diary panels, semantic differential technique, website surveys According to Holland's Model, what type is opposite of a person who values aesthetic qualities? Conventional As the degree of reliability increases, the proportion of Total variance attributed to true variance increases What is an example of a completion format on a test? Short-answer items What type of validity evidence best sheds light on whether college admissions test is valid for selecting students who will complete the program within four years? Predictive Which is a useful tool in evaluating convergent and discriminant validity evidence? A multitrait-multimethod matric Sixty-eight percent of the scores for a particular test fall between 58 and 61" is a statement regarding A confidence interval Coefficient alpha can be interpreted as The mean of all possible split-half correlations Which results in a negative item-discrimination index? More low scores get the item correct How well a test measures a single concept is known as Homogeneity "Bias" refers to Systematic variation that is unrelated to the construct being measured What is true of Thurstone's method of scaling? It uses judges' ratings to assign values to test items The higher the item-difficult index, the ____ the item. Easier Which source of error variance affects parallel-form reliability but does not affect test-retest reliability? Item sampling The Spearman-Brown formula is used for Correcting for one half of the test by estimating the reliability of the whole test, determining how many additional items are needed to increase reliability, determining how many items can be eliminated without reducing reliability Which type of reliability estimate is obtained by correlating pairs of scores from the same person on two different administrations of the same test? Test-retest Which of the following is NOT a part of the formula for the standard error of measurement for a particular test? The validity of the test If a test is valid, we would expect that Groups of people who differ on the measured construct will obtain different test scores Having a large item pool available during test revision is An advantage because poor items can be deleted in favor of the good items A source of error variance may take the form of Item sampling, test-takers' reactions to environment-related variables, or test-taker variables such as amount of sleep the night before a test A key feature of the Guttman scale is that When one item is endorsed, the less extreme positions are also endorsed Item analysis may include evaluation of Item reliability, item validity, and item difficulty What is an example of false positive? A test identifies a client as schizophrenic when the client is not Typically the primary objective of psychological testing and assessment is to predict future behavior A test designed to yield information about whether or not a student has mastered the ability to multiply two-digit numbers would be referred to as criterion-referenced test If the correlation coefficient is equal to .30, the coefficient of determination is equal to What makes a norm group appropriate? Depending on the test, they have to pass certain criterion, be representative. What makes a norm invalid? If it is normed by people who don't represent the people taking the test (eg. grad students taking a 101 exam) These are four scales of measurement Nominal, ordinal, interval, and ratio These measure central tendency. The mean, the median, and the mode These measure variability. Variance, range, deviation score, and standard deviation A student takes an IQ test and gets a 115. The standard deviation is 15 and the mean is 100. This is the student's t-score. Z-score= raw score-mean/standard deviation T-score =(Zx10)+50 The student's T-score is 60 bell curves are divided by standard deviations. What’s the combination for percentages beginning from the median? 34-13. A test designed to yield information about whether or not a student has mastered the ability to multiply two-digit numbers would be referred to as this. Criterion-referenced norms These are the two main characteristics of a test that makes it "good." Reliability and validity This tells us how much variance in one variable is accounted for by another. Coefficient of determination When a sample is selected based on the arbitrary belief that it is representative of the population, it is called this. Purposive sampling Define the following equation. Include what each variable is, as well as what it is used for: Y = a + b1X1 + b2X2 This is the equation for a multiple regression It is used to predict Y given values of X. Y is the predicted variable, a is the Y-intercept, b1 and b2 are slopes related to the predictor variables (X1 and X2). When Ryan took the S.M.R.T. IQ test today, his score was 130. Last week, his score on the same test was 70. The S.M.R.T. Test seems to lack this. test retest Reliability What are three of the reliability estimates? Test-retest, parallel-forms, alternative-forms, internal consistency, inter-rater Your correlation for a test is 0.90 with a standard deviation of 15. What is the standard error of measurement for this measure, and what does that mean? SEM = 15√(1-0.90) = 4.74 This means that the average distance this score is from the mean of all test scores is 4.74 points. How would a Cronbach's α of 0.78 be interpreted? 78% of the variance in the scores is true variance. This test is highly reliable. How are validity and reliability related? Can you have one without the other? A test can be reliable without being valid, but a test cannot be valid without being reliable. An individual gets a score that signifies they would do well at a particular job. It ends up that they are terrible at it. What term is exemplified by this? False positive Give two ways you can manipulate scores to change test bias. Addition of points, differential scoring of items, elimination of items based on differential item functioning, differential cutoffs, separate lists, within-group norming, banding, preference policies. What types of validity are under the heading of "criterion-related validity?" Define them. (Hint, there are two) Concurrent validity - an index of the degree to which a test score is related to some criterion measure obtained at the same time Predictive validity - an index of the degree to which a test score predicts some criterion measure Name two pieces of evidence of construct validity. Homogenous (measuring a single construct), scores increase or decrease as a function of age, time, or experimental manipulation as predicted, posttest scores differ from pretest scores, scores obtained by people from distinct groups vary as predicted, test scores correlate with scores on other tests as predicted. In this commonly used self-report procedure, participants rate a series of statements, typically using a scale of 1 to 5. Likert scale A student is taking the 440 final and starts picking items at random. Are they guessing or faking? What is the difference? Guessing; this occurs when there is a correct answer present. An example of faking would be during personality tests. An individual is taking a test that requires them to come up with the correct answer. What are two types of item formats that the test could be employing? Constructed-response format, completion item, short answer, or essay item d=-3.97 Describe what this is measuring and what it means. It is the discrimination index; the negative symbol indicates that the group expected to be "novices" actually performed better than the "expert" group List the five stages of test development Test conceptualization Test construction Test tryout Item Analysis Test revision This individual developed a diagnostic test to identify mental retardation in school aged children. Alfred Binet Which intelligence test would you use if you wanted the best psychometric qualities? WAIS What intelligence structure does the Stanford-Binet intelligence test operate under? Three-level hierarchical structure G= crystallized, fluid, shortterm memory. verbal reasoning crystallized abstract/visual reasoning, quantitative reasoning, fluid short-term memory short term memory Give one example of support for the nature side of intelligence and one example of support for the nurture side. Nature: Heritability Index is approximately .50 (e.g., Plomin & Defries, 1980) Twins studies support genetic component in intelligence based on degree of similarity Nurture:Perinatal factors resulting low birth weights tend to be associated with lower IQ Malnutrition during first 40 weeks associated with lower intellectual functioning SES correlates about r = .33, strongest effects seen with persistent poverty Significant correlations between IQ and years of school completed, truancy. Flynn Effect - increase of about 3 IQ points per decade from 1940 to 1990 Compare intelligence theories by naming three points of agreement. Knowledge-based thinking, Apprehension, Adaptive Purposeful Striving, Fluid-Analytic Reasoning, Mental Playfulness, Idiosyncratic Learning Idiosyncratic learning = Peculiar learning, it's messy, it doesn't flow as easily as we think it should Knowledge-based thinking, Apprehension, Adaptive Purposeful Striving, Fluid-Analytic Reasoning, Mental Playfulness, Idiosyncratic Learning What kind of testing is meant when a test affects a massive decision? high stakes One student is showing their knowledge of physics by solving complex physic problems, while another is using figures to showcase their knowledge. What type of assessment is this? Portfolio assessment A child is taking a test that measures the ability to follow rules and recognizing letters and numbers. Which test are they taking? (Hint, it could be k-abc, das, wj-iii, or mrt) Kaufman Assessment Battery for Children Name two reasons why people are leaning toward the ACT over the SAT. Gender Gap in math Female students earn higher grades in high school but score lower on the SAT ESL students under-perform on the SAT Effect also seen for bilingual students who have English as their first language Parental Education and Income effects Racial/Ethnic Minority Group Differences An individual is feeling a little down in the dumps. Is this a trait or a state State This is a test that measures "normal" personality. NEO or MBTI An individual is telling a story based on what they are looking at. What kind of test is this? Thematic apperception test Give two ways personality assessments are used. Employment Matching Adjustment issues for decisions about military service Academic opportunities Employment mobility Diagnoses, or degree of impact from some trauma Inform treatments Research and Validation of theory Give an example of how to detect dishonesty in a standardized personality test. Validity scales, infrequent responses, lie scales, impression management (social desirability) Name one difference between clinical and counseling psychology. Clinical Focus: the prevention, diagnosis and treatment of abnormal behavior. Clinical Settings: Hospitals, Public and Private Mental Health Centers, Independent Practice Academia Counseling Focus: everyday problems in living (ex. relationship problems, career decisions) Counseling Settings: School/Colleges University Counseling Centers, Community Mental Health Centers A psychologist is using a pre-determined structure to gain information about a client. What type of assessment is this? Structured interview Name the five axes on the DSM-IV-TR. Axis I - Age-related disorders Axis II - Mental retardation and personality disorders Axis III - Physical conditions that may affect mental functioning Axis IV - Stress Axis V - Global rating of overall functioning List three indicators of child abuse. Fear of adults Reluctance to remove outer garments Unusual reactions to other children crying Low self-esteem Extreme or inappropriate moods Aggressiveness or social withdrawal Nail biting, and other habit disorders. What aspects of a parent would you need to assess in a custody evaluation Measures of child-rearing behaviors Desire to have custody Other marital adjustment phenomena - life satisfaction, jealousy, communication skills. Which degree makes the most money (on average)? PhD Which drug test would you use if you were testing 60 days after an individual had used cocaine? Hair test (lasts up to 90 days in the hair follicles) This identifies patterns of interest that are associated with people who work in particular occupations. Strong Interest Inventory Name two of the survey methods used in business. Opinion polls, consumer panels, diary panels, semantic differential technique, website surveys According to Holland's Model, this type is opposite of a person who values aesthetic qualities. Conventional What are the three reasons why Dr. Armstrong wears black? It's slimming, he likes to rock out, black is his favorite color, he went to art school, it covers up food spills. What are the advantages and disadvantages of using multiple choice questions to measure understanding of the course materials? Page 256, table 8-1 Advantages: assess breadth of knowledge, can cover a great deal of knowledge in brief time, easy to grade (computerized grading), objective and precise interpretation Disadvantages: not as deep, inhibits originality and creativity,, Advantages are nullified if questions are poorly constructed Multiple-choice items tap primarily recognition. The higher the item-difficulty index, the ________ the item. Easier Which best describes a "good" test item? It distinguishes high scorers from low scorers. Give an example of an error in test administration Test environment (noise, room temp, lighting) Testtaker variables (emotional problems, physical discomfort, misread test answers) Examiner-related variables (experimenter expectancies) Explain what is meant by the following equation: X = T + E X = Observed score on some test T = True score on some construct E = Error effecting the observed score How is Cronbach's Alpha calculated? Take the average of all the split-half reliabilities If you have a Cronbach's alpha of .75 and a standard deviation of 5.50, what is the SEM? σmeas = σ √(1 - rxx)