Comprehensive Exam
1. quasi-experimental design Ans: An experiment that does not require random as-
signment.
2. experimental research design Ans: Random assignment of participants to condi-
tions, conducted in a laboratory or the workplace.
3. An organized collection of activities designed to reach certain objectives is referred
to a ? Ans: program
4. identify the dependent variable in the follow hypothesis Ans: At risk students
who participate in the Communities and Schools program will have a lower drop-
out rate than students who do not participate in the program Ans: drop out rate
5. Dependent Variable Ans: The measurable effect, outcome, or response in which the
research is interested. the variable that the researcher wants to explain!
6. independent variable Ans: The experimental factor that is manipulated; the variable
whose effect is being studied. Should explain the change
7. Logic Model Ans: Visual representation of how a program is organized, including
activities, resources, short-term and intermediate outcomes, and program goals.
8. Inputs Ans: the resources needed to run the program (money, facilities, program staff)
9. Outputs Ans: The units of service (number of clients counseled or children cared for)
10. formative evaluation Ans: not for funding but to guide and direct new programs
(note the root word, "form") (125); assists with program improvement (126)
examine the process of delivering services
11. summarative evaluation Ans: - involves gathering information once programs have
been fully implemented (usually at the end of an operating cycle),
12. outcome evaluation Ans: assesses the effectiveness of a program in producing
1/
17
,change. are summarative in nature
13. Qualitative methods are most often used with which type of program
assessment? Ans: formative
14. Program evaluation and basic research have some similarities. Which of the
following is a difference between the two approaches? Ans: how the data is used
15. Treatment fidelity is important to maintain so that program evaluation results
can confidently be attributed to , and not to other factors or
activities. Ans: the interventions used in the program itself
16. treatment fidelity Ans: implementing a procedure exactly as planned
17. One of the requirements of single system research design is that the results
are Ans: Ans: displayed in a graph to see measurable results over time
18. Aaron wishes to collect data to understand better if his program is being
implemented the way it was planned. What kind of evaluation is Aaron likely going
to complete? Ans: process evaluation
2/
17
, 19. process evaluation Ans: determines whether a program is being implemented as
intended
20. internal validity Ans: addresses the extent to which casual inferences can be made
about the intervention and the targeted behavior
21. What are the three primary purposes of process or formative evaluation?-
Ans: Program description, Program monitoring, Quality assurance
22. When completing a logic model for a family counseling program, Samira counts
the numbers of therapy sessions that were conducted during a 30 day period. This is
an example of which of the following? Ans: outputs
23. When treatment fidelity is not maintained, what is/are the risk(s) for the
evaluator? Ans: data can and will contain errors
treatment likely can not be recreated in other settings concluding
that a program was not effective when it really was
24. Which one of the following is carried out at the conceptualization stage of
programs or before programs are implemented? Ans: needs assessments
25. needs assessment Ans: •First step in responding to perceived needs within a
community or client group.
• Can arise due to a desire to improve programs or from new attention to unrecog- nized
problems.
• Used to prioritize spending, allocate resources and aid planning and development.
26. You are designing an evaluation for a county foster care youth program. You
sample youth at three county foster youth facilities within your county. What kind
of evaluation is this? Ans: purposeful sample
27. You are using a single subject research design to test a new behavioral technique
with your 8 year-old client.You give the parents a behavioral check- list to complete
3/
17
1. quasi-experimental design Ans: An experiment that does not require random as-
signment.
2. experimental research design Ans: Random assignment of participants to condi-
tions, conducted in a laboratory or the workplace.
3. An organized collection of activities designed to reach certain objectives is referred
to a ? Ans: program
4. identify the dependent variable in the follow hypothesis Ans: At risk students
who participate in the Communities and Schools program will have a lower drop-
out rate than students who do not participate in the program Ans: drop out rate
5. Dependent Variable Ans: The measurable effect, outcome, or response in which the
research is interested. the variable that the researcher wants to explain!
6. independent variable Ans: The experimental factor that is manipulated; the variable
whose effect is being studied. Should explain the change
7. Logic Model Ans: Visual representation of how a program is organized, including
activities, resources, short-term and intermediate outcomes, and program goals.
8. Inputs Ans: the resources needed to run the program (money, facilities, program staff)
9. Outputs Ans: The units of service (number of clients counseled or children cared for)
10. formative evaluation Ans: not for funding but to guide and direct new programs
(note the root word, "form") (125); assists with program improvement (126)
examine the process of delivering services
11. summarative evaluation Ans: - involves gathering information once programs have
been fully implemented (usually at the end of an operating cycle),
12. outcome evaluation Ans: assesses the effectiveness of a program in producing
1/
17
,change. are summarative in nature
13. Qualitative methods are most often used with which type of program
assessment? Ans: formative
14. Program evaluation and basic research have some similarities. Which of the
following is a difference between the two approaches? Ans: how the data is used
15. Treatment fidelity is important to maintain so that program evaluation results
can confidently be attributed to , and not to other factors or
activities. Ans: the interventions used in the program itself
16. treatment fidelity Ans: implementing a procedure exactly as planned
17. One of the requirements of single system research design is that the results
are Ans: Ans: displayed in a graph to see measurable results over time
18. Aaron wishes to collect data to understand better if his program is being
implemented the way it was planned. What kind of evaluation is Aaron likely going
to complete? Ans: process evaluation
2/
17
, 19. process evaluation Ans: determines whether a program is being implemented as
intended
20. internal validity Ans: addresses the extent to which casual inferences can be made
about the intervention and the targeted behavior
21. What are the three primary purposes of process or formative evaluation?-
Ans: Program description, Program monitoring, Quality assurance
22. When completing a logic model for a family counseling program, Samira counts
the numbers of therapy sessions that were conducted during a 30 day period. This is
an example of which of the following? Ans: outputs
23. When treatment fidelity is not maintained, what is/are the risk(s) for the
evaluator? Ans: data can and will contain errors
treatment likely can not be recreated in other settings concluding
that a program was not effective when it really was
24. Which one of the following is carried out at the conceptualization stage of
programs or before programs are implemented? Ans: needs assessments
25. needs assessment Ans: •First step in responding to perceived needs within a
community or client group.
• Can arise due to a desire to improve programs or from new attention to unrecog- nized
problems.
• Used to prioritize spending, allocate resources and aid planning and development.
26. You are designing an evaluation for a county foster care youth program. You
sample youth at three county foster youth facilities within your county. What kind
of evaluation is this? Ans: purposeful sample
27. You are using a single subject research design to test a new behavioral technique
with your 8 year-old client.You give the parents a behavioral check- list to complete
3/
17
