Area of Responsibility IV - ANSWEREvaluation and Research
Components of Area IV - ANSWER4.1 Design process, impact, and outcome
evaluation of the intervention
4.2 Design research studies.
4.3 Manage the collection and analysis of evaluation and/or research data
using appropriate technology.
4.4. Interpret data.
4.5. Use findings.
Delimitations - ANSWERare decisions made by an evaluator or researcher
that ought to be mentioned because they are used to help the evaluator
identify the parameters and boundaries set for a study.
Examples of delimitations include - ANSWERwhy some literature is not
reviewed, populations are not studied, and certain methods are not used
Evaluation - ANSWERis a series of steps that evaluators use to assess a
process or program to provide evidence and feedback about the program
Limitations - ANSWERare phenomena the evaluator or researcher cannot
control that place restrictions on methods and, ultimately, conclusions.
,Examples of possible limitations - ANSWERtime, nature of data collection,
instruments, sample, and analysis
Logic models - ANSWERtake a variety of forms but generally depict aspects of
a program such as inputs, outputs, and outcomes
offer a scaled down, somewhat linear, visual depiction of programs. -
ANSWERlogic models
research - ANSWERan organized process in which a researcher uses the
scientific method to generate new knowledge
Reliability - ANSWERrefers to the consistency, dependability, and stability of
the measurement process
validity - ANSWERdegree to which a test or assessment measures what it is
intended to measure
increases the chance of measuring what was intended - ANSWERUsing a valid
instrument
variables - ANSWERoperational forms of a construct.
Researchers use thes to - ANSWERdesignate how the construct will be
measured in designated scenarios
,Unit of Analysis - ANSWERwhat or who is being studied or evaluated (the
individual, group, organization, or program, etc.)
used by health education specialists to determine the value or worth of the
programs - ANSWERevaluation of programs
Formative evaluation - ANSWERa process that evaluators or researchers use
to check an ongoing process of the evaluation from planning through
implementation phases.
Process evaluation - ANSWERis any combination of measures that occurs as a
program is implemented to assure or improve the quality of performance or
delivery
Summative evaluation - ANSWERis often associated with measures or
judgments that enable the investigator to conclude impact and outcome
evaluations.
Impact evaluation - ANSWERis the immediate and observable effects of a
program leading to the desired outcomes.
(think IMpact = IMmediate)
Outcome evaluation - ANSWERis focused on the ultimate goal, product, or
policy
(think Outcome = Overall)
, often measured in terms of health status, morbidity, and mortality. -
ANSWERoutcome evaluation
true or false
Prior to developing data gathering instruments, researchers consider the type
of data collection that is going to occur - ANSWERtrue
Common data collection strategies include - ANSWERface-to-face surveys
telephone surveys
self-administered surveys
traditional mail-in surveys
electronic platforms (e.g., SurveyMonkey)
designed to ANSWER questions that are being asked by the evaluator or
researcher - ANSWERData collection instruments
what is the goal of program evaluation - ANSWERto determine ways that
policies or programs can be improved
a process that health education specialists use to check to ensure they are
reaching the desired outcomes. - ANSWERevaluation
level of review can be dependent on - ANSWERintent of the evaluation
if results remain internal and intent is for quality control, - ANSWERsome
agencies might require fewer levels of review and approval.