HEP 456 Module 5 Section 10 Data Collection Methods for Process and Impact Evaluation

HEP 456: Health Promotion Program Eval

Arizona State University

Dean Helitzer

18th November 2022

Data Collection Methods for Intervention Program ‘Living Well With Dialysis’

Data Collection Methods for Process and Impact Evaluation.

These data collection methods will be designed to answer the process and impact evaluation questions.

Some of the process evaluation questions include:

a) Was the plan executed as expected? Why or Why Not?

b) What are the specific kind of interventions that were put into place? Have the interventions worked or not? If not, why have they not worked?

c) Did all the planned activities go as planned? If not, why did some activities not go as planned?

d) Was the target population reached as earlier planned?

e) Was the program able to maintain an active and diverse stakeholder community? If not, why did some stakeholders pull out of the plan before termination?

f) What types of issues did you experience when delivering the program – did you have adequate resources from the start to perform it well?

g) Was the program well-managed?

h) Were employees taught or educated to the appropriate degree of program design? Is there skill in enabling the program procedures from start to finish?

i) Was the program well-supported?

Some of the impact evaluation questions include:

a) Is the community around Gulfport Memorial Hospital happy regarding the project?

b) Has the project been able to meet the community’s needs?

c) What were the completion rates of the enrolled individuals? If not 100%, why were some individuals unable to complete the program?

d) Is there evidence that the well-being of dialysis patients involved in the program is improving?

e) Has the’ Living Well in Dialysis’ plan met its objectives? These objectives are stated below.

During the process assessment, both quantitative and qualitative data will be employed. Here are a few data collection strategies that will be used:

• Questionnaires and Surveys.

Questionnaires and surveys will collect data from participants by asking them both open-ended and closed-ended questions. Some of the questions that will be directed to the program evaluators will be regarding the execution of the program. Was it executed as expected? Was it well managed? The type of issues that were experienced during delivery of the program? Participants in surveys of the program will include patients, care providers, or other entities. Staff and volunteer training effectiveness will be assessed by in-person surveys. The vast majority of the questions on these questionnaires will be at the nominal or ordinal level, allowing for quick and easy classification of respondents into three categories: well-trained, somewhat well-trained, and not well-trained. Clear written and verbal guidelines on how to fill out the questionnaire will be provided to all program employees and volunteers.

• Post and Pre Program Knowledge and Attitude test.

These will help keep track of any new knowledge gained or perspective altered as a consequence of program participation. The attitude tests will be used to assess whether the community around Gulf Memorial Hospital is happy about the project and

• Interviews and Focus Groups.

In order to conduct an effective assessment, focus groups will be comprised of a representative sample of the target audience. Interviews related to certain questions or concerns will also be used. Both approaches include talking to grantees or other stakeholder groups to glean information about their experiences with program implementation and evaluating both intended and unanticipated policy effects.

• Expert panels.

Professionals will evaluate policies, provide suggestions, weigh the benefits and drawbacks, and think about both the program’s intended and unforeseen impacts. Expert panels will be used to assess whether the program has met it objectives and whether the interventions that were put into place worked.

• Direct Observations.

In order to maintain tabs on the progress of the training of both staff and volunteers, program administrators will use direct observation. This will be done prior to implementation on January 2023. Direct observations will be used in assessing questions like has the well-being of the participants improved, whether all participants completed the program, whether all shareholders reached the final stages of the program or some pulled out along the way and whether all the planned activities went as planned.

Measurement Approaches

The ‘Living Well On Dialysis’ program will be evaluated using a variety of measures. The measures include how many participants were present as well as whether or not the project was presented to them. These measures will be assessed via program records, structured interviews with staff, and observations.

1. Direct Observation

Direct observation will be utilized to evaluate if the program was applied and offer descriptive details of the study and the participant’s behavior.

2. Structures Interviews With The Program Staff

Staff members' impressions of how well the program was adhered to in practice will be recorded via these interviews. Any problems that arise during program implementation may be discovered via the use of structured interviews with program employees.

3. Program Records

They’ll be put to use explaining the results of program. Information such as participant numbers, demographics, services provided, and programm implementation can be gleaned from program records. The results will help establish whether or not the program’s content was effectively delivered to the targeted audience.

Data Collection Procedures

Participants in the “Living Well On Dialysis” program will be provided with a consent form that details the goals of the program, any potential hazards, and the participant’s involvement in making decisions about the program throughout enrolment. Participants will be able to understand the evaluation procedure and provide their informed permission for evaluators to access their personal information via this agreement, including results from age and prior knowledge surveys. The evaluator will begin by collecting program records.

It will likely take two or three days to finish reviewing all of the program’s records. The program implementation process will be observed. The evaluator will be the only one involved and will have received training in indirect observation. There will be a one-hour observation session. The evaluator will conduct formal interviews with program employees to gather data. Depending on the complexity of the questions and the answers given, an interview might span anywhere from thirty to sixty minutes.