Introduction
The ultimate goal of program evaluation is to provide the basis for making decisions within a system analysis of planned change. Data must be aggregated into a meaningful whole, the data must be interpreted, and the data must be presented in some meaningful fashion.
This week covers the final steps associated with presenting the results of a program evaluation.
Evaluation reports can take many forms and be distributed to a wide array of audiences. When preparing the written report of an evaluation, the evaluation must consider both the format of the report and the intended audience of the report. When possible, the evaluator should involve audiences in determining the type of information to include in the report and the mode of delivery (Fitzpatrick et al., 2011).
A communication plan can be a valuable tool for communicating the results of a program evaluation. Such a plan should consider factors such as stakeholder information needs, planning report meetings, and setting a communication schedule. In addition, evaluators must understand the importance of and need for personal presentations. The personal presentation should consist of a summary of the major findings of the written evaluation report and must be tailored to the audience (Posavac, 2011).
References
Fitzpatrick, J. L., Sanders, J. R., & Worthen, B. R. (2011). Program evaluation: Alternative approaches and practical guidelines (4th ed.). Pearson.
Posavac, E. J. (2011). Program evaluation: Methods and case studies (8th ed.). Pearson, Prentice Hall.
Week 10 Prepare: Discussion Preparation
In the first discussion in this week, you will critique an example of a program evaluation report. Note: You cannot use a report from the same organization as any of your peers. Therefore, it will be advantageous for you to find a suitable report and post it to the discussion as soon as possible.
Search the Internet to find a good example of a program evaluation report. Make sure that it does a good job in covering all the elements that should be presented. Once you have downloaded the report, complete the preparation instructions in the first discussion for this week.
Note: If you cannot quickly identify an acceptable program evaluation, use the library’s Summons to locate a program evaluation or a research study of a program implementation on a topic similar to the one you are investigating for your course project.
Week 10 Study
Readings
Use your textbook, Royse, D., Thyer, B. A., & Padgett, D. K. (2016). Program evaluation: An introduction to an evidence-based approach (6th ed.). Cengage, to read:
- Chapter 14, “Writing evaluation proposals, reports, and journal articles,” pages 379–400.
Use the Internet to complete the following:
Recommended
In preparation for this unit’s assignment, refer to the following for tips on preparing PowerPoint presentations.
PowerPoint Presentation Design Suggestions
A PowerPoint presentation should communicate the lesson information as effectively as possible in visual as well as verbal terms:
- The number of words on each slide should be cut to the bare minimum without losing the meaning.
- Typically, a heading at top of each slide, about 36-42 pts. in size, tells what the subject of the slide.
- Use bullet entries instead of continuous text. It would be ideal to have no more than 6 bullet entries on a slide and no more than 10 words per entry. Instead of crowding slides with text, it is better to add more slides.
- Only use typefaces that are easy to read. Do not use more than two typefaces of different names (such as Helvetica or Times). Do not use different typefaces that are similar in style.
- However, it is very helpful to use some appropriate contrasts of sizes and weights of type to focus the viewer’s attention on the most important content within each slide.
- As much as possible, it is best to convey relevant information visually through use of pictures and diagrams. However, minimize the use of decorative elements or effects that distract from meaning.
- If you use pictures or diagrams that you did not create yourself, you must find out and abide by applicable copyright restrictions. You must cite the source of any visual material that you did not create yourself within your presentation and in the References list at the end of the presentation.
- Write concise notes in the area beneath each slide provide supporting information for the points presented on the slide.
For the final component of the course project, you will imagine that you have successfully implemented the program evaluation you designed. Create a PowerPoint presentation to communicate the results of your evaluation to stakeholders.
Since you have not actually implemented your program evaluation design, you will need to simulate results that are fictional, but they must be plausible.
Note: It must be understood that in an actual program evaluation it would be highly unethical to represent “made up” results as actual data. However, it is ethical to simulate results in this way for this learning exercise.
Assignment Instructions
Refer to the two sample PowerPoint presentations linked in Resources for guidance as you create a PowerPoint deck for this assignment. Do not submit a paper for this assignment. Papers will not be graded.
- The number of words on each slide should be cut to the bare minimum without losing the meaning. It would be ideal to have no more than six bullet points on a slide and no more than six words per bullet. You can always add more slides to cover any given topic. Note: do not use complete sentences.
- Place supporting details and references to evidence that you will use when making your presentation in the Notes section below the slide. Provide enough detail so that a colleague could make the presentation in your absence.
- Include copyright-free graphics or your own images to accompany text where appropriate. For instance, search Google Images (linked in Resources) for royalty-free stock photos and other graphics; be sure to attribute image sources as you would cite any other source and comply with any terms of use.
- In-text citations in current APA format must be included and references listed at the end of the presentation. Refer to the APA links in Resources as needed.
For guidance in the basics of using PowerPoint and effective PowerPoint design, refer to the helpful links in Resources. If, after reviewing this material, you need more help using PowerPoint, contact your instructor—seek help early!
Title: On the first slide of the PowerPoint presentation, enter:
- The presentation title: Results of Evaluation of [Project].
- Your name.
- Course number and title.
- University.
- Instructor’s name.
If this presentation was made in an actual professional context, the entries under your name would be replaced by your job title, the name of your organization, and perhaps your contact information.
Introduction: In this series of slides, generally summarize:
- History of the program and the need it was created to meet.
- Program goals and objectives.
- Program methods and major strategies.
- Significant evaluation findings.
- High-level overview of evaluation methods.
- High-level synopsis of recommendations based on findings.
Evaluation Methods: Describe the methods in enough detail that other evaluators would be able to replicate them. Include:
- Data and Collection
- What types of data was collected? Why did you consider it to be significant?
- Who was responsible for data collection?
- What were the sources of the data?
- How, when and from whom was the data collected?
- Methodological Challenges:
- Describe difficulties you encountered and how you resolved them.
- Describe limitations of your evaluation methods and strategies you used to mitigate them.
Evaluation Findings:
- Present the key findings of your evaluation. (Remember, you will invent plausible findings for this assignment, but never do this for professional work or assignments that are supposed to involve actual research.)
- Stick to “facts” here, do not add interpretation in this section.
- To make the findings clear and impactful:
- Consider using graphics (diagrams, tables, or cross-tabulations).
- Include brief quotes, brief examples, photos, or illustrations.
Interpretation of Results:
- Interpret the data, providing your opinions explaining what conclusions can be drawn from the data concerning the program and its effectiveness in meeting its goals and objectives.
Recommendations:
- Make specific recommendations based on your findings about ways to sustain or improve program effectiveness. These may include changes in:
- Financial support.
- Policy.
- Procedures.
- Staffing.
- Other recommendations.
Conclusion slide: Summarize the main findings, emphasizing why your recommendations should be followed.
References: Use current APA style and formatting guidelines.
Assignment Requirements
- Written communication: Free of errors that detract from the overall message.
- Format: Follow design suggestions in the weekly study. Follow current APA style and formatting guidelines as they apply to this assignment.
- Font: The font, font size, and color should be selected for ease of viewing. Most often that means at least 36-point type for titles, 28–32 points for headings, and 24–28 point for subheadings. The text color should provide high contrast with background.
- Citation requirements: Cite best practices from at least three scholarly/research articles in this assignment. You may cite reputable sources from websites, books, textbooks, and assigned resources as well, but these will not count toward the three required scholarly/research references.
Throughout this assignment, make use of specific concepts, ideas, and program evaluation terminology presented in the course. Support your ideas with relevant references, citations, and empirical research. Be sure to conform to APA style and formatting guidelines and include a reference slide at the end of your presentation.
Read the rubric for this assignment to understand how your work will be assessed.
Resources
- Sample Presentation 1 [PPTX] Download Sample Presentation 1 [PPTX]
. - Sample Presentation 2 [PPTX] Download Sample Presentation 2 [PPTX]
. - Evidence and APALinks to an external site.
. - PowerPoint Design Suggestions.
- Guidelines for Effective PowerPoint Presentations [PPTX] Download Guidelines for Effective PowerPoint Presentations [PPTX]
.
View Rubric
Week 10 Assignment – Communicating Results
| Week 10 Assignment – Communicating Results | ||
| Criteria | Ratings | Pts |
| Describe methods in enough detail that other evaluators would be able to replicate them. | 47.5 to >40.38 pts DISTINGUISHED Describes comprehensive methods concisely, but in enough detail that other evaluators would be able to replicate them. 40.38 to >33.25 pts PROFICIENT Describes methods in enough detail that other evaluators would be able to replicate them. 33.25 to >0 pts BASIC Describes methods, but they are incomplete, or there is not enough detail that other evaluators would be able to replicate them. 0 pts NON_PERFORMANCE Does not describe methods. | / 47.5 pts |
| Describe strategies to mitigate difficulties and limitations of evaluation methods. | 47.5 to >40.38 pts DISTINGUISHED Comprehensively analyzes difficulties and limitations of evaluation methods and concisely evaluates best strategies to mitigate them. 40.38 to >33.25 pts PROFICIENT Describes strategies to mitigate difficulties and limitations of evaluation methods. 33.25 to >0 pts BASIC Describes difficulties and limitations of an evaluation approach, but does not describe feasible strategies to mitigate all of them. 0 pts NON_PERFORMANCE Does not describe difficulties and limitations of an evaluation approach. | / 47.5 pts |
| Present the key findings of an evaluation in a clear and impactful manner. | 47.5 to >40.38 pts DISTINGUISHED Employs enhanced written and/or visual communication to present key findings of an evaluation in a clear and impactful manner. 40.38 to >33.25 pts PROFICIENT Presents the key findings of an evaluation in a clear and impactful manner. 33.25 to >0 pts BASIC Presents findings of an evaluation, but not all are clear or presented in an impactful manner. 0 pts NON_PERFORMANCE Does not present findings of an evaluation. | / 47.5 pts |
| Make specific recommendations supported by interpretation of findings. | 47.5 to >40.38 pts DISTINGUISHED Draws a clear line of sight from sound methods that produce accurate findings, through cogent interpretation, leading to actionable, well-considered recommendations to sustain or improve program effectiveness. 40.38 to >33.25 pts PROFICIENT Makes specific recommendations supported by interpretation of findings. 33.25 to >0 pts BASIC Makes recommendations that are too general or not well supported by interpretation of findings. 0 pts NON_PERFORMANCE Does not make relevant recommendations. | / 47.5 pts |
| Employ appropriate written and visual communication to convey content to an intended audience. | 47.5 to >40.38 pts DISTINGUISHED Employs enhanced written and/or visual communication throughout presentation to aid reception of content by intended audience. 40.38 to >33.25 pts PROFICIENT Employs appropriate written and visual communication to convey content to an intended audience. 33.25 to >0 pts BASIC Employs appropriate written and visual communication overall, but some elements would impede reception of content by intended audience. 0 pts NON_PERFORMANCE Includes many elements of written and visual communication that would impede reception of content by intended audience. | / 47.5 pts |
| Comply with APA guidelines. | 12.5 to >10.63 pts DISTINGUISHED Complies with APA guidelines consistently with no errors. 10.63 to >8.75 pts PROFICIENT Complies with APA guidelines with few minor errors. 8.75 to >0 pts BASIC Uses APA format and style, but inconsistently and with errors. 0 pts NON_PERFORMANCE Does not use APA format and style. | / 12.5 pts |
| Total Points: 0 | ||
