Is Learning Actually Impacting the Library? Investigating Class Outcomes After the Traditional Evaluation ▪ Was learning shared with colleagues and patrons? ▪ Are participants following through on their good intentions?

Background: A consumer health continuing education course for public librarians included an evaluation but there were no additional opportunities for follow-up to explore actual impact. To address this, a three-month post-course follow-up was designed to explore the following; was the learning shared with colleagues and or patrons, what new actions had been taken in the library because of the course, and why did some not complete the course? This follow-up questionnaire generated data about practical course value, led to a better understanding of course completion influences, and provided a model for other course developers and continuing education granting organizations.

Description: The questionnaire was developed by collaboratively identifying what information was desired and what was missing in the current course evaluation and building a process for implementation and review. Through brainstorming, reviewing the current evaluation data, and processing what could realistically be explored, a draft version of a follow-up questionnaire was created. The draft was shared with the organization’s evaluation team for feedback. A final version was created and emailed to the most recent cohort of course registrants. With no issues detected and responses that proved valuable, the questionnaire was sent to two previous cohorts as well. It continues to be sent to all course registrants, for both online and in-person versions of the course, three months after completion. Responses are regularly explored and analyzed for information that supports course development, delivery, and public librarian health information knowledge.

Conclusion: Currently, the questionnaire has been delivered to 402 individuals with 209 responses (52%). Key findings include: 80% shared a resource with a fellow staff member, almost 14% plan to; 51% developed new programming/outreach; and 100% of respondents who completed at least one week indicated learning about a new resource. By implementing a delayed follow-up questionnaire, it is possible to explore learners perceptions of the value of a course, the scope of activities attributed to the learning and discover how to better support learners to meet their needs and support course completion.