A cross-sectional assessment of extension specialists’ evaluation training needs

Odunayo Omotilewa; Omolola A. Adedokun; Jacqueline Corum

doi:10.37433/aad.v7i3.731

Authors

Odunayo Omotilewa University of Kentucky, USA https://orcid.org/0009-0008-4516-7804
Omolola A. Adedokun University of Kentucky, USA https://orcid.org/0000-0002-0705-2976
Jacqueline Corum University of Kentucky, USA

DOI:

https://doi.org/10.37433/aad.v7i3.731

Keywords:

cooperative extension, evaluation capacity building effort, SDG 4: Quality Education, well-being, needs assessment

Abstract

Extension specialists play a crucial role in designing, implementing, and assessing evidence-based Extension programs and outreach to address community needs, yet their evaluation training needs remain underexamined. This study reports the findings of a needs assessment conducted to identify priority evaluation training needs of Extension specialists at the University of Kentucky (UK) to inform targeted capacity-building efforts. Using a cross-sectional survey, UK Extension specialists rated their training needs across 25 evaluation topics. Findings revealed seven priority training needs including determining the economic value of programs using return-on-investment or cost-benefit analyses; developing measurable long-term outcomes to assess program impact; conducting follow-up surveys; developing evaluation plans to address what, why, when, and how to evaluate program outcomes/impact; developing effective quantitative tools; analyzing quantitative program evaluation data; and using data visualization to communicate evaluation findings. Further analysis showed that 21 of the 25 evaluation topics clustered into four core areas: quantitative evaluation methods, evaluation outcomes, program planning and reporting, and qualitative evaluation methods. In addition, the results indicated that training needs varied by program area and years of employment. These findings highlight the importance of using data-driven approaches to identify Extension specialists’ priority evaluation training needs and to inform tailored capacity-building efforts.

Downloads

Download data is not yet available.

References

Altschuld, J. W., & Watkins, R. (2014). A primer on needs assessment: More than 40 years of research and practice. New Directions for Evaluation, 2014(144), 5–18. https://doi.org/10.1002/ev.20099 DOI: https://doi.org/10.1002/ev.20099

Benge, M., & Beattie, P. (2021). Challenges of early career extension agents in Florida. Advancements in Agricultural Development, 2(1), 42–55. https://doi.org/10.37433/aad.v2i1.87 DOI: https://doi.org/10.37433/aad.v2i1.87

Bourgeois, I., Lemire, S. T., Fierro, L. A., Castleman, A. M., & Cho, M. (2023). Laying a solid foundation for the next generation of evaluation capacity building: Findings from an integrative review. The American Journal of Evaluation, 44(1), 29–49. https://doi.org/10.1177/10982140221106991 DOI: https://doi.org/10.1177/10982140221106991

Diaz, J. M., Jayaratne, K. S. U., & Kumar Chaudhary, A. (2020). Evaluation competencies and challenges faced by early career extension professionals: Developing a competency model through consensus building. The Journal of Agricultural Education and Extension, 26(2), 183–201. https://doi.org/10.1080/1389224X.2019.1671204 DOI: https://doi.org/10.1080/1389224X.2019.1671204

Diaz, J., Chaudhary, A. K., Jayaratne, K. S. U., & Warner, L. A. (2019). Program evaluation challenges and obstacles faced by new extension agents: Implications for capacity building. Journal of Extension, 57(4), 26. https://doi.org/10.34068/joe.57.04.26 DOI: https://doi.org/10.34068/joe.57.04.26

Donaldson, J. L., Graham, D., Arnold, S., Taylor, L. K., & Jayaratne, K. S. U. (2023). An analytic needs assessment for extension education: Views from extension professionals and faculty. Journal of Human Sciences & Extension, 13. https://doi.org/10.55533/2325-5226.1388 DOI: https://doi.org/10.55533/2325-5226.1388

Donaldson, J. L., Graham, D. L., Arnold, S., Taylor, L. K., & Jayaratne, K. S. U. (2022). Extension education trends and research needs: Views from professionals and faculty. Journal of Agricultural Education, 63(3), 73–82. https://doi.org/10.5032/jae.2022.03073 DOI: https://doi.org/10.5032/jae.2022.03073

Donaldson, J. L., & Vaughan, R. (2022). A scoping study of United States extension professional competencies. Journal of Human Sciences and Extension, 10(1). https://doi.org/10.54718/BNRG8317 DOI: https://doi.org/10.54718/BNRG8317

Franz, N., & Archibald, T. (2018). Four approaches to building extension program evaluation capacity. Journal of Extension, 56(4). https://doi.org/10.34068/joe.56.04.03 DOI: https://doi.org/10.34068/joe.56.04.03

Ghimire, N. R., & Martin, R. A. (2013). Does evaluation competence of extension educators differ by their program area of responsibility? The Journal of Extension, 51(6), 18. https://doi.org/10.34068/joe.51.06.18 DOI: https://doi.org/10.34068/joe.51.06.18

Guion, L., Boyd, H., & Rennekamp, R. (2007). An exploratory profile of extension evaluation professionals. The Journal of Extension, 45(4), 7. https://commons.joe.org/joe/vol45/iss4/7

Halbritter, A., Wallau, M., Benge, M., & Mackowiak, C. (2021). Identifying important skills and competencies needed for new Florida agriculture extension agents. Advancements in Agricultural Development, 2(3), 61–71. https://doi.org/10.37433/aad.v2i3.151 DOI: https://doi.org/10.37433/aad.v2i3.151

Harpe, S. E. (2015). How to analyze Likert and other rating scale data. Currents in Pharmacy Teaching and Learning, 7(6), 836–850. https://doi.org/10.1016/j.cptl.2015.08.001 DOI: https://doi.org/10.1016/j.cptl.2015.08.001

Hernandez, F. J. (2025). Assessment of the evaluation competencies needed for extension professionals at the University of Connecticut: Implications for designing professional development curriculum in program evaluation. Journal of Agricultural Education, 66(4), 9. https://doi.org/10.5032/jae.v66i4.3276 DOI: https://doi.org/10.5032/jae.v66i4.3276

Hetherington, C., Eschbach, C., & Cuthbertson, C. (2019). How evaluation capacity building grows credible and actionable evidence for cooperative extension programs. Journal of Human Sciences and Extension, 7(2), 10. https://doi.org/10.54718/GLDP7457 DOI: https://doi.org/10.54718/GLDP7457

Israel, G. D., Diehl, D., & Galindo-Gonzalez, S. (2009). Evaluation situations, stakeholders & strategies (WC090). University of Florida Institute of Food and Agricultural Sciences (IFAS) Extension. https://doi.org/10.32473/edis-wc090-2009 DOI: https://doi.org/10.32473/edis-wc090-2009

Kelsey, K. D. (2018). Building evaluation capacity within an agricultural NGO using SWOT analysis. Journal of International Agricultural and Extension Education, 25(1), 60-79. https://doi.org/10.5191/jiaee.2018.25106 DOI: https://doi.org/10.5191/jiaee.2018.25106

Lamm, A., Israel, G. D., Diehl, D., & Harder, A. (2011). Evaluating Extension Programs (WC109). University of Florida Institute of Food and Agricultural Sciences. https://doi.org/10.32473/edis-wc109-2011 DOI: https://doi.org/10.32473/edis-wc118-2011

McClure, M. M., Fuhrman, N. E., & Morgan, A. C. (2012). Program evaluation competencies of extension professionals: Implications for continuing professional development. Journal of Agricultural Education, 53(4), 85–97. https://doi.org/10.5032/jae.2012.04085 DOI: https://doi.org/10.5032/jae.2012.04085

Narine, L., & Harder, A. (2021). Comparing the Borich model with the Ranked Discrepancy Model for competency assessment: A novel approach. Advancements in Agricultural Development, 2(3), 96–111. https://doi.org/10.37433/aad.v2i3.169 DOI: https://doi.org/10.37433/aad.v2i3.169

Narine, L. K., & Ali, A. D. (2020). Assessing priority competencies for evaluation capacity building in extension. Journal of Human Sciences and Extension, 8(3). https://doi.org/10.54718/OKVW8622 DOI: https://doi.org/10.54718/OKVW8622

Rodgers, M. S., Hillaker, B. D., Haas, B. E., & Peters, C. (2012). Taxonomy for assessing evaluation competencies in extension. The Journal of Extension, 50(4). https://doi.org/10.34068/joe.50.04.03 DOI: https://doi.org/10.34068/joe.50.04.03

Ruxton, G. D., & Beauchamp, G. (2008). Time for some a priori thinking about post hoc testing. Behavioral Ecology, 19(3), 690-693. https://doi.org/10.1093/beheco/arn020 DOI: https://doi.org/10.1093/beheco/arn020

Silliman, B., Crinion, P., & Archibald, T. (2016). Evaluation champions: What they need and where they fit in organizational learning. Journal of Human Sciences and Extension, 4(3). https://doi.org/10.54718/WOLP9257 DOI: https://doi.org/10.54718/WOLP9257

Strong, R., & Harder, A. (2011). Recommended competencies needed for training in international extension settings. Journal of International Agricultural and Extension Education, 18(3), 72–83. https://doi.org/10.5191/jiaee.2011.18306 DOI: https://doi.org/10.5191/jiaee.2011.18306

Turner, J. A., Guesmi, B., Gil, J. M., Heanue, K., Sierra, M., Percy, H., ... & Milne, C. (2022). Evaluation capacity building in response to the agricultural research impact agenda: Emerging insights from Ireland, Catalonia (Spain), New Zealand, and Uruguay. Evaluation and Program Planning, 94, 102127. https://doi.org/10.1016/j.evalprogplan.2022.102127 DOI: https://doi.org/10.1016/j.evalprogplan.2022.102127

Vengrin, C. A. (2016). Examining the evaluation capacity, evaluation behaviors, and the culture of evaluation in Cooperative Extension. Virginia Polytechnic Institute and State University. http://hdl.handle.net/10919/64513

Witkin, B. R. (1984). Assessing needs in educational and social programs: Using information to make decisions, set priorities, and allocate resources. Jossey-Bass.

Wright, A., Wright, J., McCorkle, D., & Hyde, J. (2025). Are we measuring impact accurately? Identifying potential sources of bias in the evaluation of extension personnel and programs. Applied Economic Perspectives and Policy, 47(1), 49–64. https://doi.org/10.1002/aepp.13478 DOI: https://doi.org/10.1002/aepp.13478