The EVAL framework: Developing impact evaluation scholars

Robert Strong; Kim  Dooley; Theresa Murphrey; Jen Strong; Chanda  Elbert; Matt Baker

doi:10.37433/aad.v2i3.139

Authors

Robert Strong Texas A&M University, USA https://orcid.org/0000-0001-5279-4808
Kim Dooley Texas A&M University, USA https://orcid.org/0000-0002-5654-5988
Theresa Murphrey Texas A&M University, USA https://orcid.org/0000-0003-4996-6087
Jen Strong Texas A&M University, USA https://orcid.org/0000-0001-6718-6434
Chanda Elbert Texas A&M University, USA https://orcid.org/0000-0001-6115-6410
Matt Baker Texas A&M University, USA https://orcid.org/0000-0002-0556-744X

DOI:

https://doi.org/10.37433/aad.v2i3.139

Keywords:

individual values, active and experiential learning, leadership, career preparation, evaluation framework

Abstract

The complexities of food, agriculture, natural resources, and human sciences (FANH) programs and projects require faculty to write and secure funding in addition to mastering skills such as evaluation competencies that integrate abilities in quantitative and qualitative research methods and evaluation theory and practice. The EVAL Framework was developed to advance skill development among FANH graduates to include these competencies and increase the pipeline of students who have the essential skills needed to advance FANH initiatives and priorities. The EVAL Framework includes four primary constructs: (a) Evaluation, (b) Value, (c) Active and Experiential Learning, and (d) Leadership. The purpose of EVAL is to build relationships with untapped FANH fields to develop a pipeline for graduates to become evaluation leaders for advancing food and agricultural sciences. This experiential learning and development model focuses on foundational and enrichment experiences, through formal coursework, project-based learning, and contextually rich environments. Mentoring, individualized development plans, scholarly learning communities, collaboration, transferable skills, and career planning and guidance activities are integrated into the EVAL framework to enhance skill development among EVAL scholars.

Downloads

Download data is not yet available.

References

American Evaluation Association [AEA]. (2018). AEA Competencies. https://www.eval.org/About/Competencies-Standards/AEA-Evaluator-Competencies

Boyd, B., & Strong, J. (2020). Ethical leadership: Theory to practice. Kendall Hunt Publishing.

Britton, E., Simper, N., Leger, A., & Stephenson, J. (2017). Assessing teamwork in undergraduate education: A measurement tool to evaluate individual teamwork skills. Assessment & Evaluation in Higher Education, 42(3), 378–397. https://doi.org/10.1080/02602938.2015.1116497

Brungardt, C. (1996). The making of leaders: A review of the research in leadership development and education. Journal of Leadership and Organizational Studies, 3(3), 81–95. https://doi.org/10.1177/107179199700300309

Curtin, N., Malley, J., & Stewart, A. J. (2016). Mentoring the next generation of faculty: Supporting academic career aspirations among doctoral students. Research in Higher Education, 57, 714–738. https://doi.org/10.1007/s11162-015-9403-x

Fitzpatrick, J. L., Sanders J. R., & Worthen, B. R. (2011). Program evaluation: Alternative approaches and practical guidelines (4th ed.). Pearson.

Freire, P. (1970). Pedagogy of the oppressed. Penguin Books.

Guba, E. G., & Lincoln, Y. (1981). Effective evaluation: Emergence of responsive evaluation. Jossey-Bass Publishers.

Hitt, D. H., & Tucker, P. D. (2016). Systematic review of key leader practices found to influence student achievement: A unified framework. Review of Educational Research, 86(2), 531–569. https://doi.org/10.3102/0034654315614911

Ibarra-Sáiz, M. S., Rodríguez-Gómez, G., & Boud, D. (2020). Developing student competence through peer assessment: The role of feedback, self-regulation and evaluative judgement. Higher Education, 80, 37–156. https://doi.org/10.1007/s10734-019-00469-2

Jackson, D. (2010). An international profile of industry-relevant competencies and skill gaps in modern graduates. International Journal of Management Education, 8(3), 29–58. https://doi.org/10.3794/ijme.83.288

Kolb, D. A. (2014). Experiential learning: Experience as the source of learning and development (2nd ed.). Prentice Hall.

Kram, K. E. (1985). Mentoring at work: Developmental relationship in organizational life. Scott Foresman.

Ladson-Billings, G. (1994). The dreamkeepers. Jossey-Bass Publishing Co.

Patton, M. Q. (2014). Qualitative research & evaluation methods: Integrating theory and practice. Sage Publications.

Patton, M. Q. (2021). How far dare an evaluator go toward saving the world?: Redux, update, and a reflective practice facilitation tool. American Journal of Evaluation, 42(2), 162–184. https://doi.org/10.1177/1098214020927095

Roberts, T. G. (2006). A philosophical examination of experiential learning theory for agricultural educators. Journal of Agricultural Education, 47(1), 17–29. https://doi.org/10.5032/jae.2006.01017

Rossi, P. H., Lipsey, M. W., & Henry, G. T. (2019). Evaluation: A systematic approach (8th ed.). Sage Publications.

Silberman, M. (2006). Active training: A handbook of techniques, designs, case examples, and tips (3rd ed.). John Wiley and Sons, Inc.

Stufflebeam, D. L. (2001). Evaluation models: New directions for evaluation. Jossey-Bass. https://doi.org/10.1002/ev.3

Succi, C., & Canovi, M. (2020). Soft skills to enhance graduate employability: Comparing students and employers’ perceptions. Studies in Higher Education, 45(9), 1834–1837. https://doi.org/10.1080/03075079.2019.1585420

United States Department of Agriculture. (2018). USDA Strategic Plan FY 2018-2022. https://www.usda.gov/sites/default/files/documents/usda-strategic-plan-2018-2022.pdf