A discrepancy in discrepancy scores? Comparing the Borich and Ranked Discrepancy Models for determining professional development needs

Donald M. Johnson; Will Doss; Christopher M. Estepp; Henry O. Akwah; George W. Wardlow

doi:10.37433/aad.v5i4.515

Authors

Donald M. Johnson University of Arkansas, USA https://orcid.org/0000-0003-2592-654X
Will Doss University of Arkansas, USA https://orcid.org/0000-0002-3163-7528
Christopher M. Estepp University of Arkansas, USA https://orcid.org/0000-0001-7268-9044
Henry O. Akwah University of Arkansas Community College at Batesville, USA https://orcid.org/0009-0007-3164-3614
George W. Wardlow University of Arkansas, USA https://orcid.org/0000-0001-5701-8250

DOI:

https://doi.org/10.37433/aad.v5i4.515

Keywords:

measurement theory, statistical theory, research methods, SDG 4: Quality Education

Abstract

The Borich (1980) model has been widely used to determine professional development (PD) needs of school-based agricultural education (SBAE) teachers over the past 40-plus years. However, recent criticism, primarily focused on a purported statistical issue, has led to development of the Ranked Discrepancy Model [RDM (Narine & Harder, 2021)] as a potential alternative. This article provides perspective on the statistical issue in question and compares the results of using the Borich model and the RDM to assess precision agriculture (PA) PD needs of Arkansas SBAE teachers (N = 44). Our quantitative results indicated the two models produced different PD priorities, especially among the highest rated priorities. The mean weighted discrepancy scores [MWDSs (Borich model)] and the ranked discrepancy scores [RDSs (RDM)] had a shared variance of 54.8%; the PD priority rankings established by the two methods had a shared variance of 47.6%. Additionally, the number of tied priorities with the RDM complicated identifying priority PD workshop topics. We recommend further research and dialogue before wholesale abandonment of the Borich model for the RDM as a method of determining PD needs.

Downloads

Download data is not yet available.

References

Akwah, H. O. (2024). Inservice needs of selected Arkansas agriculture teachers related to precision agriculture systems.[Doctoral dissertation, University of Arkansas]. Scholarworks@UARK. https://scholarworks.uark.edu/etd/5373/

Barrick, R. K. (1989). Agricultural education: Building upon our roots. Journal of Agricultural Education, 30(4), 24–29. https://doi.org/10.5032/jae.1989.04024

Barrick, R. K., Ladewig, H. W., & Hedges, L. E. (1983). Development of a systematic approach to identifying technical inservice needs of teachers. Journal of the American Association of Teacher Educators in Agriculture, 24(1), 13–19. https://doi.org/10.5032/jaatea.1983.01013

Borich, G. D. (1980). A needs assessment model for conducting follow-up studies. Journal of Teacher Education, 31(3), 39–42. https://doi.org/10.1177/002248718003100310

Dyer, J. E., Haase-Wittler, P. S., & Washburn, S. G. (2003). Structuring agricultural education research using conceptual and theoretical frameworks. Journal of Agricultural Education, 44(2), 61–74. https://doi.org/10.5032/jae.2003.02061

Gaito, J. (1980). Measurement scales and statistics: Resurgence of old misconceptions. Psychological Bulletin, 87(3), 564–567. https://doi.org/10.1037/0033-2909.87.3.564

Garton, B. L., & Chung, N. (1997). An assessment of the inservice needs of beginning teachers of agriculture using two assessment methods. Journal of Agricultural Education, 38(3), 51–58. https://doi.org/10.5032/jae.1997.03051

Gates, H. R., Johnson, D. M., & Shoulders, C. W. (2018). Instrument validity in manuscripts published in the Journal of Agricultural Education Between 2007 and 2016. Journal of Agricultural Education, 59(3), 185–197. https://doi.org/10.5032/jae.2018.03185

Harwell, M. R., & Gatti, G. G. (2001). Rescaling ordinal data to interval data in educational research. Review of Educational Research, 71(1), 105–131. https://doi.org/10.3102/00346543071001105

James, W. (1907). Pragmatism: A new name for some old ways of thinking. Project Gutenberg. https://www.gutenberg.org/ebooks/5116

Jamieson, S. (2004). Likert scales: How to (ab)use them? Medical Education, 38(12), 1217–1218. https://doi.org/10.1111/j.1365-2929.2004.02012.x

Johnson, D. M., Schumacher, L. G., & Stewart, B. R. (1990). An analysis of the agricultural mechanics laboratory management inservice needs of Missouri agriculture teachers. Journal of Agricultural Education, 31(2), 35–39. https://doi.org/10.5032/jae.1990.02035

Lord, F. M. (1953). On the statistical treatment of football numbers. American Psychologist, 8, 750–751. https://doi.org/10.1037/h0063675

Narine, L., & Harder, A. (2021). Comparing the Borich model with the ranked discrepancy model for competency assessment: A novel approach. Advancements in Agricultural Development, 2(3), 96–11. https://doi.org/10.37433/aad.v2i3.169

Newman, M. E., & Johnson, D. M. (1994). Inservice education needs of teachers of pilot agriscience courses in Mississippi. Journal of Agricultural Education, 35(1), 54–60. https://doi.org/10.5032/jae.1994.01054

Norman, G. (2010). Likert scales, levels of measurement, and “laws” of statistics. Advances in Health Science Education, 15(5), 625–632. https://doi.org/10.1007/s10459-010-9222-y

Roberts, T. G., Harder, A., & Brashears, M. T. (Eds). (2016). American Association for Agricultural Education national research agenda: 2016-2020. Department of Agricultural Education and Communication.

Smalley, S. W., Hainline, M. S., & Sands, K. (2019). School-based agricultural education teachers’ perceived PD needs associated with teaching, classroom management, and technical agriculture. Journal of Agricultural Education, 60(2), 85–98. https://doi.org/10.5032/jae.2019.02085

Stevens, S. S. (1946). On the theory of measurement scales. Science, 103 (2684), 677–680. https://doi.org/10.1126/science.103.2684.677

Zumbo, B. D., & Zimmerman, D. W. (1993). Is the selection of statistical methods governed by the level of measurement? Canadian Psychology, 43(4), 390–400. https://doi.org/10.1037/h0078865