Original Article

CME Article: Assessment of Written Feedback for Emergency Medicine Residents

Authors: Barry Hahn, MD, Elizabeth D. Waring, MD, Jerel Chacko, MD, Gabriella Trovato, RN, Amanda Tice, RN, Josh Greenstein, MD

Abstract

Objectives: An essential component of resident growth is a learning environment with high-quality feedback. Criteria have been developed for characterizing and assessing written feedback quality in internal medicine residents by Jackson et al. Our primary goal was to describe feedback characteristics and assess the quality of written feedback for emergency medicine (EM) residents. Our secondary goals were to evaluate the relation between feedback quality and objective outcome measures.

Methods: This retrospective study was conducted between July 1, 2016 and July 1, 2018. EM residents with an Accreditation Council for Graduate Medical Education composite score (ACS), an in-service score, and written evaluations completed by an attending physician or EM resident in each of the 2 years of the study period were included.

Results: Overall, most of the evaluations contained 1 (21%), 2 (23%), or 3 (17%) feedback items. Feedback tended to be positive (82%) and the feedback quality of the evaluations was more likely to be high (44%). There was an association between feedback quality and ACS change (P < 0.0001), but not in-service score change (P = 0.63). Resident evaluations were more likely than attending evaluations to correlate with ACS change (P < 0.00001).

Conclusions: The written evaluations contained few individual feedback items. Evaluations generally focused on the feedback characteristics of professionalism and interpersonal communication. The general feedback quality of evaluations tended to be high and correlated with an increase in ACSs.

This content is limited to qualifying members.

Existing members, please login first

If you have an existing account please login now to access this article or view purchase options.

Purchase only this article ($25)

Create a free account, then purchase this article to download or access it online for 24 hours.

Purchase an SMJ online subscription ($75)

Create a free account, then purchase a subscription to get complete access to all articles for a full year.

Purchase a membership plan (fees vary)

Premium members can access all articles plus recieve many more benefits. View all membership plans and benefit packages.

References

1. Archer JC. State of the science in health professional education: effective feedback. Med Educ 2010;44:101–108. 2. Ende J. Feedback in clinical medical education. JAMA 1983;250:777–781. 3. van de Ridder JM, Stokking KM, McGaghie WC, et al. What is feedback in clinical education? Med Educ 2008;42:189–197. 4. Sarkany D, Deitte L. Providing feedback: practical skills and strategies. Acad Radiol 2017;24:740–746. 5. Skeff KM, Stratos GA, Berman J, et al. Improving clinical teaching. Evaluation of a national dissemination program. Arch Intern Med 1992;152:1156–1161. 6. Colmers-Gray IN, Walsh K, Chan TM. Assessment of emergency medicine residents: a systematic review. Can Med Educ J 2017;8:e106–e122. 7. Jackson JL, Kay C, Jackson WC, et al. The quality of written feedback by attendings of internal medicine residents. J Gen Intern Med 2015;30:973–978. 8. Kay C, Jackson JL, Frank M. The relationship between internal medicine residency graduate performance on the ABIM certifying examination, yearly in-service training examinations, and the USMLE Step 1 examination. Acad Med 2015;90:100–104. 9. Educational Commission for Foreign Medical Graduates. ACGME Core Competencies. 2012. Available at: https://ecfmg.org/echo/acgme-core-competencies.html. Accessed July 23, 2020. 10. Gulbas L, Guerin W, Ryder HF. Does what we write matter? Determining the features of high- and low-quality summative written comments of students on the internal medicine clerkship using pile-sort and consensusanalysis: a mixed-methods study. BMC Med Educ 2016;16:145.