The Southern Medical Journal (SMJ) is the official, peer-reviewed journal of the Southern Medical Association. It has a multidisciplinary and inter-professional focus that covers a broad range of topics relevant to physicians and other healthcare specialists.

SMJ // Article

Original Article

Evaluating Graduate Medical Education Meetings Using a Modified Nominal Group Technique

Authors: Tamar Levene, MD, MS, Benjamin Houseman, MD, Lindsay Weiss, MD, Christopher Chang, MD, Kerice Pinkney, MD, Robert Hunter, MD, Trishawn Shim, MBA, Ahmed Shoreibah, MD, Holly Neville, MD, Saima Chaudhry, MD, Suzanne Minor, MD

Abstract

Objectives: Despite the critical oversight role that the graduate medical education committee (GMEC) plays in Graduate Medical Education (GME), there has been little examination and assessment of the most effective way to conduct GMEC meetings to establish best practices and optimize efficacy. Using the modified nominal group technique (mNGT), an innovative methodology for evaluating medical education activities, we studied perceived strengths and weaknesses of GMEC meetings and developed an action plan based on our assessment.

Methods: We conducted an mNGT at an annual GME leadership retreat involving leaders from 16 residency and fellowship programs. Participants ranked strengths and weaknesses in accordance with standard mNGT methodology. Results were tabulated, and an action plan was developed following a discussion period.

Results: Study participants ranked provision of informational updates and fostering collaboration among training programs as the most useful aspects of the GMEC, and areas for improvement included reviewing agenda content, ensuring all committee members are heard, and optimizing meeting logistics. These results were reviewed with the entire GMEC membership, and several changes were implemented, including adjusting meeting format and developing a process for program leadership to provide input regarding agenda items.

Conclusions: This study demonstrates that the mNGT is an efficient and effective means to evaluate the strengths and weakness of GMEC meetings so that changes can be made when necessary to optimize the oversight of this critically important committee.

This content is limited to qualifying members.

Existing members, please login first

If you have an existing account please login now to access this article or view purchase options.

Purchase only this article ($25)

Create a free account, then purchase this article to download or access it online for 24 hours.

Purchase an SMJ online subscription ($75)

Create a free account, then purchase a subscription to get complete access to all articles for a full year.

Purchase a membership plan (fees vary)

Premium members can access all articles plus recieve many more benefits. View all membership plans and benefit packages.

References

1. Accreditation Council for Graduate Medical Education. Institutional application and requirements, effective. 2022. https://www.acgme.org/programs-and-institutions/institutions/institutional-application-and-requirements. Accessed September 22, 2025.
 
2. Amedee RG, Guidroz D, Walker W. Graduate medical education committee meetings 101. J Grad Med Educ 2018;10:707–708.
 
3. Frye AW, Hemmer PA. Program evaluation models and related theories: AMEE Guide No. 67. Med Teach 2012;34:e288–e299.
 
4. Kitzinger J. Qualitative research. Introducing focus groups. BMJ 1995;311:299–302.
 
5. Wiggins ST, Colby S, Moret L, et al. A modified nominal group technique (mNGT)—finding priorities in research. Am J Health Behav 2020;44:345–352.
 
6. Smith D, Cartwright M, Dyson J, et al. Use of nominal group technique methods in the virtual setting: a reflective account and recommendations for practice. Aust Crit Care 2024;37:158–165.
 
7. Dobbie A, Rhodes M, Tysinger JW, et al. Using a modified nominal group technique as a curriculum evaluation tool. Fam Med 2004;36:402–406.
 
8. Lloyd-Joes G, Fowell S, Bligh JG. The use of the nominal group technique as an evaluative tool in medical undergraduate education. Med Educ 1999;33:8–13.
 
9. Lancaster T, Hart R, Gardner S. Literature and medicine: evaluating a special study module using the nominal group technique. Med Educ 2002;36:1071–1076.