Original Article

Orthopaedic In-Training Examination Performance: A Nine-Year Review of a Residency Program Database

Authors: Benjamin Risner, BS, John Nyland, EdD, PT, SCS, ATC, FACSM, Charles Crawford, MD, Craig S. Roberts, MD, John R. Johnson, MD

Abstract

Background: The Orthopaedic In-Training Examination (OITE) provides an objective way for both the residency program and the resident to monitor progress.


Methods: This longitudinal descriptive study tracks the OITE performance of 16 residents from one orthopaedic surgery residency program over nine years (1997–2005). Domain comparisons are made to national averages (N > 3000) by mean difference and split middle celeration line assessment trend analysis to evaluate program strengths and weaknesses. Further evaluation by postgraduate year (PGY) is made of domains that were deemed to be in need of moderate attention.


Results: Resident performance for the medically related issues, rehabilitation, and sports medicine domains were deemed acceptable. Resident performance on the orthopaedic science, orthopaedic diseases, hip and knee reconstruction, spine, and shoulder and elbow domains were deemed to be in need of minor attention. Musculoskeletal trauma, pediatric orthopaedics, foot and ankle, and hand domains were deemed to be in need of moderate attention. Further analysis of these domains by PGY revealed less positive slopes for the pediatric orthopaedics and musculoskeletal trauma domains, and a negative slope for the hand domain between PGY-3 and PGY-4, each indicative of lower domain-specific OITE scores than the national mean. A similar, less positive slope was identified between PGY-2 and PGY-3 for the foot and ankle domain.


Conclusions: A longitudinal descriptive review of orthopaedic surgery resident OITE performance enables the departmental education committee to identify curricular content areas that require attention, select the most efficient modes of educational information delivery, facilitate learning through the application of innovative educational technologies, establish measurable educational program goals, and more prescriptively allocate personnel and equipment resources.


Key Points


* Standardized tests such as the Orthopaedic In-Training Examination (OITE) provide valuable data that can be used by residency programs to review educational mission effectiveness.


* A longitudinal review of OITE scores can be used to identify curricular strengths and weaknesses and to set measurable educational program goals.


* Personnel and educational equipment resources can be prescriptively allocated to improve resident OITE performance.

This content is limited to qualifying members.

Existing members, please login first

If you have an existing account please login now to access this article or view purchase options.

Purchase only this article ($25)

Create a free account, then purchase this article to download or access it online for 24 hours.

Purchase an SMJ online subscription ($75)

Create a free account, then purchase a subscription to get complete access to all articles for a full year.

Purchase a membership plan (fees vary)

Premium members can access all articles plus recieve many more benefits. View all membership plans and benefit packages.

References

1.Buckwalter JA, Schumacher R, Albright JP, et al. The validity of orthopaedic in-training examination scores. J Bone Joint Surg Am 1981;63:1001–1006.
 
2.Black KP, Abzug JM, Chinchilli VM. Orthopaedic in-training examination scores: a correlation with USMLE results. J Bone Joint Surg Am 2006;88:671–676.
 
3.Mankin HJ. The orthopaedic in-training examination (OITE). Clin Orthop Relat Res 1971;75:108–116.
 
4.Mankin HJ, Carter RM, Krawczyk M. The effect of permissive environment on scoring of the Orthopaedic In-Training examination. J Bone Joint Surg Am 1973;55:1100–1111.
 
5.Klein GR, Austin MS, Randolph S, et al. Passing the boards: can USMLE and orthopaedic in-training examination scores predict passage of the ABOS Part-I examination? J Bone Joint Surg Am 2004;86:1092–1095.
 
6.Dirschl DR, Dahners LE, Adams GL, et al. Correlating selection criteria with subsequent performance as residents. Clin Orthop Relat Res 2002;399:265–271.
 
7.Roberts CS, Johnson JR, Crawford C. Correlations between ABOS Part-I, OITE, and USMLE exam performance. Poster #P273 presented at the American Academy of Orthopaedic Surgeons Annual Conference, San Diego, CA, 2007.
 
8.Portney LG, Watkins MP. Foundations of Clinical Research: Applications to Practice. Upper Saddle River, NJ, Prentice Hall, 2000, ed 2.
 
9.Joyner BD, Nicholson C, Seidel K. Medical knowledge: the importance of faculty involvement and curriculum in graduate medical education. J Urol 2006;175:1843–1846.
 
10.Dailey SW, Brinker MR, Elliot MN. Orthopedic residents’ perceptions of the content and adequacy of their residency training. Am J Orthop 1999;27:563–570.
 
11.Kragh JF Jr, Bagg MR, Ward JA, et al. Measuring medical education and curriculum during orthopedic surgical residency. J Surg Res 2005;123:268–274.
 
12.Pinney SJ, Mehta S, Pratt DD, et al. Orthopaedic surgeons as educators: applying the principles of adult education to teaching orthopaedic residents. J Bone Joint Surg Am 2007;89:1385–1392.