Original Article

Comparison of Medical Student Communication Skills Measured by Standardized Patients During an OSCE and by Faculty During an In-Hospital Encounter

Authors: Mary Lacy, MD, Leonard Noronha, MD, Yuridia Leyva, MS, John Rush Pierce, MD, MPH

Abstract

Objectives: At our institution, learner communication skills during an objective structured clinical examination (OSCE) are measured by standardized patients (SPs) using the New Mexico Clinical Communication Scale (NM-CCS). Faculty physicians also conduct a direct observation of a clinical encounter (DOCE) to observe students’ interactions with real hospitalized patients. The objective of this study was to determine whether students have similar communication skills scores with real patients as compared with SPs.

Methods: The NM-CCS was modified to fit a hospital encounter (mNM-CCS). Student NM-CCS scores for an OSCE were compared with their matched mNM-CCS scores obtained during their DOCE.

Results: Matched scores were compared for 83 students. The mean total percentage scores on the DOCE and OSCE were both 60%. There was no correlation between individual student communication scores. The difference between mean total scores mNM-CCS scores for the faculty preceptors was not statistically significant (P = 0.1985).

Conclusions: We found no correlation between student communication scores measured by faculty during the DOCE compared with communication skills measured by SPs during an OSCE. The discordant results of some students on the OSCE compared with the DOCE suggests that the OSCE may not identify students who may benefit from additional communication skills training.

This content is limited to qualifying members.

Existing members, please login first

If you have an existing account please login now to access this article or view purchase options.

Purchase only this article ($25)

Create a free account, then purchase this article to download or access it online for 24 hours.

Purchase an SMJ online subscription ($75)

Create a free account, then purchase a subscription to get complete access to all articles for a full year.

Purchase a membership plan (fees vary)

Premium members can access all articles plus recieve many more benefits. View all membership plans and benefit packages.

References

1. Stewart MA. Effective physician-patient communication and health outcomes: a review. CMAJ 1995;152:1423-1433.
2. Aspegren K. BEME guide no. 2: teaching and learning communication skills in medicine-a review with quality grading of articles. Med Teach 1999;21:563-570.
3. Hauer KE, Hodgson CS, Kerr KM, et al. A national study of medical student clinical skills assessment. Acad Med 2005;80(10 suppl):S25-S29.
4. Taylor ML, Blue AV, Mainous AG, 3rd et al. The relationship between the National Board of Medical Examiners’ prototype of the Step 2 clinical skills exam and interns’ performance. Acad Med 2005;80:496-501.
5. Smith SR. Correlations between graduates’ performances as first-year residents and their performances as medical students. Acad Med 1993;68:633-634.
6. Winward ML, Lipner RS, Johnston MM, et al. The relationship between communication scores from the USMLE Step 2 Clinical Skills examination and communication ratings for first-year internal medicine residents. Acad Med 2013;88:693-698.
7. Cuddy MM, Winward ML, Johnston MM, et al. Evaluating validity evidence for USMLE Step 2 Clinical Skills Data Gathering and Data Interpretation Scores: does performance predict history-taking and physical examination ratings for first-year internal medicine residents? Acad Med 2016;91:133-139.
8. Brannick MT, Erol-Korkmaz HT, Prewett M. A systematic review of the reliability of objective structured clinical examination scores. Med Educ 2011;45:1181-1189.
9. Pierce JR, Jr Noronha L, Collins NP, et al. Brief structured observation of medical student hospital visits. Educ Health (Abingdon) 2013;26:188-191.
10. Torre DM, Daley BJ, Sebastian JL, et al. Overview of current learning theories for medical educators. Am J Med 2006;119:903-907.
11. Burdick WP, Boulet JR, LeBlanc KE. Can we increase the value and decrease the cost of clinical skills assessment? Acad Med 2018;93:690-692.
12. Ecker DJ, Milan FB, Cassese T, et al. Step up-not on-the Step 2 Clinical Skills Exam: directors of clinical skills courses (DOCS) oppose ending Step 2 CS. Acad Med 2018;93:693-698.
13. End Step 2 CS. http://endstep2cs.com. Accessed February 15, 2018.
14. Schneider NR. Validity evidence for the interpretation and use of essential elements of communication global rating scale scores. http://digitalrepository.unm.edu/educ_ifce_etds/34. Published February 1, 2016. Accessed November 18, 2018.
15. Makoul G. Essential elements of communication in medical encounters: the Kalamazoo consensus statement. Acad Med 2001;76:390-393.
16. Harris PA, Taylor R, Thielke R, et al. Research electronic data capture (REDCap)-a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009;42:377-381.