Original Article

Peer Assessment of Professional Performance by Hospitalist Physicians

Authors: Harjit K. Bhogal, MD, MBBS, Eric Howell, MD, Haruka Torok, MD, Amy M. Knight, MD, Erica Howell, MD, Scott Wright, MD

Abstract

Background: The clinical collaborations among hospitalist physicians create opportunities for peer evaluation. We conducted this study to generate validity evidence for a scale that allows for peer assessment of professional performance.


Methods: All of the hospitalist physicians working for >1 year at our hospital were asked to assess each of their physician colleagues along eight domains and name three colleagues whom they would choose to care for a loved one needing hospitalization. A mean composite clinical performance score was generated for each provider. Statistical analyses using the Pearson coefficient were performed.


Results: The 22 hospitalist physician participants were confident in their ability to assess their peers’ clinical skills. There were strong correlations between the domains of clinical excellence (r > 0.5, P < 0.05). Being selected as a doctor whom colleagues would choose to take care of their loved ones was highly correlated with high scores in the domains of humanism, diagnostic acumen, signouts/handoffs, and passion for clinical medicine, and higher composite clinical performance scores (all r > 0.5, P < 0.05). High scores on the Press Ganey questions correlated with peer assessment of humanism (r = .78, P = 0.06).


Conclusions: The correlation among scale items, the composite clinical performance score, and the variable “a doctor whom you would choose to care for a loved one” provides validity evidence to our assessment scale. Such measurements may allow hospitalist groups to identify top performers who could be recognized, rewarded, and held up as role models and weaker performers who may need focused training or remediation.

This content is limited to qualifying members.

Existing members, please login first

If you have an existing account please login now to access this article or view purchase options.

Purchase only this article ($25)

Create a free account, then purchase this article to download or access it online for 24 hours.

Purchase an SMJ online subscription ($75)

Create a free account, then purchase a subscription to get complete access to all articles for a full year.

Purchase a membership plan (fees vary)

Premium members can access all articles plus recieve many more benefits. View all membership plans and benefit packages.

References

1. Buckley LM, Sanders K, Shih M, et al. Attitudes of clinical faculty about career progress, career success and recognition, and commitment to academic medicine: results of a survey. Arch Intern Med 2000; 160: 2625–2629.
 
2. Atasoylu AA, Wright SM, Beasley BW, et al. Promotion criteria for clinician-educators. J Gen Intern Med 2003; 18: 711–716.
 
3. Levinson W, Rubenstein A. Mission critical—integrating clinical-educators into academic medical centers. N Engl J Med 1999; 341: 840–843.
 
4. Carey RM, Wheby MS, Reynolds RE. Evaluating faculty clinical excellence in the academic health sciences center. Acad Med 1993; 68: 813–817.
 
5. Beasley BW, Wright SM, Cofrancesco J, et al. Promotion criteria for clinician-educators in the United States and Canada. A survey of promotion committee chairpersons. JAMA 1997; 278: 723–728.
 
6. Yusuf SW. The decline of academic medicine. Lancet 2006; 368: 284.
 
7. Durso SC, Christmas C, Kravet S, et al. Implications of academic medicine’s failure to recognize clinical excellence. Clin Med Res 2009; 7: 127–133.
 
8. Christmas C, Kravet SJ, Durso SC, et al. Clinical excellence in academia: perspectives from masterful academic clinicians. Mayo Clin Proc 2008; 83: 989–994.
 
9. Dressler DD, Pistoria MJ, Budnitz TL, et al. Core competencies in hospital medicine: development and methodology. J Hosp Med 2006; 1: 48–56.
 
10. Top doctors 2009: your questions answered.http://www.bostonmagazine.com/articles/top_doctors_2009_your_questions_answered. Accessed August 9, 2011.
 
11. Castle Connolly Medical Ltd. Nomination process. http://www.castleconnolly.com/about/nomprocess.cfm. Accessed August 9, 2011.
 
12. Ramsey PG, Wenrich MD. Peer ratings: an assessment tool whose time has come. J Gen Intern Med 1999; 14: 581–582.
 
13. Ramsey PG, Wenrich D, Carline JD, et al. Use of peer ratings to evaluate physician performance. JAMA 1993; 269: 1655–1660.
 
14. Ramsey PG, Carline JD, Bland LL, et al. Feasibility of hospital-based use of peer ratings to evaluate the performances of practicing physicians. Acad Med 1986; 71: 364–370.
 
15. Hall W. Assessment of physician performance in Alberta: the physician achievement review. CMAJ 1999; 161: 1999–2001.
 
16. Elwyn G, Lewis M, Evans R, et al. Using a peer assessment questionnaire in primary medical care. Br J Gen Pract 2005; 55: 690–695.
 
17. Ramsey PG, Carline JD, Inui Thomas, et al. Predictive validity of certification by the American Board of Internal Medicine. Ann Intern Med 1989; 110: 719–726.
 
18. Evans R, Elwyn G, Edwards A. Review of instruments for peer assessment of physicians. BMJ 2004; 328: 1240–1245.
 
19. Smith CA, Varey AB, Evans AT, et al. Evaluating the performance of inpatient attending physicians. Gen Intern Med 2004; 19: 766–771.
 
20. Carline JD, Wenrich M, Ramsey PG. Characteristics of ratings of physician competence by professional associates. Eval Health Prof 1989; 12: 409.
 
21. Campbell JL, Richards SH, Dickens A. Assessing the professional performance of UK doctors: an evaluation of the utility of the general medical council patient and colleague questionnaires. Qual Saf Health Care 2007; 17: 187–193.