Program Evaluation

Training programs are expected to regularly evaluate aspects of their effectiveness.

With full implementation of Phase Three of the "Outcomes Project," training programs are expected to regularly evaluate aspects of their effectiveness. This is a frequently cited area for many programs; therefore, we pulled together a list of resources to help programs understand and fulfill these requirements. 

The annual surveys for faculty and residents can easily be set up in the Residency Management Suite (RMS). Please contact Graduate Medical Education (GME) if you are interested.  

Requirements and ideas/suggestions for implementation

Annual meeting

  1. The program director must organize a meeting with program faculty members and residents (at least 1-2 per training year) to review the program. Build this into an existing meeting and invite residents
  2. Discuss areas of strength and areas for improvement. Review goals/objectives, conferences, rotation evaluations, aggregate in-training examination performance. (click here for a meeting checklist)
  3. Meeting must be documented (click here for meeting minutes template)
  4. An action plan should be developed for the next year.

Resident evaluation of program

Residents must have the opportunity to confidentially evaluate the program in writing once per year.

Samples:

Faculty evaluation of program

Faculty members must have the opportunity to confidentially evaluate the program in writing once per year.

Samples:

Faculty development participation

Programs should be tracking faculty participation in various teaching and evaluation sessions.

  • Department and division offerings
  • Medical School Workshops
  • Regional and national offerings (CGEA, ACGME, AHME, specialty societies)

Board pass rate

One marker of program effectiveness is board pass rates.  If the program's pass rate is less than 100%, what areas could be targeted to impact pass rates?

Evaluation of resident performance

  1. How are the resident/fellows performing on in-training examinations (areas of strength, areas for improvement)?
  2. Where are areas of strength and areas for improvement?
  3. Which rotations do residents perform better on than others?