Other Research
Published: Predicting Performance in the Physical Medicine and Rehabilitation Part II Certification Oral Examination Based On Milestone Ratings
This study aimed to provide follow-up to the research evaluating Milestones ratings and the American Board of Physical Medicine and Rehabilitation (ABPMR) Part I Examination. Scores in Part I, which measures medical knowledge, have been shown to correlate only with Milestones ratings in medical knowledge. The ABPMR Part II Examination assesses medical and physiatric knowledge in data acquisition (DA), problem solving (PS), patient management (PM), systems-based practice (SBP, and interpersonal and communication skills (ICS) in the context of eight clinical scenarios. For the follow-up study, researchers hypothesized that combined ratings of various Milestone competencies would predict subsequent performance in related ABPMR Part II Examination domains.
The five Part II Examination domain scaled scores were converted to three scores: PM and PS scores were combined, as were SBP and ICS. These domains were combined because their attributes have similarities. For instance, problem solving is an integral part of patient care. DA was analyzed on its own.
Milestones data and ABPMR Part II Examination scores of trainees in 3-yr PM&R residency programs in the United States from academic years (AY) 2014-2016 who sat for the ABPMR Parts I and II Examinations, immediately after completion of training, were reviewed. Regression analysis showed that Milestone sub-competencies, alone or in combination, did not correlate with Part II domain scaled scores. These results were not surprising, since the Milestones were designed not as an assessment tool, but as a means of tracking the trajectory of trainees' development while in a training program.
This current study found that no association exists between any of the Milestones competencies and the ABPMR Part II certifying examination, suggesting that the two assessment tools measure different attributes and can be considered complimentary.
Gerard E. Francisco, MD; Mikaela M. Raddatz, PhD; Kenji Yamazaki, MD; Sunil Sabharwal, MD, Keneshia Kirksey, MD; Carolyn L. Kinney, MD; Eric Holmboe, MD
