We will be using the pilot to explore which method will best accomplish the ABPMR goal of ongoing learning and engagement.
Scoring for the pilot will work like this: Participants will have two opportunities to answer each question: an initial attempt and then, if incorrect, an immediate second attempt after having an opportunity to read the critique (explanation of why the correct answer is correct and why another isn't based on recent texts and research).
If you're a pilot participant, your diplomate dashboard will reflect your initial attempt answer in the performance for the corresponding content area, in part so you can target any weaker areas for improvement. The second attempt will be tracked for statistical analysis only but it also offers a benefit: longitudinal assessment research shows re-attempts help to boost learning after reading the rationale.
Keep in mind, too, that in later quarters you'll be seeing question clones - similar question “repeats” delivered based on a missed question or low confidence in an earlier quarter. Each of these clones will provide an opportunity to demonstrate learning over time and will improve your overall performance in those weaker content areas.
Again, this is the scoring design for the pilot, which won't have any bearing on pilot participants' certification status except for serving as a free study tool before the secure MOC Examination. Statistical analysis from the project will help inform the final decision on scoring for the integration of CertLink for MOC (if the pilot is successful).