SP Performance Assessment - Observation Requirements of an Activity

The SP Performance Assessment panel located on the Activity Reporting Setup page can be used for determining

the required number of SP observations that should be submitted for the Activity by Observers,
how some information on the SP Performance Assessment Reports should be displayed.

Important

Any changes made in the Observation Requirements or other settings—regarding the display of scores or learner names—have to be saved by clicking Save at the bottom of the page. You may have to scroll down to see the Save button.

Observation Requirements

Observation Requirement is the percentage or number of simulated patient encounters portrayed by a Standardized Patient (SP) that are required to be evaluated by an Observer within an Activity to assess the performance of some or every SP featured in the Activity.

You can set up the required number of observations by

selecting the percentage of required observations out of the total encounters of the Activity
selecting the percentage of required observations out of the total encounters of each SP
selecting the number of required observations of each SP's daily encounter count

If the percentage or the number of the required SP observations is below the maximum amount of patient encounters—below 100% or the total number of encounters—saved under the name of the Activity, the system selects encounters randomly for Observers to evaluate.

Encounters Selected for Observation

An encounter is only eligible for SP observation if the conditions are met for setting up Inter-rater Agreement or the SP Performance Assessment Checklist.

So, whenever the Observer user opens the SP Performance Assessment - Post-Encounter Observations page, the list of Encounters to Observe will be populated with the exact number of randomly selected encounters set up at the Observation Requirements.

Highlighting the Low Scores of SPs

You can set benchmarks for SP performance:

Highlight the SPs on the SP Performance Assessment Report whose overall percentage score is under the desired benchmark expressed as a percentage
Highlight the SPs on the SP Performance Assessment Report whose lowest score per an encounter is lower than the desired benchmark expressed as a percentage

Further Settings

By selecting the Include Section Agreement Scores checkbox, the summary page of the SP Performance Assessment Reports
—before selecting any SP to check their individual scores—shows the Inter-rater agreement broken down by Sections.