Page History

When evaluating SP performance, besides the Inter-Rater Agreement Score, the assessment comes from the SP Performance Assessment (SPPA) part of a Case that is to be filled out by Observers.
The SPPA part of the questionnaire contains questions about how the SP performed during a certain learner encounter.

Image Modified

Like in the case of agreement scores, a score is calculated for each observation, then the average score across all observations of the SP is calculated.

SP Performance Evaluation Value

The SP Performance Evaluation Value refers to one certain encounter and it is calculated very similarly to the learner scores, but in this case, the SP is scored, not the learner:
The SP gets as many points for each section of a certain part of the Case as the answer selected by the observer is worth.
Then the system calculates the percentage score for each section of this part and gets the SP Performance Evaluation Value for this observation by calculating the weighted average of the section percentage scores using the section weights, as set in the Case Manager. 

Image Modified

s_s = section score of an SP, for each section of the SPPA part of one particular Case
w_s = section weight belonging to each section within SPPA part of the Case, defined in the Case Manager
n = number of sections in the SPPA part of the Case

SP Performance Evaluation Score

The reported SP Performance Evaluation Score is the average value of the SP Performance Evaluation Values which refer to the  observations of the SP doing the Case in the Activity.

Image Modified

e_o = SP Performance Evaluation Value of an SP, for one particular encounter for each observation the SP has for a certain Case
n = number of encounters that have been observed for the SP in the Case

Image Modified