Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Setting Up Inter-rater Agreement

Inter-rater Agreement measures the accuracy of an SP's assessment skills. It can be complemented by the SP Performance Assessment Checklist.

Tip
titleSP Performance Assessment Report

Where can you check the scores of observed SPs? Click here to find out more about SP Performance Assessment reporting.

General Conditions

Excerpt
  •  Grant the Observer privilege to a preferred user of the activity's faculty group.
  •  Make sure the case that the observed SP is involved in has an SP checklist.
  •  Check each section of the SP checklist and make sure that the Observed checkbox is selected at the top of each section.

Conditions for Live Observation

Excerpt
  •  Meet the General Conditions of the setup.
  •  Have the activity, case, learner and SP added to a room in Recording.
    An activity and case can be added either manually to the room, or with RNSA setup, or by a scheduled event.
  •  

    Have one of your video control users or automatic recording controls (user-action triggered or timeslot structure video control) launch the recording in the room.

...

Info
titleInfo

The Observer user can now access the Live Observation of the SP under the Data Entry Tools by selecting the activity.


Conditions for Post-Encounter Observation

Excerpt
  •  Meet the General Conditions of the setup.
  •  Have a saved video recording with the name of the learner performing the case and the name of the observed SP. 
  •  Make sure that the observed SP filled out and submitted the SP checklist of the portrayed case on the learner featured on the video recording.

...

Info
titleInfo

The Observer user should have access to the Post-Encounter Observations of the activity under the Data Entry Tools by selecting the activity.

After selecting the activity, the Observer should see the video recording, and the SP checklist displayed.


Note
titleAbout the Number of Encounters to Observe

No encounters to observe? Check the Observation Requirement set up for the activity in the activity's Reporting Setup to manage the number of encounters eligible for observation.

...