Setting Up Inter-rater Agreement
Inter-rater Agreement measures the accuracy of an SP's assessment skills. It can be complemented by the SP Performance Assessment Checklist.
SP Performance Assessment Report
Where can you check the scores of observed SPs? Click here to find out more about SP Performance Assessment reporting.
General Conditions
- Grant the Observer privilege to a preferred user of the Activity's faculty group.
- Make sure the Case that the observed SP is involved in has an SP checklist.
- Check each section of the SP checklist and make sure that the Observed checkbox is selected at the top of each section.
Conditions for Live Observation
- Meet the General Conditions of the setup.
- Have the Activity, Case, learner and SP added to a room in Recording.
An Activity and Case can be added either manually to the room, or with RNSA setup, or by a scheduled event. Have one of your video control users or automatic recording controls (user-action triggered or timeslot structure video control) launch the recording in the room.
Info
The Observer user can now access the Live Observation of the SP under the Data Entry Tools by selecting the Activity.
Conditions for Post-Encounter Observation
- Meet the General Conditions of the setup.
- Have a saved video recording with the name of the learner performing the Case and the name of the observed SP.
- Make sure that the observed SP filled out and submitted the SP checklist of the portrayed Case on the learner featured on the video recording.
Info
The Observer user should have access to the Post-Encounter Observations of the Activity under the Data Entry Tools by selecting the Activity.
After selecting the Activity, the Observer should see the video recording, and the SP checklist displayed.
About the Number of Encounters to Observe
No encounters to observe? Check the Observation Requirement set up for the Activity in the Activity's Reporting Setup to manage the number of encounters eligible for observation.
Related pages
For further information, visit our Case Manager and Cases - How to pages, or watch our Case Manager Training Videos.
Overview
Content Tools