Necessary privilege:
Users with Open-Ended Question Scoring Data Entry privilege have access to rating answers given to open-ended questions by clicking the OEQS button on the Your Activities panel.
Only Activities shared with the user, that is, where the user is member of the assigned Faculty group, are listed in the panel.
While item types that offer selectable answers to a question, thereby yielding concrete score values calculable by the system; the text item type phrases a question that requires
a freely worded textual answer from the responder's part. As the score value of such answers cannot be calculated by the system, scoring requires the active participation of a competent user.
Conditions to be met for OEQS
- any of the checklists of a Case has to contain at least one text or structured text item or Step 2 CS Patient Note section that is scored
- such a Case has to be assigned to an Activity
- the scoring user has to have Open-Ended Question Scoring Data Entry privilege
- such a user has to be the member of the Faculty group assigned to the Activity in which the Case is added
See How to Evaluate Answers to Open-Ended Questions for details.
Preparation: Scored Text Item Type in a Case Part
Scoring notes: instructions for the scorers regarding the nuances of evaluating the responses. Such notes are displayed below the question on the Learner response page.
Scoring textual items of a checklist has three available techniques. When clicking the Points button, a drop-down menu appears for selecting the scoring method:
Direct scoring
When Direct scoring is selected, a Max. Score field is displayed where the maximum point value has to be determined; OEQS users can choose to give any number in the range of zero and the provided score value.
In case an item has direct scoring, the FON submit (OEQS) is not clickable in the Individual Checklist report. The submit is only clickable if the item’s scoring is Questionnaire based or based on the Keyword method.
To check out the Direct scoring related report, use the Comments report.
Keywords method
Selecting the Keywords method prompts the Set Keywords button to be displayed. Clicking the button opens the Keywords Setup pop-up where any word can be set with fixed value, thus when typed in, the system recognizes and calculates a recommended score for the response (from the sum of the point value of the matching words), which is displayed on the OEQS page by highlighting the relevant words in the response text and also listing them with their values and the recommended score.
See How to Set Up Keyword Scoring.
IMPORTANT: Setting up keywords should be regarded as a guideline in scoring - it is recommended that the answers be double-checked and approved by the OEQS users.
If multiple spelling can be considered acceptable, or typos might be disregarded, alternative spelling can be listed within the same keyword field, separated by comma(s).
In such case, the system will calcuate the recommended score for either one of the listed words.
In such case, the system will calcuate the recommended score for either one of the listed words.
Questionnaire based scoring
Questionnaire based scoring entails evaluation completed by answering a set of questions. The questionnaire can be created on the Special Section part, which then can be selected via the drop-down menus displayed when the Questionnaire method is selected.
For further information, see the Reports - How to pages and the Reports Module Training Videos.
Overview
Content Tools