Default scoring templates for line items
Getting started
Puzzel QA offers four default scoring templates to help get you started. However, if they don't suit your needs, you can create your own customised templates in Quality settings
Here are the four default templates....
DEFAULT TEMPLATE 1: The 2-point scoring template
The 2-point (binary) scoring template is typically used to evaluate process adherence/risk line items (questions) and, as the name suggests, this template offers two outcomes.
- Before use, you can edit the Name of the template.
- You can also edit the default Outcome titles from "Pass" and "Fail" to words / phrases of your choice.
- You can even change the Colour assigned to each outcome by clicking the colour box to reveal a palette of colours to choose from
The Line Item Performance Report presents the performance breakdown of all the possible outcomes available on each line item. However, to enable line items with different scoring templates to be grouped together in the Category Performance Report, all outcomes also need to be classified (treated) as either a system "Pass" or a system "Fail".
Outcome Score: Each outcome can be assigned a score. The top score for a template must always be "1", and the bottom score "0". Obviously with only two outcomes available on this template, you don't have the option to edit the two scores.
To help explain Scores in this context - If you created a scorecard that only contained line items that could be marked using the 2-point scoring template and you then marked all line items as a "Pass", the Quality Score would be 100%. Conversely, if you marked all line items as a "Fail", the Quality Score would be 0%.
Once a scoring template is Active (i.e it is assigned to an Active scorecard) and/or is used as part of an evaluation, it becomes locked and can no longer be edited.
DEFAULT TEMPLATE 2: The Steps scoring template
The Step scoring template is typically used to evaluate more complex process adherence/risk questions and line items and allows you to evaluate and ultimately report the performance of the detailed steps which make up the line item.
- Add as many steps as you need by clicking Add step
- You will have already decided on whether the line item overall can be marked as Not applicable. However, as you add each step, you will need to decide whether or not the step can be marked as not applicable.
- If all steps can be marked as Not applicable, then the line item always defaults to allow Not applicable as an option.
During an evaluation, the score outcome for a step is either "Pass" or "Fail". Step scores are then converted into an overall line item score as follows:
- If all steps are marked as Not applicable, then the line item is determined to be Not applicable.
- If some steps are marked as "Pass" and some are marked as Not applicable, then the line item is determined to be a "Pass".
- As soon as just one step is marked as "Fail", then the line item is determined to be a "Fail".
The Steps scoring template is linked to the 2-point scoring template. If you deactivate the 2-point scoring template, this means that you'll also deactivate the Steps scoring template.
DEFAULT TEMPLATE 3: The 3-point scoring template
The 3-point scoring template includes three outcomes
- Before use, you can edit the Name of the template.
- You can change the default Outcome titles from "Complete", "Partially complete" and "Incomplete" to words or phrases of your choice.
- You can edit the Score of the middle outcome and decide whether the system will Treat as "Pass" or a "Fail"
- You can even change the colour assigned to each outcome by clicking the colour box to reveal a palette of colours to choose from.
The Line Item Performance Report presents the performance breakdown of all the possible outcomes available on each line item. However, to enable line items with different scoring templates to be grouped together in the Category Performance Report, all outcomes also need to be classified (treated) as either a system "Pass" or a system "Fail".
Outcome Score: Each outcome can be assigned a score. The top score for a template must always be "1", and the bottom score "0". Obviously with only three outcomes available on this template, you don't have the option to edit the top and bottom scores but you can edit the middle score.
To help explain Scores in this context - If you created a scorecard that only contained line items that could be marked using the 3-point scoring template as configured in the diagram above and you then marked all line items as "Complete", the Quality Score would be 100%. Conversely, if you marked all line items as "Incomplete", the Quality Score would be 0%. However, with a score of 0.5 assigned to the "Partially complete" outcome, if you marked all line items as "Partially complete", the Quality Score would be 50%.
Once a scoring template is Active (i.e it is assigned to an Active scorecard) and/or is used as part of an evaluation, it becomes locked and can no longer be edited.
DEFAULT TEMPLATE 4: The 4-point scoring template
The 4-point scoring template includes four outcomes
- Before use, you can edit the Name of the template.
- You can change the default Outcome titles from "Exceeds", "Meets", "Coach" and "Underperform" to words and phrases of your choice.
- You can edit the Score of the two middle outcomes and decide whether the system will treat each one as a "Pass" or a "Fail".
- You can even change the colour assigned to each outcome by clicking the colour box to reveal a palette of colours to choose from.
The Line Item Performance Report presents the performance breakdown of all the possible outcomes available on each line item. However, to enable line items with different scoring templates to be grouped together in the Category Performance Report, all outcomes also need to be classified (treated) as either a system "Pass" or a system "Fail".
Outcome Score: Each outcome can be assigned a score. The top score for a template must always be "1", and the bottom score "0". With four outcomes available on this template, you don't have the option to edit the top and bottom scores but you can edit the two middle scores.
To help explain Scores in this context - If you created a scorecard that only contained line items that could be marked using the 4-point scoring template as configured in the diagram above and you then marked all line items as "Exceeds", the Quality Score would be 100%. Conversely, if you marked all line items as "Underperform", the Quality Score would be 0%. However, with a score of 1 also assigned to the "Meets" outcome, if you marked all line items as "Meets", the Quality Score would also be 100%. In the same way, with a score of 0 also assigned to the "Coach" outcome, if you marked all line items as "Coach", the Quality Score would be 0%. If you wanted to different performance, you could assign a score of 0.75 to Meets and a score of 0.5 to Coach for example.
Once a scoring template is Active (i.e it is assigned to an Active scorecard) and/or is used as part of an evaluation, it becomes locked and can no longer be edited.