Below is important information you need to know on scoring your Quality Questions, which takes place between 6 - 30 May.

You should have recently received your 'Evaluator Passport' which details the Quality Questions and if also scoring, the Supplier Demonstrations you've been allocated. Following that, there will be both Quality Question and Supplier Demonstration Moderation sessions. 

If you have any questions related to the scoring of your Supplier responses to Quality Questions, please reach out to colleagues within the EPR team who will be able to support you:

Important information to consider when scoring:

  1. Ensure your feedback is clear: In some instances, it is not clear WHY a particular score has been given. Please ensure you articulate why you have given a particular score. You may wish to borrow elements of text from the scoring matrix.
  2. Clarity on different scores: If you are giving different suppliers different scores, it should be very obvious from your comments WHY the scores are different. However, please remember you should not compare bids.
  3. Consider the detail: You do not need to list every requirement in your comments. It is not wrong to do so, but you are free to group them together, again, so long as it is clear WHY you have done this.
  4. Don’t make it too high level: Ensure your comments are not high level - detail is required to justify WHY you have given a score.

On Tuesday 6 May, you will receive an email notification to say you’ve been added to a Quality Question folder. These folders are located within the Evaluator Sharepoint.

This folder will contain all the information you need to score the Supplier response to the Quality Question(s) you’ve been allocated.

If you have been allocated more than one Quality Question to score, you will receive separate email notifications for these folders.

 

Why is there a folder with my name on it?

As an Evaluator, it is important that you score the Supplier responses to the Quality Questions, without influence from other Evaluators scoring the same question.

Your named folder will be private to you as an Evaluator and will contain your Scorecard (in the format of an Excel document).

From Tuesday 6 May, you will be able to begin scoring the Supplier responses to the Quality Questions. It's important to note:

  • Scoring can be done in your own time
  • You must not collaborate with other Evaluators, even if they are scoring the same responses to Quality Questions
  • You must score alone and somewhere private
  • The deadline for scoring to be completed is 30 May at 12 noon.
  • After this time, all folders will be locked, and you will not be able to access them.

We advise you to start scoring as early as possible from 6 May. 

 

Supporting you to score well 

The EPR Team will check your responses for completeness, making sure you have provided a clear justification for the score you have given and that you have scored all three suppliers.

We will be monitoring the responses throughout the period. If there are any issues, a member of the EPR Team will reach out to you to amend.

You may also receive a reminder from the EPR Team to encourage you to start scoring, if you’ve already completed your scoring this email will not apply to you, and you can please ignore.

To help you score the supplier responses, within your Quality Question folder, you will have the following supporting information:

  1. Extract of the OBS (Output Based Specification): This details the functional and non-functional requirements we are asking Suppliers to detail in their responses to Quality Questions
  2. Scoring Criteria: You can refer to this to support with allocating the most appropriate score to the responses from Suppliers
  3. Supplier Responses x 3: This will include the Quality Question and the three Supplier responses to those Quality Question(s)
  4. Scoring Complete Form: Complete this form once you have finished scoring the responses for all suppliers.

Within your named folder there will be your Scorecard, in the format of an Excel document:

  • The Scorecard will contain the Quality Question and reminder of the scoring criteria to apply
  • There are 3 tabs on the score card, 1 for each supplier. 
  • You must complete each tab for each supplier to successfully score the Quality Question
  • Do not save or share your scorecard with any other Evaluator or anyone else
  • Simply, add your score and score justification for each supplier
  • Once complete, you can leave your scorecard in your folder.

Once you have completed your Scorecard, please complete the Scoring Complete Form, which opens as a Microsoft Form.

This form confirms that you have finished your scoring as an Evaluator for the Quality Question and the EPR Team will then review your response for completeness and alert you to any issues.

Please complete all the details and ensure you have selected the right Quality Question from the drop-down list you have scored. 

If you are scoring multiple Quality Questions, there will be a separate Scoring Complete Form for you to complete for each one.