Versions Compared

Old Version 7

changes.mady.by.user Asfand Khan

Saved on

compared with

New Version 8

changes.mady.by.user Rob Wade

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.



When a consensus evaluation is used, the average score does not apply because the consensus evaluation overrides individual evaluations.
The scores given by the Consensus Evaluator will be used in VFM (Value for Money) algorithm to rank the each provider
Tip
Tip

It is good procurement practice for evaluation team members to score submissions without any influence from their peers and colleagues.  Conversely, it is also good practice to hear the views of people with different experiences and points of view.

The Consensus Evaluations feature allows:

  • Evaluators to score independently
  • The evaluation team to come together for final deliberations
  • An opportunity to correct ill-advised evaluation scores and comments with full transparency and accountability
  • An opportunity to incorporate the evaluations of people who, for whatever reason, were not able to fully complete the evaluation.

When consensus evaluations are used, only the scores and risk assessments of the Consensus Evaluator will be used in VFM (Value for Money) algorithm to rank the each submission.

Step-by-step guide

To assign a consensus evaluator:

  1. Sign-in to https://360users.apetsoftware.com.au/ as the Request Manager
  2. From the main menu, click Requests
  3. If using the new look:
    1. Either:
      1. If the request is not released, click Drafts
        1. Click Configure against the desired request
      2. If the request is open or closed, click either:
        1. Open / Pending / In Late Submission Period
        2. Closed / Awaiting Finalisation
          1. Click Manage against the desired request
          2. Click Staff & Contractors
  4. If using the old look:Select the desired request from the listNavigate to the desired request from the list and open it
  5. Click on the 
    Svg out inline
    borderfalse
    maxZoom10
    bottom100%
    panZoomfalse
    minZoom0.1
    right100%
    align0
    IEToolTipsfalse
    download/download/attachments/535036168/users.svg?version=1&modificationDate=1542536892832&cacheVersion=1&api=v2
    linkList[]
    zoomButtonsfalse
    top0%
    left0%
    startActivetrue
    exportPNGtrue
    width50px
    attachmentIDatt540377159
    md5Shorta0388
    useWheeltrue
    height
     icon to open the Staff & Contractors view
  6. Select the desired evaluator from from the Nominated Consensus Evaluator drop-down list (the consensus evaluator cannot also be part of the evaluation team)
  7. Switch Ready for consensus evaluation? to Yes when the evaluation team has done as much evaluating as possible
  8. Click Save
  9. Enter an Audit reason if required
  10. Click Update

At this point, you have successfully assigned a consensus evaluator to a requestthe evaluation team will no longer be able to evaluate and the rankings system will not include their scores or risk assessments.

To start an evaluation as a consensus evaluator:

...

  1. Sign-in to https://360users.apetsoftware.com.au/ as the Consensus Evaluator
  2. If using the new look:
    1. From the main-menu, click Requests
    2. Click Closed / Awaiting Finalisation
    3. Click Evaluate against the desired request
  3. If using the old look:
    1. From the main-menu, click Evaluation
    2. Select the desired request from the list
    Evaluate either by clicking
  4. Seed the consensus evaluation scores by clicking Adopt Others' Evaluations with options:
    1. Adopt Max Scores
    2. Adopt Min Scores
    3. Adopt Agreed Scores (recommended)
    4. Adopt Reasons (recommended)
  5. Evaluate by clicking either:
    1. One Provider at a Time - If evaluating multiple providers for one question at a time
      1. Select the desired provider
      2. Confirm 'I Have No Conflict of Interest' if required
    2. One Question at a Time - If evaluating multiple questions for one provider at a time
      1. Confirm 'I Have No Conflict of Interest' if required
      2. Select the desired section from the drop-down list
      3. Select the desired question from the drop-down list 
  6. Click on the 
    Svg out inline
    borderfalse
    maxZoom10
    bottom100%
    panZoomfalse
    minZoom0.1
    right100%
    align0
    IEToolTipsfalse
    download/download/attachments/581795969/users2.svg?version=1&modificationDate=1565936041132&cacheVersion=1&api=v2
    linkList[]
    zoomButtonsfalse
    top0%
    left0%
    startActivetrue
    exportPNGtrue
    width40px
    attachmentIDatt581795991
    md5Short216c5
    useWheeltrue
    height
     icon Either:
  7. Choose the average score
    8. Click CloseFor each question, evaluate the provider's response and provide:
  8. Score
    9. Comment icon see and adopt the evaluation team's:
    1. Average score
    2. Individual:
      1. Scores
      2. Reasons
      3. Tags

      4. Risk

      5. Click Next
  9. Once all the sections are evaluated, click Finish on the last section to complete the evaluation

...

      1. assessments

  2. Amend the evaluations as appropriate
  3. Continue until the Finish option is available


Info

Score and Risk are used in VFM (Value for Money) algorithm  algorithm to rank the each providersubmissions. To learn more about VFM algorithm, see: How does the VFM (value for money) algorithm work in 360?Note: Score drop-down may not be available for some questions. It is up-to the Request Manager to enable or disable the score option for each question for evaluators' to evaluate. For example: If there is a question where it is asked to the providers' to provide their ABN. It is silly to set the score option for this question so the Request Manager can disable the Score 

option when configuring this questionUnweighted questions do not allow a score.  Questions with a weighting of 0% require a score however they have no impact on the rankings.

...