Survey Reports

The RCPAQAP Microbiology report format follows a standard structure that is now adopted by other programs offered by the RCPAQAP. This single report replaces the previous generic and survey reports.

The structure of the new reports provides participants with a summary of performance, a review of individual performance, a method breakdown review with commentary and cumulative performance.

An example of the report issued for the Bacteriology – Urine program can be seen below, and all other Microbiology reports will follow the same structure:

1. Summary of Performance – the summary of performance provides a snapshot of participation and assessment in the program. It is split into two sections when antibiotic susceptibility is included in the program structure.

1. Summary of performance – tests marked for assessment
   Below is an explanation of what is populated in the table columns provided in the example above.
   1. Test: Is the test performed by the participant, that is assessed.
   2. Measurement system: Will list the measurement system submitted at result entry in the myQAP portal.
   3. Your result: Is the result submitted at result entry in the myQAP portal.
   4. Target: Is the expected result
   5. Assessment: Will provide the assessment of your results based on the target (expected result). If a test does not pass in-house homogeneity testing, the assessment grade of “Not assessed” will be assigned to all participants.
      Please note: The assessment of performance now uses terminology to grade performance, which replaces the scores that have been used in the past. The terms used to assess performance are
      Concordant: Matches the target or expected result
      Minor Discordant: A result that may have partial agreement with the expected or target result
      Discordant: Does not match the target response
      Not Assessed: The RCPAQAP in-house homogeneity or stability testing was unsuccessful; test not performed by the participant; the result is beyond the scope of acceptance for grading
      No Participation: The participant failed to take part in the assessment
2. Summary of performance – Antibiotic susceptibilities (if included in the program structure)
   
   The performance review for the antibiotic susceptibility testing has been split to review the performance based on the sample. Below is an explanation of what is populated in each column in the example provided.
   1. Antibiotic: The antibiotics that are listed in this table are those reported from you as well as antibiotics that have been pretested by our reference laboratory.
   2. Antibiotic standard: Will list the antibiotic susceptibility testing guidelines provided at result entry in the myQAP portal.
   3. Your Primary Test Result: Is the primary test result submitted at result entry in the myQAP portal.
   4. Your Reported Test Result: Is the reported test result submitted at result entry in the myQAP portal.
   5. Expected Reported Test Result: Is the expected reported result for the antibiotics listed. An expected result will only be displayed if the antibiotic was tested for by our reference laboratory.
   6. Assessment: Will provide the assessment of your results based on “your reported test result”.
      Please note: The assessment of performance now uses terminology to grade performance, which replaces the scores that have been used in the past. The terms used to assess performance are
      Concordant: Matches the target or expected result
      Minor Discordance: A result that may have partial agreement to the target result
      Discordant: Does not match the target response
      Not Assessed: Not assessed due to the unavailability of “an expected result”.

Discordant results will be highlighted in red and the antibiotic that is highlighted as discordant will be listed in the ‘Overall Performance’ summary at the bottom of the page.

2. Result Review
The review of the survey performance has been structured to facilitate the breakdown of results to be reviewed by the survey case. That is, all results for Sample A will be displayed, followed by results for Sample B.

Result review – Microscopy: Provides a breakdown of the responses received for the microscopy, bacterial count and species identification components of the survey. The histograms provide a review of the responses received for each test. The dark blue overlay represents the results returned by other participants using your method. The “blue” circle represents the result provided by your laboratory.

Result review – Bacterial Count & Growth / Media Selection: Provides a breakdown of the responses received for the bacterial count and growth. The histograms provide a review of the responses received for each test, with the same legends used for the bacterial count chart. The “Media Selection” histogram also provides a breakdown of the responses received. The bars in this histogram will be highlighted in blue if the media was chosen by your laboratory as result entry.

Result review – Species Identification: Provides a histogram illustrating the responses received from participants for species identification. The responses are ordered by the assessment grade provided.

Please note: The terms used to assess performance are
Concordant: Matches the target or expected result
Minor Discordance: A result that may have partial agreement to the target result
Discordant: Does not match the target response
Not Assessed: This assessment grade may be provided to participants unable to grow the pathogen; participants unable to identify (referred to an external laboratory); the result stated is beyond the scope of acceptance.

Antibiotic – susceptibility testing: The antibiotics listed in this histogram have been reported by 10 or more participants that have been assessed. The histogram displays the responses received by all laboratories that reported the antibiotic for testing. The dark blue overlay represents the results returned by other participants using the same antibiotic standard. The “blue” circle represents the result provided by your laboratory.

3. Cumulative Performance

Each survey report provides a snapshot of your performance for the microscopy, bacterial count and identification components of the program. The cumulative performance will provide participants with survey performance for the last six surveys.