Data Analysis & Assessment Criteria
RCPAQAP myQAP login

Key Incident Monitoring and Management System 

Introduction

The Key Incident Monitoring and Management Systems (KIMMS) aims to monitor the pre- and post-analytical phase of the laboratory quality system and is designed to provide pathology practices with the tools for continuous measurement and monitoring of key incident quality indicators.

Data for the survey is entered into the result entry tab in the myQAP portal. A list of all incidents captured and measured by the KIMMS program can be found here. Instructions to input the incidents recorded by participants will be provided when the survey opens.

KIMMS Report

Analysis of Results

Participants are asked to capture the number of episodes and the number incidents per quarter of the year.

An episode is usually covered by a single request and may consist of one or more samples. It may include more than one request, but the samples are collected at the same time: i.e. samples received together in a bag with a request form equals one episode.

All incidents recorded should be counted, whether they lead to rejection or not.

Each specific incident reported to KIMMS is calculated per 100,000 episodes (number of incidents divided by the number of episodes, multiplied by 100,000), known as the rate. Incidents recorded from “test requests”, “collection” and “transport and storage” are separated into the number of episodes recorded from inpatient, outpatient, community, emergency department and mixed options.

Incidents recorded from “test registration”, “analytical” and “post analytical” are calculated against total number of episodes.

Incident rates are compared to peer groups, and flagged red if outside the best performers, which is set at 80% of all results.

An example of the analyses is provided below.

Survey:1 KM-23-01

Inpatient Episodes:2 536502

Outpatient Episodes:2 101011

Community Episodes:2 150

Emergency Department:2 102052

ALL EPISODES:3 739715

Unlabelled specimen or request10 130 24.2 28.0
Insufficient patient ID specimen or request10 230

43.08

40.0
ID mismatch between specimen and request10 287 53.0 60.0
Specimen from wrong patient10 3 0.6 0.8
Inpatient4 – Collection Identification Incident5 Results6 Rate7 80% cut-off9

 

Cumulative results

Results are plotted cumulatively on a continuous line graph. A graph for each option and incident type is presented in reports, showing rates for the last six surveys.

Overall Performance Summary

The overall performance summary highlights any “incident” that recorded a rate greater than 80% of all participants. This is presented in a table, which includes columns for the Consequence, Probability and Detectability rating (tables 1-3). The KIMMS Advisory Committee has pre-determined the consequence rating so this field is pre-populated.

 

Parameter out of allowable limits

 

 

Consequence rating

 

 

Probability Rating

 

 

Detectability rating

 

 

Risk Score

 

 

Organisational response

 

Inpatient – haemolysis rate = 400

2

5

1

10

Example: Although this is a low risk incident, high compared to peers and to our collectors (0.2). Meeting with hospital organised 7/10/22

The light blue text highlights the results participants needs to complete.

All reports are available in myQAP on the Reports tab and a guide to interpret the report will be available on the RCPAQAP website.

Result review

It is recommended that participants review their results by applying the probability and detectability rating to determine the risk score (Tables 1-3). The risk score is calculated by multiplying the three ratings (consequence rating x probability rating x detectability rating). : The risk score can be used as a guide to organisational risk, and from that, a decision is made as to the next step(s).

In the above example, the consequence, probability and detectability rating give a risk score of 10. This would be considered low risk. Apart from flagging that the risk is higher than other participant inpatient collections, it is unlikely that any further immediate action is required. This incident should be monitored closely to ensure it does not deteriorate.

Risk Score

The score is calculated by multiplying the consequences (Table 1) x probability (Table 2) x detectability (Table 3)

Table 1: Consequence scale

 

Scale

 

 

Name

 

 

Definition

 

1 Negligible/Minimal Minimal, delay, inconvenience
2 Marginal/Minor Recollect required
3 Significant/Moderate Delayed management (non-malignant) and/or medical treatment
4 Serious/Major Delayed diagnosis (malignant) and/or surgical treatment
5 Critical/Catastrophic Serious harm to multiple patients and/or patient death

 

Table 2: Probability scale

 

Scale

 

 

Name

 

 

Example Definition

 

1 Rare <1/year
2 Unlikely 1 per year
3 Occasional 1 per month
4 Likely 1 per week
5 Frequent 1 per day or more

 

Table 3: Detectability scale

 

Scale

 

 

Name

 

 

Definition

 

1 Detected >95%
2 Most detected 75-95%
3 Half detected 25-75%
4 Most not detected <5-25%
5 NOT detected <5%

 

References
  1. Survey number: Year and survey number.

  2. Option episodes: Episodes that were received from a specified location.

  3. All episodes: Total number episodes from all location options.

  4. Option.

  5. Category: Incident categories comprise test request, collection, transport and storage, test registration, analytical and post analytical.

  6. Raw result: As reported to KIMMS by the participant.

  7. Rate: Incidents per hundred thousand episodes “Calculation = result / episodes) x 100,000”. From the example above “rate for unlabelled specimen or request” = 130 / 536502 x 100,000.

  8. Result assessment: If the incident rate is higher than 80% of the best performing participants, the incident is flagged as requiring review. These incidents will be listed in the report summary of the report.

  9. 80% cut-off. Results will be calculated from all results received.

  10. Specific incident.

Last updated on August 19, 2024
Back to top
en_AUEnglish
It appears you're using an old version of Internet Explorer for safer and optimum browsing experience please upgrade your browser.