Data Analysis & Assessment Criteria
RCPAQAP myQAP login

Molecular Genetics/Haematology 

Introduction

The Molecular Genetics discipline supplies a variety of report styes that provide a direct comparison of individual participant results with all results received. Participants’ results are compared to a calculated median from all method classifications for a particular test and within the main variable of the method system for the measurand. Survey reports are issued after the scheduled closing date.

All Molecular Genetics reports are structured to provide:

  • Summary and overall participant performance
  • Result review
  • Method comparison (if applicable)
  • Commentary
  • Cumulative summary of the last three year’s performance.

Assessment of results

The RCPAQAP Molecular Genetics programs are designed to assess laboratory’s performance in the detection of genetic abnormalities across a variety of disorders. Overall participant performance is based on consensus results returned for qualitative measurands. Quantitative results are illustrated in scatterplots including the median value and an indicator of the upper and lower (+/- 3 standard deviations) range.

Analysis of Qualitative results

The expected results for all qualitative survey results (i.e. detection, genotype and clinical interpretation) are determined from reference testing and/or consensus of all results, regardless of method used.

Reference testing result:

  • Validation of a genotype is performed by a NATA-accredited reference testing laboratory.
  • This applies to the Sanger DNA Sequencing module, where PCR products are generated by member(s) of the Molecular Genetics advisory committee.

Survey result consensus:

  • If a test achieves 80% consensus/agreement from 6 or more results, this is then listed as the expected value. Participants who return the expected result are assessed as “Concordant”.  Minor discordance will also be provided as an assessment grade, implying that a result is not considered a critical error (acceptable) but warrants a review to ensure accuracy.  These values are included to achieve 80% consensus.
  • If a test achieves 80% consensus from 6 or more results, participants in the minority group are assessed as inconsistent from the consensus and their results are graded as “Discordant”.
  • When <80% or < 6 labs agree, results will be reviewed by the appropriate advisory committee for consideration to void assessment (graded as “Not Assessed”) or deem the sample for educational purposes only with an assessment against a target value. Review outcomes will be recorded in the Survey Report.

Genotyping

Genotyping results are assessed against an expected value determined by the reference testing laboratory, or survey result consensus. The assessment of genotyping results takes into consideration the clinical context, nature of an error and clinical relevance of an error (i.e. diagnosis, treatment, counselling).

Listed below are the general considerations for the assessment of genotyping results.

Considerations for a “Concordant” genotype:

  • Correct variant
  • Incorrect amino acid change when only protein variant is reported

Considerations for a “Minor discordance” genotype:

  • Genotype mis-positioned
  • No or incorrect zygosity (only applies in cases where zygosity status has implications on clinical interpretation e.g. diagnosis, reproductive planning)

 Considerations for a “Discordant” genotype:

  • Incorrect variant
  • False negative/positive result where an expected variant is covered by scope of assay performed (also applies if scope of assay not stated)
  • Variant not reported due to assay limitations i.e. not included in laboratory’s standard testing panel, or below limit of detection. Depending on the clinical relevance of the variant, the advisory committee will recommend if a missed variant should be graded as “Discordant”, “Minor discordance” or “Not assessed”.

A discordant genotype highlights the need for further investigation into the accuracy of genotyping processes e.g. sample handling, assay performance, and data analysis.

Clinical Interpretation

Clinical interpretation of genotyping results is assessed against survey result consensus. Listed below are the general considerations for the assessment of clinical interpretation.

Considerations for a “Concordant” interpretation:

  • Correctly interprets genetic variant in the context of clinical history provided
    • Correct diagnosis provided for the expected genotype
    • Correct recommendation of treatment option

Considerations for a “Minor discordance” interpretation:

  • Misdiagnosis that does not have adverse effects on patient care or outcomes

Considerations for a “Discordant” interpretation:

  • Discordant genotype
  • Incorrectly interprets genetic variant in the context of clinical history provided i.e. misdiagnosis or incorrect treatment options

Analysis of Quantitative Results

Quantitative analysis is performed on all tests where a numerical result is provided. Results are illustrated in a scatterplot for all methods. The scatterplot illustrates the median value and an indicator of the upper and lower (+/- 3SD) range. Assessment of quantitative measurands is based on an APS score or z-score. Refer to Analytic Performance Specification – Quantitative Analysis.

Refer to the table below for the assessment categories of each module.

Module

Target

Qualitative

Quantitative

Genotyping

Interpretation

Technical

Coeliac Disease HLA Genotyping HLA-DQA1, HLA-DQB1
Human Leukocyte Antigen B*57 HLA-B57:01
Molecular Testing in Glioma IDH1, IDH2, MGMT
Mutation Detection in Colorectal Cancer KRAS, NRAS, BRAF
Mutation Detection in Lung Cancer EGFR, KRAS G12C
Mutation Detection in Melanoma BRAF, NRAS
Maternal Cell Contamination Maternal Cell Contamination
Non-Small Cell Lung Carcinoma Panel Testing EGFR, KRAS, BRAF, MET, ATK, ROS1, RET, NTRK1, NTRK2, NTRK3        
Quality Assessment of DNA Extracts Assessment of DNA integrity and purity
Quality Assessment of FFPE Extracts Assessment of DNA integrity and purity
Sanger DNA Sequencing Assessment of raw sequencing data and genotyping
PTEN PTEN
Kennedy’s Disease Androgen receptor; CAG trinucleotide repeat expansion
Myeloid Leukaemia NGS Panel Testing Myeloid associated variants by next generation sequencing
BCR-ABL Qualitative Testing p190, p210, e1a2, e1a3, e13a2, e13a3, e14a2, e14a3
Chimerism Analysis Chimerism analysis of donor and recipient DNA
FLT3 ITD & TKD Internal tandem duplication, tyrosine kinase domain variants
Hereditary Haemochromatosis C282Y, H63D
IDH Mutation Analysis in AML IDH1, IDH2
Immunogenotyping Gene rearrangement, IgH, TCR
Lymphoid NGS Panel Testing Lymphoid associated variants by next generation sequencing
Myeloproliferative Neoplasms JAK2 V617F, CALR exon 9, MPL codon 515 (JAK2)
NPM1 NPM1
PML RARA Gene rearrangement, bcr1, bcr2, bcr3
Thalassaemia HBA, HBB
Thrombosis Prothrombin, factor V leiden
TP53 Deletions at 17p13.1 in CLL 17p deletion by FISH

Molecular Genetics – Qualitative

Report ExampleRCPAQAP Human Leukocyte Antigen B*57

1. Summary of Performance

Method system used by your laboratory

  • Category: The method category specific to the measurand
  • Method: The method supplied by the participant associated with the method category

Performance Assessment

  • Test: All measurands that are performed by the participant.
  • Your result: The result submitted by the participant.
  • Expected Result: The target result for the measurand.
  • Review: Results flagged for review are highlighted in red if Discordant.
  • nParts: Number of participants that returned a survey result for the test.

Overall Performance

Provides a snapshot of the overall performance. Results that do meet the expected criteria are listed for review.

2. Result Review

A
Target

Provides the expected or target results for each test/measurand.

B
Histogram – Result review

Provides a display of the results returned for the survey sample. Results in dark blue represent the result returned by your peer group (participants using the same method). Your result is represented as a light blue dot.

C
Method Comparison

Each report will provide a method comparison table to review the performance across all methods.

A
Target

Provides the expected or target results for each test/measurand.

B
Histogram – Result review

Provides a display of the results returned for the survey sample. Results in dark blue represent the result returned by your peer group (participants using the same method). Your result is represented as a light blue dot.

C
Method Comparison

Each report will provide a method comparison table to review the performance across all methods.

3. Cumulative assessment

Provides a snapshot of participant’s performance over the previous surveys, displaying the results returned, the expected result and assessment provided.

Molecular Genetics – Quantitative

Report ExampleMaternal Cell Contamination

1. Summary of Performance

Method system used by your laboratory

  • Category: The method category specific to the measurand
  • Method: The method supplied by the participant associated with the method category.

Performance Assessment

  • Test: All measurands that are performed by the participant
  • Consensus Result: List the expected result based on 80% consensus of all returned results. The “Level of MCC (%)” consensus is based on the median of all results returned
  • Your result: The result submitted by the participant
  • Assessment: Qualitative results flagged for review and are highlighted in red if Discordant. Quantitative results are highlighted in red if marked as ‘low’ or ‘high’
  • nParts: Number of participants that returned a survey result for the test
  • Z-score: Provides the number of standard deviations away from the mean result
  • APS: Provides the analytical performance specification (APS) score based on the median and APS of the median (Lab score – target / APS limit of median). Refer to Analytic Performance Specification – Quantitative Analysis.

Overall Performance

  • Provides a snapshot of the overall performance. Results that do meet the expected criteria are listed for review

2. Result Review

A
Sample ID / Test:

Provides the Sample ID and the test in review.

B
Target

Provides the expected or target results for each test and the associated measurand.

C
Histogram – Result review

Provides a display of the results returned for the survey sample. Results in dark blue represent the result returned by your peer group (participants using the same method). Your result is represented as a light blue dot.

D
Scatterplot – Result review

Provides a display of the associated numerical results, which includes the median target, the acceptable range, results from your method (highlighted in dark blue) and your results represented as a light blue dot.

E
Method Comparison

Each report will provide a method comparison table to review the performance across all methods.

A
Sample ID / Test:

Provides the Sample ID and the test in review.

B
Target

Provides the expected or target results for each test and the associated measurand.

C
Histogram – Result review

Provides a display of the results returned for the survey sample. Results in dark blue represent the result returned by your peer group (participants using the same method). Your result is represented as a light blue dot.

D
Scatterplot – Result review

Provides a display of the associated numerical results, which includes the median target, the acceptable range, results from your method (highlighted in dark blue) and your results represented as a light blue dot.

E
Method Comparison

Each report will provide a method comparison table to review the performance across all methods.

3. Cumulative assessment

Provides a snapshot of participant’s performance over the previous surveys, displaying the results returned, the expected result and assessment provided.

 

Molecular Haematology – Qualitative

Report ExampleThrombosis

1. Summary of Performance

Method system used by your laboratory

  • Category: The method category specific to the measurand
  • Method: The method supplied by the participant associated with the method category

Performance Assessment

  • Test: All measurands that are performed by the participant.
  • Your result: The result submitted by the participant.
  • Assessment: Results flagged for review are not in consensus. Results flagged for review are highlighted in red if Discordant.
  • Consensus Result: The consensus result for the measurand.
  • nParts: Number of participants that returned a survey result for the test.

Overall Performance

  • Provides a snapshot of the overall performance. Results that do meet the expected criteria are listed for review.

2. Result Review

A
Target

Provides the expected or target results for each test/measurand.

B
Histogram – Result review

Provides a display of the results returned for the survey sample. Results in dark blue represent the result returned by your peer group (participants using the same method). Your result is represented as a light blue dot.

C
Method Comparison

Each report will provide a method comparison table to review the performance across all methods.

A
Target

Provides the expected or target results for each test/measurand.

B
Histogram – Result review

Provides a display of the results returned for the survey sample. Results in dark blue represent the result returned by your peer group (participants using the same method). Your result is represented as a light blue dot.

C
Method Comparison

Each report will provide a method comparison table to review the performance across all methods.

3. Cumulative assessment

Provides a snapshot of participant’s performance over the previous surveys, displaying the results returned, the expected result and assessment provided.

 

Last updated on August 26, 2024
Back to top
en_AUEnglish
It appears you're using an old version of Internet Explorer for safer and optimum browsing experience please upgrade your browser.