method performance for measuring immunoreactive ... · method performance for measuring...

20
Joanne Mei, PhD Newborn Screening Quality Assurance Program Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots National Center for Environmental Health Division of Laboratory Sciences

Upload: others

Post on 20-May-2020

25 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

Joanne Mei, PhD

Newborn Screening Quality Assurance Program

Method Performance for Measuring Immunoreactive Trypsinogen (IRT)

in Dried Blood Spots

National Center for Environmental Health

Division of Laboratory Sciences

Page 2: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

NSQAP Prepares IRT QC and PT Materials

Whole blood is enriched with commercial IRT (human)

IRT reconstituted according to package insert

>95% cationic form of IRT (IRT1)

IRT is labile and susceptible to proteolysis

CDC assayed values used

Quality Control Materials

Certified values

QC used to track method performance over time

6 Month expiration

Proficiency Testing Materials: Blind-coded

IRT “within normal limits”

IRT “outside normal limits”

Cutoffs variable

http://www.cdc.gov/labstandards/nsqap.html

Page 3: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

QC Data sent to NSQAP

Dose-response QC DBS sent 2x per year

Four levels are made for IRT

Labs report data from 5 independent runs

• Two replicates per run

Data is compiled by method

Weighted linear regression examines the comparability by method

of reported versus enriched concentrations

Parameters summarized

• Mean, within-lab and total std, y-intercept, slope

Method biases reflected in slopes

• 1.0 = ideal slope

• Deviations from 1.0 indicate bias

Summary QC results published 2x per year http://www.cdc.gov/labstandards/pdf/nsqap/nsqap_qcmidyearreport_2010.pdf

http://www.cdc.gov/labstandards/pdf/nsqap/nsqap_summaryreport_2010.pdf

Page 4: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

IRT Immunoassays Reported to NSQAP

Time Resolved Fluorescence

Perkin Elmer assays – Delfia* and AutoDelfia*

• Lanthanide fluorescence – Europium-labeled antibodies

Enzyme Immunoassays

MP Biomedicals*

Bioclone

Bio-Rad Quantase

Other (less than 3 participants/method)

• Ani Labsystems

• CIS Bio International - RIA

• GSP - Perkin Elmer

• IBL International

• Immunotech Beckman Coulter

• Interscientific

• TecnoSuma Umelisa

*Available in the US

Page 5: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

Recovery of IRT in QC Materials 2010

0

20

40

60

80

100

120

140

160

180

200

0 20 40 60 80 100 120 140 160 180 200

Ob

serv

ed

IR

T n

g/m

L

Expected IRT ng/mL

MP Biomedicals Delfia AutoDelfia Bio-Rad Quantase Bioclone Other

Page 6: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

0

20

40

60

80

100

120

140

160

180

200

0 20 40 60 80 100 120 140 160 180 200

Ob

serv

ed

IR

T n

g/m

L

Expected IRT ng/mL

2008 2009 2010

Slope = 1.4

Slope = 0.6

Slope = 0.3

Recovery of IRT in QC Materials by MP Biomedicals 2008-2010

Page 7: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

Proficiency Testing Materials

Distributed 4 times per year (US and Canada)

Data reported within 4 weeks of distribution date

Analytical values, presumptive clinical assessments,

and cutoffs values reported

Page 8: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

Domestic IRT Cutoff Values: 2003-2010

Year N Mean

(ng/mL)

Median Mode Min/Max

2003 7 93.6 NA 90.0 66-114

2004 8 97.3 92.5 90.0 58-170

2005 9 95.3 105.0 105.0 63-170

2006 14 106.2 100.0 100.0 57-170

2007 30 89.0 80.0 62.0 62-170

2008 34 85.0 67.5 100.0 32-170

2009 42 79.9 65.0 62.0 39.6-170

2010 48 76.6 62.0 62.0 48.8-170

Page 9: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

0

5

10

15

20

25

30

35

Specimen 3884 Specimen 1982 Specimen 3982

IRT

ng

/mL

Reproducibility of IRT- Normal PT Specimen A – Commercial IRTDistributed in 2008 and 2009

CDC assayed value = 23.3

Delfia Auto Delfia Bio-Rad Quantase MP Biomedicals ELISA Bioclone ELISA

Page 10: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

0

25

50

75

100

125

150

175

200

225

250

Specimen 1084 Specimen 3084 Specimen 4081 Specimen 1183

IRT

ng

/mL

Reproducibility of IRT - Abnormal Specimen B - Commercial IRTDistributed in 2010 and 2011

CDC assayed value = 236.6

Delfia Auto Delfia Bio-Rad Quantase MP Biomedicals ELISA Bioclone ELISA

Page 11: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

0

20

40

60

80

100

120

140

160

Specimen 4085 Specimen 1184

IRT

ng

/mL

Reproducibility of IRT - Abnormal Specimen C - Native IRTDistributed in 2010 and 2011

CDC Assayed value = 113.5

Delfia Auto Delfia Bio-Rad Quantase MP Biomedicals ELISA Bioclone ELISA

Page 12: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

0

0.5

1

1.5

2

2.5

3

2003 2004 2005 2006 2007 2008 2009 2010

Mis

cla

ssif

ica

tio

n r

ate

(%

)

Year

False Negative False Positive

IRT Domestic Misclassification Rates: 2003-2010.

Page 13: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

IRT False Negative Results: Quarter 1, 2011a

Specimen

Number

Method N CDC Assayed

Value

Reason for False

Negative

1181 AutoDelfiab 2 164.8 Low quantitative value

MP Biomedicalsc 4 Low quantitative value

Bio-Rad Quantase 1 Low quantitative value

IBL International 1 Low quantitative value

1183 MP Biomedicalsc 2 236.6 Low quantitative value

1184d AutoDelfiab 5 113.5 Low quantitative value

Delfiab 5 Low quantitative value

Bio-Rad Quantase 3 Low quantitative value

Bioclone ELISA 1 Low quantitative value

ILMA Beckman

Coulter

1 Low quantitative value

aDomestic and Foreign combined; bUnusual number of FNs for the AutoDelfia and Delfia methods; cCurrent method cannot detect commercial IRT in CDC blood spots; dNative IRT specimen; N=25 FNs.

Page 14: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

Domestic Labs with IRT FN*Cutoffs were higher than Mean Cutoff

CDC Cutoff = 80 ng/mL

Domestic

Lab

IRT Cutoff

(ng/mL)

Mean

Domestic

Cutoff

Median Mode Min/Max

1 10076.6 62.0 62.0 48.8-170

2 100

3 140

4 100

5 114

6 90

7 90

8 100

9 89

*Quarter 1, 2011

Page 15: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

Specimen

Number

Method N CDC

Assayed

Value

Reason for False

Negative

3183 MP Biomedicalsb 3 143.5 Low quantitative value

Bio-Rad Quantase 1 Low quantitative value

3185 MP Biomedicalsb 2 206.1 Low quantitative value

CIS Bio

International RIA

1 Wrong Assessment Code

IRT False Negative Results: Quarter 3, 2011a

aDomestic and Foreign combinedbCurrent method cannot detect commercial IRT in CDC blood spots.

Page 16: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

Can Commercial IRT kits distinguish betweenIRT 1 and IRT2?

Objective: To ascertain if methods reported to the CDC’s Newborn

Screening Quality Assurance Program (NSQAP) can

detect the anionic and cationic forms of

Immunoreactive Trypsinogen, IRT1 and IRT2,

respectively, in dried blood spots prepared for

proficiency testing (PT).

Mei JV, et.al. Recovery of Anionic and Cationic Immunoreative Trypsinogen (IRT1 and IRT2) by Methods Reported to the Newborn Screening Quality Assurance Program. Proceedings of the 2010 Newborn Screening and Genetic testing Symposium. Orlando, FL. May 2010.

Page 17: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

0

50

100

150

200

250

300

350

400

450

500

4981 4982 4983 4984 4985

IRT

(n

g/m

L w

ho

le b

loo

d)

Specimen Number

Delfia Auto Delfia Bio-Rad Quantase MP Biomedicals ELISA Other

IRT2*

(600 ng/mL)IRT1** + IRT2*

(397.6 + 600 ng/mL)

No IRT Added IRT1**(27.4 ng/mL)

IRT1**(126.4 ng/mL)

Median Domestic IRT cutoff = 65 ng/mL

*IRT2 = Enrichment value

**IRT1 = CDC Assayed value

Mean recovery of IRT1 and IRT2 by method

Quarter 4, 2009 PT panel.

Page 18: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

Conclusions

IRT methods detect IRT1 (cationic form) only

IRT method performance can be variable; dependent

on epitope recognition of kit antibodies

External QC materials provide valuable data for dose-

response method performance

Proficiency testing highlights method and laboratory

differences in performance over time

Low IRT recovery and higher-than-average IRT cutoff

contributed to false-negative errors.

Page 19: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

Future IRT Material Preparation

Pilot IRT DBS with and without protease inhibitor sent

to several participants

Improved recovery seen for MP Biomedicals

BUT other methods called normal specimens abnormal

Continued research using protease inhibitors needed

No change in how current IRT QC DBS made

Protease inhibitor may be added to PT specimens

Page 20: Method Performance for Measuring Immunoreactive ... · Method Performance for Measuring Immunoreactive Trypsinogen (IRT) in Dried Blood Spots ... Reproducibility of IRT - Abnormal

For more information please contact Centers for Disease Control and Prevention

1600 Clifton Road NE, Atlanta, GA 30333

Telephone, 1-800-CDC-INFO (232-4636)/TTY: 1-888-232-6348

E-mail: [email protected] Web: www.cdc.gov

The findings and conclusions in this report are those of the authors and do not necessarily represent the official

position of the Centers for Disease Control and Prevention.

National Center for Environmental Health

Place Descriptor Here

AcknowledgementsDr. Carla Cuthbert, Chief, Newborn Screening and

Molecular Biology Branch

Dr. Harry Hannon, Emeritus Chief

Carol Bell

Sarah Brown

Dr. Marie Earley

Dr. LiXia Li

Nancy Meredith

Connie Singleton

Sherri Zobel