development and validation of a gene ... and validation of a gene expression signature to...

1
DEVELOPMENT AND VALIDATION OF A GENE EXPRESSION SIGNATURE TO DISTINGUISH MALIGNANT MELANOMA FROM BENIGN NEVI Colleen Rock 1 , Loren E Clarke 1 , M. Bryan Warf 1 , Darl D Flake II 2 , Anne-Renee Hartman 1 , Steven Tahan 3 , Christopher R. Shea 4 , Pedram Gerami 5 , Jane Messina 6 , Richard J. Wenstrup 1 , Kristen Rushton 1 , Kirstin M. Roundy 1 , Benjamin Roa 1 , Kathryn A. Kolquist 1 , Alexander Gutin 1 , Steven D. Billings 7 , Sancy Ann Leachman 8 . 1 Myriad Genetic Laboratories, Inc., Salt Lake City, UT; 2 Myriad Genetics, Inc., Salt Lake City, UT; 3 Beth Israel Deaconess Medical Center, Boston, MA; 4 The University of Chicago, Chicago, IL; 5 Northwestern University, Chicago, IL; 6 Moffitt Cancer Center, Tampa, FL; 7 Cleveland Clinic, Cleveland, OH; 8 Oregon Health & Science University, Portland, OR. BACKGROUND • Melanoma is among the most malignant of human cancers; however, many are curable if detected early. - 10 year survival for Stage I patients: 86-95% - 10 year survival for Stage IV patients: 10-15% • Currently, histopathologic evaluation is considered the ‘gold standard’ for the diagnosis of melanocytic lesions. But many studies demonstrate difficulties in determining a diagnosis when histopathology is used alone. - Numerous studies have demonstrated considerable inter-observer variability in diagnosis, even among experienced dermatopathologists. - Additionally, histopathologic criteria used in routine dermatopathology may not work in differentiating ambiguous lesions as benign or malignant. • Measurement of biomarker gene expression has been proposed as an adjunctive diagnostic method in the evaluation of ambiguous melanocytic lesions with uncertain malignant potential. RESULTS • Expression of Gene Component #1 was the most effective differentiating feature in the forward selection model. (P-value = 1.2x10 -68 ). • The model was improved by adding Gene Component #2 (P-value = 3.9x10 -12 ) and the average expression from the Gene Component #3 gene group (P-value = 7.2x10 -5 ) (Figure 2A). • The three components in this model had distinct expression profiles that were not highly correlated with each other (Figure 2B). • Incorporating additional gene groups or other individual genes to the model did not increase the diagnostic power. • The final gene signature consists of 23 genes (Figure 3). - Component #1 regulates melanocyte differentiation - Component #2 is a group of 5 genes that have multiple functions including some immune regulation - Component #3 represents 8 genes involved in immune signaling - 9 housekeeper genes are necessary for normalization of gene expression • Performance of the gene signature was clinically validated in a cohort of 437 lesions (Figure 1). • The final MDS distribution ranged from -16.7 to +11.1 (Figure 4). - Scores from -16.7 to -0.1 are reported as benign. - Scores from 0 to +11.1 are reported as malignant. • Using a predefined threshold of zero and a bimodal score distribution, the MDS discriminated melanoma from nevi with 90% sensitivity and 91% specificity (P-value=3.7 x 10 -63 ; AUC = 96%) (Figure 5). CONCLUSIONS • A 23 gene signature has been clinically validated to differentiate melanoma and nevi with a sensitivity of 90% and a specificity of 91%. • Expression of genes regulating melanocyte differentiation and immune responses appear to represent critical differences between benign and malignant melanocytic lesions. • The gene signature provides diagnostic information independent of histopathology and has been shown to modify physician behavior in approximately a third of cases. - A 33.2% change in management recommendations was observed in a retrospective case review study. (Rock et al; USCAP Annual Meeting 2014). - Preliminary results of an ongoing prospective study appear to confirm these results, with a 35.1% change in management recommendations observed to date. • In order to provide a better interpretation of the diagnostic score, an indeterminate zone could be introduced. • The performance, objectivity, reliability, and minimal tissue requirements of this diagnostic test make it well-suited for clinical use as an adjunct to histopathology. METHODS Sample Cohorts • All testing was performed on archival formalin-fixed paraffin-embedded (FFPE) tissue sections of melanocytic lesions. • Specimens were selected by experienced dermatopathologists and included a spectrum of clinical and histopathologic subtypes (Table 1). • Each case underwent review by a second expert dermatopathologist who was blinded to the diagnosis of the contributing dermatopathologist. If there was discordance, the case was adjudicated by a third expert dermatopathologist. Quantification of Gene Expression • H&E stained slides were reviewed by an anatomic pathologist and the representative area of each lesion was identified, circled and macro-dissected. • Total RNA was extracted from the tissue and gene expression was assessed by quantitative reverse-transcription polymerase chain reaction (qRT-PCR). • Expression levels for each gene were calculated using the ∆∆CT method. Gene Signature Discovery & Verification • Published literature was reviewed to identify candidate genes with differential expression in melanoma or other cancers. • The panel of candidate genes was refined based upon 1) ability of each gene to differentiate (AUC>70%) benign from malignant lesions and 2) technical reliability. • Expression levels were subjected to forward selection in a series of logistic regression models to identify the subset of genes which most effectively discriminate benign from malignant lesions. • A refined logistic regression model was used to generate a single numeric score capable of differentiating benign nevi from malignant melanoma. Validation of the Melanoma Diagnostic Score (MDS) • The association between the score and pathologic diagnosis was assessed to calculate sensitivity and specificity of the MDS in a second, independent cohort of melanocytic lesions. OBJECTIVE Develop and validate a gene signature capable of differentiating malignant melanoma and benign nevi. Melanomas Discovery Verification Validation Overall Superficial Spreading 15 167 105 287 Nodular 7 23 38 68 Acral 3 20 9 32 LM/LMM* 4 39 31 74 Other 3 5 28 36 Overall 32 254 211 497 Nevi** Discovery Verification Validation Overall Compound 15 68 101 184 Junctional 9 38 20 67 Intradermal 12 28 41 81 Spitz 3 34 7 44 Blue 3 38 22 63 Other 9 4 35 48 Overall 51 210 226 487 Table 1. Melanocytic Lesions by Subtype Figure 1. Analysis of Candidate Genes by qRT-PCR Figure 2. Distribution of the gene expression for the three best performing components. Figure 4. Distribution of diagnostic scores in the clinical validation cohort. Figure 5. ROC curve of diagnostic scores in the clinical validation cohort. * Lentigo Maligna / Lentigo Maligna Melanoma ** Includes a total of 209 dysplastic nevi 83 Melanocytic Lesions 31 melanomas / 52 nevi DISCOVERY VERIFICATION VALIDATION 464 Melanocytic Lesions 254 melanomas /210 nevi 437 Melanocytic Lesions 211 melanomas / 226 nevi qRT-PCR for 79 genes qRT-PCR for 40 genes qRT-PCR for 23 genes (AUC > 70) 40 Genes Forward Selection 14 genes Melanoma Diagnostic Score Figure 3. Final Gene Expression Signature. 1 Gene Differentiation Regulator 9 Genes ‘Housekeepers’ 5 Genes Multifunctional and Immune Signaling 8 Genes Immune Signaling Melanoma Diagnostic Score RESULTS • 79 candidate genes were initially identified and evaluated for differential expression in melanoma and nevus samples using 83 melanocytic lesions. - Included were genes with known immune functions, cell cycle progression genes, cellular differentiation, Notch signaling, migration, fat metabolism or the cytoskeleton. • Forty genes were chosen for further assessment in a larger study of 464 melanocytic lesions. • Genes from similar biological pathways that exhibited correlated expression were consolidated by averaging. Presented at ASCO - June 2, 2014

Upload: ngotuong

Post on 04-Aug-2019

222 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DEVELOPMENT AND VALIDATION OF A GENE ... AND VALIDATION OF A GENE EXPRESSION SIGNATURE TO DISTINGUISH MALIGNANT MELANOMA FROM BENIGN NEVI Colleen Rock 1, Loren E Clarke 1, M. Bryan

DEVELOPMENT AND VALIDATION OF A GENE EXPRESSION SIGNATURE TO DISTINGUISH MALIGNANT MELANOMA FROM BENIGN NEVI

Colleen Rock1, Loren E Clarke1, M. Bryan Warf1, Darl D Flake II2, Anne-Renee Hartman1, Steven Tahan3, Christopher R. Shea4, Pedram Gerami5, Jane Messina6, Richard J. Wenstrup1, Kristen Rushton1, Kirstin M. Roundy1, Benjamin Roa1, Kathryn A. Kolquist1, Alexander Gutin1, Steven D. Billings7, Sancy Ann Leachman8.1Myriad Genetic Laboratories, Inc., Salt Lake City, UT; 2Myriad Genetics, Inc., Salt Lake City, UT; 3Beth Israel Deaconess Medical Center, Boston, MA; 4The University of Chicago, Chicago, IL; 5Northwestern University, Chicago, IL; 6Moffitt Cancer Center, Tampa, FL; 7Cleveland Clinic, Cleveland, OH; 8Oregon Health & Science University, Portland, OR.

BACKGROUND• Melanoma is among the most malignant of human cancers; however, many are curable if detected early.

- 10 year survival for Stage I patients: 86-95% - 10 year survival for Stage IV patients: 10-15%

• Currently, histopathologic evaluation is considered the ‘gold standard’ for the diagnosis of melanocytic lesions. But many studies demonstrate difficulties in determining a diagnosis when histopathology is used alone. - Numerous studies have demonstrated considerable inter-observer variability in diagnosis, even among experienced dermatopathologists. - Additionally, histopathologic criteria used in routine dermatopathology may not work in differentiating ambiguous lesions as benign or malignant.

• Measurement of biomarker gene expression has been proposed as an adjunctive diagnostic method in the evaluation of ambiguous melanocytic lesions with uncertain malignant potential.

RESULTS• Expression of Gene Component #1 was the most effective differentiating feature in the forward selection model.

(P-value = 1.2x10-68). • The model was improved by adding Gene Component #2 (P-value = 3.9x10-12) and the average expression from the

Gene Component #3 gene group (P-value = 7.2x10-5) (Figure 2A). • The three components in this model had distinct expression profiles that were not highly correlated with each

other (Figure 2B). • Incorporating additional gene groups or other individual genes to the model did not increase the

diagnostic power.

• The final gene signature consists of 23 genes (Figure 3). - Component #1 regulates melanocyte differentiation - Component #2 is a group of 5 genes that have multiple functions including some immune regulation - Component #3 represents 8 genes involved in immune signaling - 9 housekeeper genes are necessary for normalization of gene expression

• Performance of the gene signature was clinically validated in a cohort of 437 lesions (Figure 1).• The final MDS distribution ranged from -16.7 to +11.1 (Figure 4). - Scores from -16.7 to -0.1 are reported as benign. - Scores from 0 to +11.1 are reported as malignant.

• Using a predefined threshold of zero and a bimodal score distribution, the MDS discriminated melanoma from nevi with 90% sensitivity and 91% specificity (P-value=3.7 x 10-63; AUC = 96%) (Figure 5).

CONCLUSIONS• A 23 gene signature has been clinically validated to differentiate melanoma and nevi with a sensitivity of 90% and

a specificity of 91%.• Expression of genes regulating melanocyte differentiation and immune responses appear to represent critical

differences between benign and malignant melanocytic lesions. • The gene signature provides diagnostic information independent of histopathology and has been shown to modify physician behavior in approximately a third of cases. - A 33.2% change in management recommendations was observed in a retrospective case review study. (Rock et al; USCAP Annual Meeting 2014). - Preliminary results of an ongoing prospective study appear to confirm these results, with a 35.1% change in management recommendations observed to date.

• In order to provide a better interpretation of the diagnostic score, an indeterminate zone could be introduced.• The performance, objectivity, reliability, and minimal tissue requirements of this diagnostic test make it well-suited

for clinical use as an adjunct to histopathology.

METHODSSample Cohorts• All testing was performed on archival formalin-fixed paraffin-embedded (FFPE) tissue sections of

melanocytic lesions.• Specimens were selected by experienced dermatopathologists and included a spectrum of clinical and

histopathologic subtypes (Table 1). • Each case underwent review by a second expert dermatopathologist who was blinded to the diagnosis

of the contributing dermatopathologist. If there was discordance, the case was adjudicated by a third expert dermatopathologist.

Quantification of Gene Expression• H&E stained slides were reviewed by an anatomic pathologist and the representative area of each lesion was

identified, circled and macro-dissected. • Total RNA was extracted from the tissue and gene expression was assessed by quantitative reverse-transcription

polymerase chain reaction (qRT-PCR).• Expression levels for each gene were calculated using the ∆∆CT method.Gene Signature Discovery & Verification• Published literature was reviewed to identify candidate genes with differential expression in melanoma or

other cancers.• The panel of candidate genes was refined based upon 1) ability of each gene to differentiate (AUC>70%) benign

from malignant lesions and 2) technical reliability.• Expression levels were subjected to forward selection in a series of logistic regression models to identify the

subset of genes which most effectively discriminate benign from malignant lesions. • A refined logistic regression model was used to generate a single numeric score capable of differentiating

benign nevi from malignant melanoma.Validation of the Melanoma Diagnostic Score (MDS)• The association between the score and pathologic diagnosis was assessed to calculate sensitivity and specificity

of the MDS in a second, independent cohort of melanocytic lesions.

OBJECTIVEDevelop and validate a gene signature capable of differentiating malignant melanoma and benign nevi.

Melanomas Discovery Verification Validation Overall

Superficial Spreading 15 167 105 287

Nodular 7 23 38 68

Acral 3 20 9 32

LM/LMM* 4 39 31 74

Other 3 5 28 36

Overall 32 254 211 497

Nevi** Discovery Verification Validation Overall

Compound 15 68 101 184

Junctional 9 38 20 67

Intradermal 12 28 41 81

Spitz 3 34 7 44

Blue 3 38 22 63

Other 9 4 35 48

Overall 51 210 226 487

Table 1. Melanocytic Lesions by Subtype

Figure 1. Analysis of Candidate Genes by qRT-PCR

Figure 2. Distribution of the gene expression for the three best performing components.

Figure 4. Distribution of diagnostic scores in the clinical validation cohort.

Figure 5. ROC curve of diagnostic scores in the clinical validation cohort.

* Lentigo Maligna / Lentigo Maligna Melanoma ** Includes a total of 209 dysplastic nevi

83 Melanocytic Lesions31 melanomas / 52 nevi

DISCOVERY VERIFICATION VALIDATION

464 Melanocytic Lesions254 melanomas /210 nevi

437 Melanocytic Lesions211 melanomas / 226 nevi

qRT-PCRfor 79 genes

qRT-PCRfor 40 genes

qRT-PCRfor 23 genes

(AUC > 70)40 Genes

Forward Selection 14 genes Melanoma Diagnostic Score

Figure 3. Final Gene Expression Signature.

1 Gene Differentiation Regulator

9 Genes ‘Housekeepers’

5 Genes Multifunctional and Immune

Signaling

8 Genes Immune Signaling

Melanoma Diagnostic Score

RESULTS

• 79 candidate genes were initially identified and evaluated for differential expression in melanoma and nevus samples using 83 melanocytic lesions. - Included were genes with known immune functions, cell cycle progression genes, cellular differentiation, Notch signaling, migration, fat metabolism or the cytoskeleton.

• Forty genes were chosen for further assessment in a larger study of 464 melanocytic lesions. • Genes from similar biological pathways that exhibited correlated expression were consolidated by averaging.

Presented at ASCO - June 2, 2014