mycobacterium tuberculosis resistance...

98
Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated software tools V. Schleusener S. Feuerriegel S. Niemann Research Center Borstel, Borstel, Germany 2nd Conference Rapid Microbial NGS and Bioinformatics: Translation Into Practice, 2016

Upload: hoanghanh

Post on 04-Apr-2019

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Mycobacterium tuberculosis resistance prediction fromgenome sequencing:

comparison of automated software tools

V. Schleusener S. Feuerriegel S. Niemann

Research Center Borstel, Borstel, Germany

2nd Conference Rapid Microbial NGS and Bioinformatics:Translation Into Practice, 2016

Page 2: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Outline

1 MotivationThe Basic ProblemState of the art

2 ComparisonVisualizationValidation datasetPerformance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 0 / 14

Page 3: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Outline

1 MotivationThe Basic ProblemState of the art

2 ComparisonVisualizationValidation datasetPerformance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 0 / 14

Page 4: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Tuberculosis

• Worldwide occurring infection (normally of the lung)

• 1.5 million deaths annually

• 9.6 million cases (1/3 of the worlds population infected)

• Infection caused by pathogens of the Mycobacterium tuberculosisComplex (MTBC)

• Treatment impaired by increasing numbers of antibiotic resistance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 1 / 14

Page 5: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Tuberculosis

• Worldwide occurring infection (normally of the lung)

• 1.5 million deaths annually

• 9.6 million cases (1/3 of the worlds population infected)

• Infection caused by pathogens of the Mycobacterium tuberculosisComplex (MTBC)

• Treatment impaired by increasing numbers of antibiotic resistance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 1 / 14

Page 6: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Tuberculosis

• Worldwide occurring infection (normally of the lung)

• 1.5 million deaths annually

• 9.6 million cases (1/3 of the worlds population infected)

• Infection caused by pathogens of the Mycobacterium tuberculosisComplex (MTBC)

• Treatment impaired by increasing numbers of antibiotic resistance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 1 / 14

Page 7: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Tuberculosis

• Worldwide occurring infection (normally of the lung)

• 1.5 million deaths annually

• 9.6 million cases (1/3 of the worlds population infected)

• Infection caused by pathogens of the Mycobacterium tuberculosisComplex (MTBC)

• Treatment impaired by increasing numbers of antibiotic resistance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 1 / 14

Page 8: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Tuberculosis

• Worldwide occurring infection (normally of the lung)

• 1.5 million deaths annually

• 9.6 million cases (1/3 of the worlds population infected)

• Infection caused by pathogens of the Mycobacterium tuberculosisComplex (MTBC)

• Treatment impaired by increasing numbers of antibiotic resistance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 1 / 14

Page 9: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Tuberculosis

• Worldwide occurring infection (normally of the lung)

• 1.5 million deaths annually

• 9.6 million cases (1/3 of the worlds population infected)

• Infection caused by pathogens of the Mycobacterium tuberculosisComplex (MTBC)

• Treatment impaired by increasing numbers of antibiotic resistance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 1 / 14

Page 10: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Molecular Drug Susceptibility Testing

PacBio RSII

Ion Torrent Proton

Illumina NextSeq

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 2 / 14

• Key to control: timely diagnosis

• Fast molecular Tests such as GeneXpert

• Highest resolution with Next-GenerationSequencing (NGS) data

• NGS analysis complex and computationallyintensive

Automated tools needed:Raw data ⇒ resistance profile

Page 11: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Molecular Drug Susceptibility Testing

PacBio RSII

Ion Torrent Proton

Illumina NextSeq

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 2 / 14

• Key to control: timely diagnosis

• Fast molecular Tests such as GeneXpert

• Highest resolution with Next-GenerationSequencing (NGS) data

• NGS analysis complex and computationallyintensive

Automated tools needed:Raw data ⇒ resistance profile

Page 12: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Molecular Drug Susceptibility Testing

PacBio RSII

Ion Torrent Proton

Illumina NextSeq

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 2 / 14

• Key to control: timely diagnosis

• Fast molecular Tests such as GeneXpert

• Highest resolution with Next-GenerationSequencing (NGS) data

• NGS analysis complex and computationallyintensive

Automated tools needed:Raw data ⇒ resistance profile

Page 13: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Molecular Drug Susceptibility Testing

PacBio RSII

Ion Torrent Proton

Illumina NextSeq

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 2 / 14

• Key to control: timely diagnosis

• Fast molecular Tests such as GeneXpert

• Highest resolution with Next-GenerationSequencing (NGS) data

• NGS analysis complex and computationallyintensive

Automated tools needed:Raw data ⇒ resistance profile

Page 14: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Molecular Drug Susceptibility Testing

PacBio RSII

Ion Torrent Proton

Illumina NextSeq

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 2 / 14

• Key to control: timely diagnosis

• Fast molecular Tests such as GeneXpert

• Highest resolution with Next-GenerationSequencing (NGS) data

• NGS analysis complex and computationallyintensive

Automated tools needed:Raw data ⇒ resistance profile

Page 15: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

NGS Analysis

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 3 / 14

Automated analysis tools for TBavailable?

Page 16: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

NGS Analysis

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 3 / 14

Automated analysis tools for TBavailable?

Page 17: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - Screening

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 4 / 14

Page 18: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - Screening

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 4 / 14

Page 19: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - Screening

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 4 / 14

Page 20: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - Screening

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 4 / 14

Page 21: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Outline

1 MotivationThe Basic ProblemState of the art

2 ComparisonVisualizationValidation datasetPerformance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 4 / 14

Page 22: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools-CASTBCASTB - Comprehensive Analysis Server for MTBC

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 5 / 14

Iwai et. al.,Tuberculosis (Edinb), 2015

Page 23: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools-CASTBCASTB - Comprehensive Analysis Server for MTBC

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 5 / 14

Iwai et. al.,Tuberculosis (Edinb), 2015

Page 24: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools-CASTBCASTB - Comprehensive Analysis Server for MTBC

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 5 / 14

Iwai et. al.,Tuberculosis (Edinb), 2015

Page 25: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools-CASTBCASTB - Comprehensive Analysis Server for MTBC

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 5 / 14

Iwai et. al.,Tuberculosis (Edinb), 2015

Page 26: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools-CASTBCASTB - Comprehensive Analysis Server for MTBC

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 5 / 14

Iwai et. al.,Tuberculosis (Edinb), 2015

Page 27: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools-KvarQ

KvarQ

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 6 / 14

MTBC/phylo: lineage 4MTBC/resistance: Streptomycin resistance::SNP781687AG=rpsL.K43R;Isoniazid resistance [2155168CG=katG.S315T];Rifampicin resistance (RRDR) [761155CT=rpoB.S450L]

Steiner et. al., BMC Genomics, 2014

Page 28: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools-KvarQ

KvarQ

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 6 / 14

MTBC/phylo: lineage 4MTBC/resistance: Streptomycin resistance::SNP781687AG=rpsL.K43R;Isoniazid resistance [2155168CG=katG.S315T];Rifampicin resistance (RRDR) [761155CT=rpoB.S450L]

Steiner et. al., BMC Genomics, 2014

Page 29: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools-KvarQ

KvarQ

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 6 / 14

MTBC/phylo: lineage 4

MTBC/resistance: Streptomycin resistance::SNP781687AG=rpsL.K43R;Isoniazid resistance [2155168CG=katG.S315T];Rifampicin resistance (RRDR) [761155CT=rpoB.S450L]

Steiner et. al., BMC Genomics, 2014

Page 30: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools-KvarQ

KvarQ

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 6 / 14

MTBC/phylo: lineage 4MTBC/resistance: Streptomycin resistance::SNP781687AG=rpsL.K43R;Isoniazid resistance [2155168CG=katG.S315T];Rifampicin resistance (RRDR) [761155CT=rpoB.S450L]

Steiner et. al., BMC Genomics, 2014

Page 31: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools-KvarQ

KvarQ

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 6 / 14

MTBC/phylo: lineage 4

MTBC/resistance: Streptomycin resistance::SNP781687AG=rpsL.K43R;Isoniazid resistance [2155168CG=katG.S315T];Rifampicin resistance (RRDR) [761155CT=rpoB.S450L]

Steiner et. al., BMC Genomics, 2014

Page 32: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - MykrobePredictor TB

MykrobePredictor TB

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 7 / 14

Bradley et. al., Nat Commun, 2015

Page 33: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - MykrobePredictor TB

MykrobePredictor TB

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 7 / 14

Bradley et. al., Nat Commun, 2015

Page 34: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - MykrobePredictor TB

MykrobePredictor TB

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 7 / 14

Bradley et. al., Nat Commun, 2015

Page 35: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - MykrobePredictor TB

MykrobePredictor TB

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 7 / 14

Bradley et. al., Nat Commun, 2015

Page 36: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - PhyResSE

PhyResSE - Phylo-Resistance Search Engine

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 8 / 14

Feuerriegel et. al., JCM, 2015

Page 37: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - PhyResSE

PhyResSE - Phylo-Resistance Search Engine

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 8 / 14

Feuerriegel et. al., JCM, 2015

Page 38: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - PhyResSE

PhyResSE - Phylo-Resistance Search Engine

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 8 / 14

Feuerriegel et. al., JCM, 2015

Page 39: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - PhyResSEPhyResSE - Phylo-Resistance Search Engine

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 8 / 14

Feuerriegel et. al., JCM, 2015

Page 40: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - PhyResSEPhyResSE - Phylo-Resistance Search Engine

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 8 / 14

Feuerriegel et. al., JCM, 2015

Page 41: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - PhyResSEPhyResSE - Phylo-Resistance Search Engine

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 8 / 14

Feuerriegel et. al., JCM, 2015

Page 42: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - TBProfilerTBProfiler

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 9 / 14

Coll et al., Genome Medicine, 2015

Page 43: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - TBProfilerTBProfiler

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 9 / 14

Coll et al., Genome Medicine, 2015

Page 44: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - TBProfilerTBProfiler

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 9 / 14

Coll et al., Genome Medicine, 2015

Page 45: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - TBProfilerTBProfiler

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 9 / 14

Coll et al., Genome Medicine, 2015

Page 46: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Available tools - TBProfilerTBProfiler

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 9 / 14

Coll et al., Genome Medicine, 2015

Page 47: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 48: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 49: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 50: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 51: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 52: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 53: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

Easiest handling with PhyResSE

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 54: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 55: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 56: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 57: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 58: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 59: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

KvarQ is a fast, mapping-free algorithm

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 60: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 61: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 62: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 63: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 64: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 65: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

Programming skills needed for KvarQ, MykrobePredictor TB andTBProfiler

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 66: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Sierra Leone dataset

No (%)

Total 92 (100)Fully sensitive 44 (47.8)

Any resistance 48 (52.2)Any SM resistance 22 (23.9)Any INH resistance 30 (32.6)Any RMP resistance 15 (16.3)Any EMB resistance 14 (15.2)Any PZA resistance 9 (9.8)

Any Mono-resistance 23 (25)SM only 14 (15.2)INH only 8 (8.7)RMP only 1 (1.1)EMB only -PZA only -

MDR 11 (12)

Classical DST, Sanger sequencing, IS6110 RFLP DNA fingerprinting,spoligotyping and 24-loci MIRU-VNTR typing available.

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 11 / 14

Feuerriegel et. al., BMC Microbiology, 2012

Page 67: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Sierra Leone dataset

No (%)

Total 92 (100)Fully sensitive 44 (47.8)

Any resistance 48 (52.2)Any SM resistance 22 (23.9)Any INH resistance 30 (32.6)Any RMP resistance 15 (16.3)Any EMB resistance 14 (15.2)Any PZA resistance 9 (9.8)

Any Mono-resistance 23 (25)SM only 14 (15.2)INH only 8 (8.7)RMP only 1 (1.1)EMB only -PZA only -

MDR 11 (12)

Classical DST, Sanger sequencing, IS6110 RFLP DNA fingerprinting,spoligotyping and 24-loci MIRU-VNTR typing available.

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 11 / 14

Feuerriegel et. al., BMC Microbiology, 2012

Page 68: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Sierra Leone dataset

No (%)

Total 92 (100)Fully sensitive 44 (47.8)

Any resistance 48 (52.2)Any SM resistance 22 (23.9)Any INH resistance 30 (32.6)Any RMP resistance 15 (16.3)Any EMB resistance 14 (15.2)Any PZA resistance 9 (9.8)

Any Mono-resistance 23 (25)SM only 14 (15.2)INH only 8 (8.7)RMP only 1 (1.1)EMB only -PZA only -

MDR 11 (12)

Classical DST, Sanger sequencing, IS6110 RFLP DNA fingerprinting,spoligotyping and 24-loci MIRU-VNTR typing available.

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 11 / 14

Feuerriegel et. al., BMC Microbiology, 2012

Page 69: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Sierra Leone dataset

No (%)

Total 92 (100)Fully sensitive 44 (47.8)

Any resistance 48 (52.2)Any SM resistance 22 (23.9)Any INH resistance 30 (32.6)Any RMP resistance 15 (16.3)Any EMB resistance 14 (15.2)Any PZA resistance 9 (9.8)

Any Mono-resistance 23 (25)SM only 14 (15.2)INH only 8 (8.7)RMP only 1 (1.1)EMB only -PZA only -

MDR 11 (12)

Classical DST, Sanger sequencing, IS6110 RFLP DNA fingerprinting,spoligotyping and 24-loci MIRU-VNTR typing available.

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 11 / 14

Feuerriegel et. al., BMC Microbiology, 2012

Page 70: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Sierra Leone dataset

No (%)

Total 92 (100)Fully sensitive 44 (47.8)

Any resistance 48 (52.2)Any SM resistance 22 (23.9)Any INH resistance 30 (32.6)Any RMP resistance 15 (16.3)Any EMB resistance 14 (15.2)Any PZA resistance 9 (9.8)

Any Mono-resistance 23 (25)SM only 14 (15.2)INH only 8 (8.7)RMP only 1 (1.1)EMB only -PZA only -

MDR 11 (12)

Classical DST, Sanger sequencing, IS6110 RFLP DNA fingerprinting,spoligotyping and 24-loci MIRU-VNTR typing available.

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 11 / 14

Feuerriegel et. al., BMC Microbiology, 2012

Page 71: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Page 72: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Page 73: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Rough digestion into the 7 main phylogenetic lineages.

Page 74: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Page 75: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Highest resolutional depth by using SNPs from Coll et al. 2015

Page 76: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Page 77: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

MykrobePredictor TB is unable to classify strains belonging tolin. 5/ WA 1

Page 78: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Page 79: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

CASTB classified one strain belonging to lineage 4.3.3/LAM asM. bovis

Page 80: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Page 81: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Page 82: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Use phylogenetic marker kasA Gly269Ser as marker for INH resistance.

Page 83: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Page 84: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Miss markers embB Trp332Arg, Asp354Ala, Gly406Asp, Gln497Lys andHis1002Arg for EMB resistance

Page 85: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Skip gidB for SM resistance prediction.

Page 86: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Indels in gidB promotor region are reported but not flagged asresistance-mediating.

Page 87: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Skips the analysis of pncA.

Page 88: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 89: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 90: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 91: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 92: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 93: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 94: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 95: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 96: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 97: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Acknowledgements

Molecular and Experimental Mycobacteriology:Stefan Niemann Susanne HomolkaSilke Feuerriegel Matthias MerkerChristiane Gerlach Judith PetersenThomas Kohl Patrick BeckertAnja Lüdemann Julia ZalletSilvia Maaß Vanessa MohrSven Malm Tanja UbbenTanja Struwe-Sonnenschein Leila JeljeliGlennah Kerubi Doreen BeyerBarbara Tizzano Christian UtpatelRobin Koch Yassir Adam ShuaibEcaterina Noroc Anna Engström

Thank you for your attention!

Contact: [email protected]

Page 98: Mycobacterium tuberculosis resistance …rami-ngs.org/fileadmin/rami-ngs/downloads/talks/...Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated

Acknowledgements

Molecular and Experimental Mycobacteriology:Stefan Niemann Susanne HomolkaSilke Feuerriegel Matthias MerkerChristiane Gerlach Judith PetersenThomas Kohl Patrick BeckertAnja Lüdemann Julia ZalletSilvia Maaß Vanessa MohrSven Malm Tanja UbbenTanja Struwe-Sonnenschein Leila JeljeliGlennah Kerubi Doreen BeyerBarbara Tizzano Christian UtpatelRobin Koch Yassir Adam ShuaibEcaterina Noroc Anna Engström

Thank you for your attention!

Contact: [email protected]