sequence motifs, and sequence logos, neural networks

42
Sequence motifs, and sequence logos, Neural networks Ole Lund, Morten Nielsen, CBS, Department of Systems Biology, DTU

Upload: austin-mcintyre

Post on 02-Jan-2016

53 views

Category:

Documents


1 download

DESCRIPTION

Sequence motifs, and sequence logos, Neural networks. Ole Lund, Morten Nielsen, CBS, Department of Systems Biology, DTU. Informatics in biology. 70’ Little computing power Analytical solutions 80’ Computers, few data Simulations of molecular/cellular dynamics - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Sequence motifs,  and sequence logos, Neural networks

Sequence motifs, and sequence logos, Neural

networks

Ole Lund, Morten Nielsen,CBS,

Department of Systems Biology,

DTU

Page 2: Sequence motifs,  and sequence logos, Neural networks

Informatics in biology• 70’ Little computing power

– Analytical solutions• 80’ Computers, few data

– Simulations of molecular/cellular dynamics

• 90’ More data – Sequence and structure– Searching biological databases– Prediction of features by data driven

methods– Analysis of gene expression data

>polymerase“

MERIKELRDLMSQSRTREILTKTTVDHMAIIKKYTSGRQEKNPALRMKWMMAMKYPITAD

KRIMEMIPERNEQGQTLWSKTNDAGSDRVMVSPLAVTWWNRNGPTTSTVHYPKVYKTYFE

KVERLKHGTFGPVHFRNQVKIRRRVDINPGHADLSAKEAQDVIMEVVFPNEVGARILTSE

SQLTITKEKKEELQDCKIAPLMVAYMLERELVRKTRFLPVAGGTSSVYIEVLHLTQGTCW

EQMYTPGGEVRNDDVDQSLIIAARNIVRRATVSADPLASLLEMCHSTQIGGIRMVDILRQ

NPTEEQAVDICKAAMGLRISSSFSFGGFTFKRTNGSSVKKEEEVLTGNLQTLKIKVHEGY

EEFTMVGRRATAILRKATRRLIQLIVSGRDEQSIAEAIIVAMVFSQEDCMIKAVRGDLNF

...

Page 3: Sequence motifs,  and sequence logos, Neural networks

Data driven predictions

List of peptides that have a given biological feature

Mathematical model (neural network, hidden

Markov model)

Search databases for other biological sequences with the same feature/property

YMNGTMSQVGILGFVFTLALWGFFPVVILKEPVHGVILGFVFTLTLLFGYPVYVGLSPTVWLSWLSLLVPFVFLPSDFFPSCVGGLLTMVFIAGNSAYE

>polymerase“

MERIKELRDLMSQSRTREILTKTTVDHMAIIKKYTSGRQEKNPALRMKWMMAMKYPITAD

KRIMEMIPERNEQGQTLWSKTNDAGSDRVMVSPLAVTWWNRNGPTTSTVHYPKVYKTYFE

KVERLKHGTFGPVHFRNQVKIRRRVDINPGHADLSAKEAQDVIMEVVFPNEVGARILTSE

SQLTITKEKKEELQDCKIAPLMVAYMLERELVRKTRFLPVAGGTSSVYIEVLHLTQGTCW

EQMYTPGGEVRNDDVDQSLIIAARNIVRRATVSADPLASLLEMCHSTQIGGIRMVDILRQ

NPTEEQAVDICKAAMGLRISSSFSFGGFTFKRTNGSSVKKEEEVLTGNLQTLKIKVHEGY

EEFTMVGRRATAILRKATRRLIQLIVSGRDEQSIAEAIIVAMVFSQEDCMIKAVRGDLNF

...

Page 4: Sequence motifs,  and sequence logos, Neural networks

Prediction algorithms

MHC binding data

Predictionalgorithms

Genome scans

Page 5: Sequence motifs,  and sequence logos, Neural networks

Influenza A virus (A/Goose/Guangdong/1/96(H5N1))

>polymerase“

MERIKELRDLMSQSRTREILTKTTVDHMAIIKKYTSGRQEKNPALRMKWMMAMKYPITAD

KRIMEMIPERNEQGQTLWSKTNDAGSDRVMVSPLAVTWWNRNGPTTSTVHYPKVYKTYFE

KVERLKHGTFGPVHFRNQVKIRRRVDINPGHADLSAKEAQDVIMEVVFPNEVGARILTSE

SQLTITKEKKEELQDCKIAPLMVAYMLERELVRKTRFLPVAGGTSSVYIEVLHLTQGTCW

EQMYTPGGEVRNDDVDQSLIIAARNIVRRATVSADPLASLLEMCHSTQIGGIRMVDILRQ

NPTEEQAVDICKAAMGLRISSSFSFGGFTFKRTNGSSVKKEEEVLTGNLQTLKIKVHEGY

EEFTMVGRRATAILRKATRRLIQLIVSGRDEQSIAEAIIVAMVFSQEDCMIKAVRGDLNF

...

and 9 other proteins

MERIKELRD

ERIKELRDL

RIKELRDLM

IKELRDLMS

KELRDLMSQ

ELRDLMSQS

LRDLMSQSR

RDLMSQSRT

DLMSQSRTR

LMSQSRTRE

and 4376 other 9mers

Proteins

9mer peptides

>Segment 1

agcaaaagcaggtcaattatattcaatatggaaagaataaaagaactaagagatctaatg

tcgcagtcccgcactcgcgagatactaacaaaaaccactgtggatcatatggccataatc

aagaaatacacatcaggaagacaagagaagaaccctgctctcagaatgaaatggatgatg

gcaatgaaatatccaatcacagcagacaagagaataatggagatgattcctgaaaggaat

and 13350 other nucleotides on 8 segments

Genome

Page 6: Sequence motifs,  and sequence logos, Neural networks

Immune system

•Innate – fast…

•Addaptive – remembers…

•Cellular

•Cytotoxic T lymphocytes (CTL)

•Helper T lymphocytes (HTL)

•Humoral

•B lymphocytes

Figure by Eric A.J. Reits

Page 7: Sequence motifs,  and sequence logos, Neural networks

Outline

• Pattern recognition– Regular expressions

and probabilities• Information content

– Sequence logos• Multiple alignment and

sequence motifs

• Weight matrix construction– Sequence weighting– Low (pseudo) counts

• Examples from the real world

• Sequence profiles

Page 8: Sequence motifs,  and sequence logos, Neural networks

MHC-I molecules present peptides on the surface of most cells

Page 9: Sequence motifs,  and sequence logos, Neural networks

CTL response

Healthy cell

Virus-infectedcell

MHC-I

Page 10: Sequence motifs,  and sequence logos, Neural networks

CTL response

Healthy cell

Virus-infectedcell

MHC-I

Page 11: Sequence motifs,  and sequence logos, Neural networks

Anchor positions

Binding Motif. MHC class I with peptide

Page 12: Sequence motifs,  and sequence logos, Neural networks

SLLPAIVEL YLLPAIVHI TLWVDPYEV GLVPFLVSV KLLEPVLLL LLDVPTAAV LLDVPTAAV LLDVPTAAVLLDVPTAAV VLFRGGPRG MVDGTLLLL YMNGTMSQV MLLSVPLLL SLLGLLVEV ALLPPINIL TLIKIQHTLHLIDYLVTS ILAPPVVKL ALFPQLVIL GILGFVFTL STNRQSGRQ GLDVLTAKV RILGAVAKV QVCERIPTIILFGHENRV ILMEHIHKL ILDQKINEV SLAGGIIGV LLIENVASL FLLWATAEA SLPDFGISY KKREEAPSLLERPGGNEI ALSNLEVKL ALNELLQHV DLERKVESL FLGENISNF ALSDHHIYL GLSEFTEYL STAPPAHGVPLDGEYFTL GVLVGVALI RTLDKVLEV HLSTAFARV RLDSYVRSL YMNGTMSQV GILGFVFTL ILKEPVHGVILGFVFTLT LLFGYPVYV GLSPTVWLS WLSLLVPFV FLPSDFFPS CLGGLLTMV FIAGNSAYE KLGEFYNQMKLVALGINA DLMGYIPLV RLVTLKDIV MLLAVLYCL AAGIGILTV YLEPGPVTA LLDGTATLR ITDQVPFSVKTWGQYWQV TITDQVPFS AFHHVAREL YLNKIQNSL MMRKLAILS AIMDKNIIL IMDKNIILK SMVGNWAKVSLLAPGAKQ KIFGSLAFL ELVSEFSRM KLTPLCVTL VLYRYGSFS YIGEVLVSV CINGVCWTV VMNILLQYVILTVILGVL KVLEYVIKV FLWGPRALV GLSRYVARL FLLTRILTI HLGNVKYLV GIAGGLALL GLQDCTMLVTGAPVTYST VIYQYMDDL VLPDVFIRC VLPDVFIRC AVGIGIAVV LVVLGLLAV ALGLGLLPV GIGIGVLAAGAGIGVAVL IAGIGILAI LIVIGILIL LAGIGLIAA VDGIGILTI GAGIGVLTA AAGIGIIQI QAGIGILLAKARDPHSGH KACDPHSGH ACDPHSGHF SLYNTVATL RGPGRAFVT NLVPMVATV GLHCYEQLV PLKQHFQIVAVFDRKSDA LLDFVRFMG VLVKSPNHV GLAPPQHLI LLGRNSFEV PLTFGWCYK VLEWRFDSR TLNAWVKVVGLCTLVAML FIDSYICQV IISAVVGIL VMAGVGSPY LLWTLVVLL SVRDRLARL LLMDCSGSI CLTSTVQLVVLHDDLLEA LMWITQCFL SLLMWITQC QLSLLMWIT LLGATCMFV RLTRFLSRV YMDGTMSQV FLTPKKLQCISNDVCAQV VKTDGNPPE SVYDFFVWL FLYGALLLA VLFSSDFRI LMWAKIGPV SLLLELEEV SLSRFSWGAYTAFTIPSI RLMKQDFSV RLPRIFCSC FLWGPRAYA RLLQETELV SLFEGIDFY SLDQSVVEL RLNMFTPYINMFTPYIGV LMIIPLINV TLFIGSHVV SLVIVTTFV VLQWASLAV ILAKFLHWL STAPPHVNV LLLLTVLTVVVLGVVFGI ILHNGAYSL MIMVKCWMI MLGTHTMEV MLGTHTMEV SLADTNSLA LLWAARPRL GVALQTMKQGLYDGMEHL KMVELVHFL YLQLVFGIE MLMAQEALA LMAQEALAF VYDGREHTV YLSGANLNL RMFPNAPYLEAAGIGILT TLDSQVMSL STPPPGTRV KVAELVHFL IMIGVLVGV ALCRWGLLL LLFAGVQCQ VLLCESTAVYLSTAFARV YLLEMLWRL SLDDYNHLV RTLDKVLEV GLPVEYLQV KLIANNTRV FIYAGSLSA KLVANNTRLFLDEFMEGV ALQPGTALL VLDGLDVLL SLYSFPEPE ALYVDSLFF SLLQHLIGL ELTLGEFLK MINAYLDKLAAGIGILTV FLPSDFFPS SVRDRLARL SLREWLLRI LLSAWILTA AAGIGILTV AVPDEIPPL FAYDGKDYIAAGIGILTV FLPSDFFPS AAGIGILTV FLPSDFFPS AAGIGILTV FLWGPRALV ETVSEQSNV ITLWQRPLV

Sequence information

Page 13: Sequence motifs,  and sequence logos, Neural networks

Sequence Information

• Calculate pa at each position• Entropy

• Information content

• Conserved positions– PV=1, P!v=0 => S=0,

I=log(20)• Mutable positions

– Paa=1/20 => S=log(20), I=0

• Say that a peptide must have L at P2 in order to bind, and that A,F,W,and Y are found at P1. Which position has most information? • How many questions do I need to ask to tell if a peptide binds looking at only P1 or P2?

• P1: 4 questions (at most)• P2: 1 question (L or not)• P2 has the most information

Page 14: Sequence motifs,  and sequence logos, Neural networks

Information content

A R N D C Q E G H I L K M F P S T W Y V S I1 0.10 0.06 0.01 0.02 0.01 0.02 0.02 0.09 0.01 0.07 0.11 0.06 0.04 0.08 0.01 0.11 0.03 0.01 0.05 0.08 3.96 0.372 0.07 0.00 0.00 0.01 0.01 0.00 0.01 0.01 0.00 0.08 0.59 0.01 0.07 0.01 0.00 0.01 0.06 0.00 0.01 0.08 2.16 2.163 0.08 0.03 0.05 0.10 0.02 0.02 0.01 0.12 0.02 0.03 0.12 0.01 0.03 0.05 0.06 0.06 0.04 0.04 0.04 0.07 4.06 0.264 0.07 0.04 0.02 0.11 0.01 0.04 0.08 0.15 0.01 0.10 0.04 0.03 0.01 0.02 0.09 0.07 0.04 0.02 0.00 0.05 3.87 0.455 0.04 0.04 0.04 0.04 0.01 0.04 0.05 0.16 0.04 0.02 0.08 0.04 0.01 0.06 0.10 0.02 0.06 0.02 0.05 0.09 4.04 0.286 0.04 0.03 0.03 0.01 0.02 0.03 0.03 0.04 0.02 0.14 0.13 0.02 0.03 0.07 0.03 0.05 0.08 0.01 0.03 0.15 3.92 0.407 0.14 0.01 0.03 0.03 0.02 0.03 0.04 0.03 0.05 0.07 0.15 0.01 0.03 0.07 0.06 0.07 0.04 0.03 0.02 0.08 3.98 0.348 0.05 0.09 0.04 0.01 0.01 0.05 0.07 0.05 0.02 0.04 0.14 0.04 0.02 0.05 0.05 0.08 0.10 0.01 0.04 0.03 4.04 0.289 0.07 0.01 0.00 0.00 0.02 0.02 0.02 0.01 0.01 0.08 0.26 0.01 0.01 0.02 0.00 0.04 0.02 0.00 0.01 0.38 2.78 1.55

Page 15: Sequence motifs,  and sequence logos, Neural networks

Sequence logos

•Height of a column equal to I•Relative height of a letter is p•Highly useful tool to visualize sequence motifs

High information positions

HLA-A0201

http://www.cbs.dtu.dk/~gorodkin/appl/plogo.html

Page 16: Sequence motifs,  and sequence logos, Neural networks

Characterizing a binding motif from small data sets

What can we learn?

1. A at P1 favors binding?

2. I is not allowed at P9? 3. K at P4 favors binding?4. Which positions are

important for binding?

ALAKAAAAMALAKAAAANALAKAAAARALAKAAAATALAKAAAAVGMNERPILTGILGFVFTMTLNAWVKVVKLNEPVLLLAVVPFIVSV

10 MHC restricted peptides

Page 17: Sequence motifs,  and sequence logos, Neural networks

Simple motifs Yes/No rules

ALAKAAAAMALAKAAAANALAKAAAARALAKAAAATALAKAAAAVGMNERPILTGILGFVFTMTLNAWVKVVKLNEPVLLLAVVPFIVSV

10 MHC restricted peptides

• Only 11 of 212 peptides identified!• Need more flexible rules

•If not fit P1 but fit P2 then ok• Not all positions are equally important

•We know that P2 and P9 determines binding more than other positions

•Cannot discriminate between good and very good binders

Page 18: Sequence motifs,  and sequence logos, Neural networks

Simple motifsYes/No rules

• Example

•Two first peptides will not fit the motif. They are all good binders (aff< 500nM)

RLLDDTPEV 84 nMGLLGNVSTV 23 nMALAKAAAAL 309 nM

ALAKAAAAMALAKAAAANALAKAAAARALAKAAAATALAKAAAAVGMNERPILTGILGFVFTMTLNAWVKVVKLNEPVLLLAVVPFIVSV

10 MHC restricted peptides

Page 19: Sequence motifs,  and sequence logos, Neural networks

Extended motifs

• Fitness of aa at each position given by P(aa)

• Example P1PA = 6/10

PG = 2/10

PT = PK = 1/10

PC = PD = …PV = 0

• Problems– Few data– Data redundancy/duplication

ALAKAAAAMALAKAAAANALAKAAAARALAKAAAATALAKAAAAVGMNERPILTGILGFVFTMTLNAWVKVVKLNEPVLLLAVVPFIVSV

RLLDDTPEV 84 nMGLLGNVSTV 23 nMALAKAAAAL 309 nM

Page 20: Sequence motifs,  and sequence logos, Neural networks

Sequence informationRaw sequence counting

ALAKAAAAMALAKAAAANALAKAAAARALAKAAAATALAKAAAAVGMNERPILTGILGFVFTMTLNAWVKVVKLNEPVLLLAVVPFIVSV

Page 21: Sequence motifs,  and sequence logos, Neural networks

Sequence weighting

ALAKAAAAMALAKAAAANALAKAAAARALAKAAAATALAKAAAAVGMNERPILTGILGFVFTMTLNAWVKVVKLNEPVLLLAVVPFIVSV

•Poor or biased sampling of sequence space•Example P1

PA = 2/6

PG = 2/6

PT = PK = 1/6

PC = PD = …PV = 0

}Similar sequencesWeight 1/5

RLLDDTPEV 84 nMGLLGNVSTV 23 nMALAKAAAAL 309 nM

Page 22: Sequence motifs,  and sequence logos, Neural networks

Sequence weighting

ALAKAAAAMALAKAAAANALAKAAAARALAKAAAATALAKAAAAVGMNERPILTGILGFVFTMTLNAWVKVVKLNEPVLLLAVVPFIVSV

Page 23: Sequence motifs,  and sequence logos, Neural networks

Pseudo counts

ALAKAAAAMALAKAAAANALAKAAAARALAKAAAATALAKAAAAVGMNERPILTGILGFVFTMTLNAWVKVVKLNEPVLLLAVVPFIVSV

•I is not found at position P9. Does this mean that I is forbidden (P(I)=0)?•No! Use Blosum substitution matrix to estimate pseudo frequency of I at P9

Page 24: Sequence motifs,  and sequence logos, Neural networks

A R N D C Q E G H I L K M F P S T W Y V A 0.29 0.03 0.03 0.03 0.02 0.03 0.04 0.08 0.01 0.04 0.06 0.04 0.02 0.02 0.03 0.09 0.05 0.01 0.02 0.07 R 0.04 0.34 0.04 0.03 0.01 0.05 0.05 0.03 0.02 0.02 0.05 0.12 0.02 0.02 0.02 0.04 0.03 0.01 0.02 0.03 N 0.04 0.04 0.32 0.08 0.01 0.03 0.05 0.07 0.03 0.02 0.03 0.05 0.01 0.02 0.02 0.07 0.05 0.00 0.02 0.03 D 0.04 0.03 0.07 0.40 0.01 0.03 0.09 0.05 0.02 0.02 0.03 0.04 0.01 0.01 0.02 0.05 0.04 0.00 0.01 0.02 C 0.07 0.02 0.02 0.02 0.48 0.01 0.02 0.03 0.01 0.04 0.07 0.02 0.02 0.02 0.02 0.04 0.04 0.00 0.01 0.06 Q 0.06 0.07 0.04 0.05 0.01 0.21 0.10 0.04 0.03 0.03 0.05 0.09 0.02 0.01 0.02 0.06 0.04 0.01 0.02 0.04 E 0.06 0.05 0.04 0.09 0.01 0.06 0.30 0.04 0.03 0.02 0.04 0.08 0.01 0.02 0.03 0.06 0.04 0.01 0.02 0.03 G 0.08 0.02 0.04 0.03 0.01 0.02 0.03 0.51 0.01 0.02 0.03 0.03 0.01 0.02 0.02 0.05 0.03 0.01 0.01 0.02 H 0.04 0.05 0.05 0.04 0.01 0.04 0.05 0.04 0.35 0.02 0.04 0.05 0.02 0.03 0.02 0.04 0.03 0.01 0.06 0.02 I 0.05 0.02 0.01 0.02 0.02 0.01 0.02 0.02 0.01 0.27 0.17 0.02 0.04 0.04 0.01 0.03 0.04 0.01 0.02 0.18 L 0.04 0.02 0.01 0.02 0.02 0.02 0.02 0.02 0.01 0.12 0.38 0.03 0.05 0.05 0.01 0.02 0.03 0.01 0.02 0.10 K 0.06 0.11 0.04 0.04 0.01 0.05 0.07 0.04 0.02 0.03 0.04 0.28 0.02 0.02 0.03 0.05 0.04 0.01 0.02 0.03 M 0.05 0.03 0.02 0.02 0.02 0.03 0.03 0.03 0.02 0.10 0.20 0.04 0.16 0.05 0.02 0.04 0.04 0.01 0.02 0.09 F 0.03 0.02 0.02 0.02 0.01 0.01 0.02 0.03 0.02 0.06 0.11 0.02 0.03 0.39 0.01 0.03 0.03 0.02 0.09 0.06 P 0.06 0.03 0.02 0.03 0.01 0.02 0.04 0.04 0.01 0.03 0.04 0.04 0.01 0.01 0.49 0.04 0.04 0.00 0.01 0.03 S 0.11 0.04 0.05 0.05 0.02 0.03 0.05 0.07 0.02 0.03 0.04 0.05 0.02 0.02 0.03 0.22 0.08 0.01 0.02 0.04 T 0.07 0.04 0.04 0.04 0.02 0.03 0.04 0.04 0.01 0.05 0.07 0.05 0.02 0.02 0.03 0.09 0.25 0.01 0.02 0.07 W 0.03 0.02 0.02 0.02 0.01 0.02 0.02 0.03 0.02 0.03 0.05 0.02 0.02 0.06 0.01 0.02 0.02 0.49 0.07 0.03 Y 0.04 0.03 0.02 0.02 0.01 0.02 0.03 0.02 0.05 0.04 0.07 0.03 0.02 0.13 0.02 0.03 0.03 0.03 0.32 0.05 V 0.07 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.01 0.16 0.13 0.03 0.03 0.04 0.02 0.03 0.05 0.01 0.02 0.27

The Blosum matrix

Some amino acids are highly conserved (i.e. C), some have a high change of mutation (i.e. I)

Page 25: Sequence motifs,  and sequence logos, Neural networks

A R N D C Q E G H I L K M F P S T W Y V A 0.29 0.03 0.03 0.03 0.02 0.03 0.04 0.08 0.01 0.04 0.06 0.04 0.02 0.02 0.03 0.09 0.05 0.01 0.02 0.07 R 0.04 0.34 0.04 0.03 0.01 0.05 0.05 0.03 0.02 0.02 0.05 0.12 0.02 0.02 0.02 0.04 0.03 0.01 0.02 0.03 N 0.04 0.04 0.32 0.08 0.01 0.03 0.05 0.07 0.03 0.02 0.03 0.05 0.01 0.02 0.02 0.07 0.05 0.00 0.02 0.03 D 0.04 0.03 0.07 0.40 0.01 0.03 0.09 0.05 0.02 0.02 0.03 0.04 0.01 0.01 0.02 0.05 0.04 0.00 0.01 0.02 C 0.07 0.02 0.02 0.02 0.48 0.01 0.02 0.03 0.01 0.04 0.07 0.02 0.02 0.02 0.02 0.04 0.04 0.00 0.01 0.06 …. Y 0.04 0.03 0.02 0.02 0.01 0.02 0.03 0.02 0.05 0.04 0.07 0.03 0.02 0.13 0.02 0.03 0.03 0.03 0.32 0.05 V 0.07 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.01 0.16 0.13 0.03 0.03 0.04 0.02 0.03 0.05 0.01 0.02 0.27

What is a pseudo count?

• Say V is observed at P2• Knowing that V at P2 binds, what is the probability

that a peptide could have I at P2?• P(I|V) = 0.16

Page 26: Sequence motifs,  and sequence logos, Neural networks

• Calculate observed amino acids frequencies fa

• Pseudo frequency for amino acid b

• Example

ALAKAAAAMALAKAAAANALAKAAAARALAKAAAATALAKAAAAVGMNERPILTGILGFVFTMTLNAWVKVVKLNEPVLLLAVVPFIVSV

Pseudo count estimation

gI = 0.2 ⋅qI |M + 0.1⋅qI |R +L + 0.3⋅qI |V + 0.1⋅qI |LgI = 0.2 ⋅0.1+ 0.1⋅0.02 +L + 0.3⋅0.16 + 0.1⋅0.12 = 0.094

Page 27: Sequence motifs,  and sequence logos, Neural networks

ALAKAAAAMALAKAAAANALAKAAAARALAKAAAATALAKAAAAVGMNERPILTGILGFVFTMTLNAWVKVVKLNEPVLLLAVVPFIVSV

Weight on pseudo count

• Pseudo counts are important when only limited data is available

• With large data sets only “true” observation should count

• is the effective number of sequences (= Number of sequence - 1)

• is the weight on prior or weight on pseudo counts

Page 28: Sequence motifs,  and sequence logos, Neural networks

• Example

• If large, p ≈ f and only the observed data defines the motif

• If small, p ≈ g and the pseudo counts (or prior) defines the motif

• is [50-200] normally

ALAKAAAAMALAKAAAANALAKAAAARALAKAAAATALAKAAAAVGMNERPILTGILGFVFTMTLNAWVKVVKLNEPVLLLAVVPFIVSV

Weight on pseudo count

Page 29: Sequence motifs,  and sequence logos, Neural networks

Sequence weighting and pseudo counts

ALAKAAAAMALAKAAAANALAKAAAARALAKAAAATALAKAAAAVGMNERPILTGILGFVFTMTLNAWVKVVKLNEPVLLLAVVPFIVSV

Page 30: Sequence motifs,  and sequence logos, Neural networks

Position specific weighting

• We know that positions 2 and 9 are anchor positions for most MHC binding motifs– Increase weight on high

information positions

• Motif found on large data set

Page 31: Sequence motifs,  and sequence logos, Neural networks

Weight matrices

• Estimate amino acid frequencies from alignment including sequence weighting and pseudo count

• What do the numbers mean?– P2(V)>P2(M). Does this mean that V enables binding more than M.– In nature not all amino acids are found equally often

• In nature V is found more often than M, so we must somehow rescale with the background

• qM = 0.025, qV = 0.073• Finding 7% V is hence not significant, but 7% M highly

significant

A R N D C Q E G H I L K M F P S T W Y V1 0.08 0.06 0.02 0.03 0.02 0.02 0.03 0.08 0.02 0.08 0.11 0.06 0.04 0.06 0.02 0.09 0.04 0.01 0.04 0.082 0.04 0.01 0.01 0.01 0.01 0.01 0.02 0.02 0.01 0.11 0.44 0.02 0.06 0.03 0.01 0.02 0.05 0.00 0.01 0.103 0.08 0.04 0.05 0.07 0.02 0.03 0.03 0.08 0.02 0.05 0.11 0.03 0.03 0.06 0.04 0.06 0.05 0.03 0.05 0.074 0.08 0.05 0.03 0.10 0.01 0.05 0.08 0.13 0.01 0.05 0.06 0.05 0.01 0.03 0.08 0.06 0.04 0.02 0.01 0.055 0.06 0.04 0.05 0.03 0.01 0.04 0.05 0.11 0.03 0.04 0.09 0.04 0.02 0.06 0.06 0.04 0.05 0.02 0.05 0.086 0.06 0.03 0.03 0.03 0.03 0.03 0.04 0.06 0.02 0.10 0.14 0.04 0.03 0.05 0.04 0.06 0.06 0.01 0.03 0.137 0.10 0.02 0.04 0.04 0.02 0.03 0.04 0.05 0.04 0.08 0.12 0.02 0.03 0.06 0.07 0.06 0.05 0.03 0.03 0.088 0.05 0.07 0.04 0.03 0.01 0.04 0.06 0.06 0.03 0.06 0.13 0.06 0.02 0.05 0.04 0.08 0.07 0.01 0.04 0.059 0.08 0.02 0.01 0.01 0.02 0.02 0.03 0.02 0.01 0.10 0.23 0.03 0.02 0.04 0.01 0.04 0.04 0.00 0.02 0.25

Page 32: Sequence motifs,  and sequence logos, Neural networks

Weight matrices

• A weight matrix is given as

Wij = log(pij/qj)– where i is a position in the motif, and j an amino acid. q j is the background frequency for amino acid j.

• W is a L x 20 matrix, L is motif length

A R N D C Q E G H I L K M F P S T W Y V 1 0.6 0.4 -3.5 -2.4 -0.4 -1.9 -2.7 0.3 -1.1 1.0 0.3 0.0 1.4 1.2 -2.7 1.4 -1.2 -2.0 1.1 0.7 2 -1.6 -6.6 -6.5 -5.4 -2.5 -4.0 -4.7 -3.7 -6.3 1.0 5.1 -3.7 3.1 -4.2 -4.3 -4.2 -0.2 -5.9 -3.8 0.4 3 0.2 -1.3 0.1 1.5 0.0 -1.8 -3.3 0.4 0.5 -1.0 0.3 -2.5 1.2 1.0 -0.1 -0.3 -0.5 3.4 1.6 0.0 4 -0.1 -0.1 -2.0 2.0 -1.6 0.5 0.8 2.0 -3.3 0.1 -1.7 -1.0 -2.2 -1.6 1.7 -0.6 -0.2 1.3 -6.8 -0.7 5 -1.6 -0.1 0.1 -2.2 -1.2 0.4 -0.5 1.9 1.2 -2.2 -0.5 -1.3 -2.2 1.7 1.2 -2.5 -0.1 1.7 1.5 1.0 6 -0.7 -1.4 -1.0 -2.3 1.1 -1.3 -1.4 -0.2 -1.0 1.8 0.8 -1.9 0.2 1.0 -0.4 -0.6 0.4 -0.5 -0.0 2.1 7 1.1 -3.8 -0.2 -1.3 1.3 -0.3 -1.3 -1.4 2.1 0.6 0.7 -5.0 1.1 0.9 1.3 -0.5 -0.9 2.9 -0.4 0.5 8 -2.2 1.0 -0.8 -2.9 -1.4 0.4 0.1 -0.4 0.2 -0.0 1.1 -0.5 -0.5 0.7 -0.3 0.8 0.8 -0.7 1.3 -1.1 9 -0.2 -3.5 -6.1 -4.5 0.7 -0.8 -2.5 -4.0 -2.6 0.9 2.8 -3.0 -1.8 -1.4 -6.2 -1.9 -1.6 -4.9 -1.6 4.5

Page 33: Sequence motifs,  and sequence logos, Neural networks

• Score sequences to weight matrix by looking up and adding L values from the matrix

A R N D C Q E G H I L K M F P S T W Y V 1 0.6 0.4 -3.5 -2.4 -0.4 -1.9 -2.7 0.3 -1.1 1.0 0.3 0.0 1.4 1.2 -2.7 1.4 -1.2 -2.0 1.1 0.7 2 -1.6 -6.6 -6.5 -5.4 -2.5 -4.0 -4.7 -3.7 -6.3 1.0 5.1 -3.7 3.1 -4.2 -4.3 -4.2 -0.2 -5.9 -3.8 0.4 3 0.2 -1.3 0.1 1.5 0.0 -1.8 -3.3 0.4 0.5 -1.0 0.3 -2.5 1.2 1.0 -0.1 -0.3 -0.5 3.4 1.6 0.0 4 -0.1 -0.1 -2.0 2.0 -1.6 0.5 0.8 2.0 -3.3 0.1 -1.7 -1.0 -2.2 -1.6 1.7 -0.6 -0.2 1.3 -6.8 -0.7 5 -1.6 -0.1 0.1 -2.2 -1.2 0.4 -0.5 1.9 1.2 -2.2 -0.5 -1.3 -2.2 1.7 1.2 -2.5 -0.1 1.7 1.5 1.0 6 -0.7 -1.4 -1.0 -2.3 1.1 -1.3 -1.4 -0.2 -1.0 1.8 0.8 -1.9 0.2 1.0 -0.4 -0.6 0.4 -0.5 -0.0 2.1 7 1.1 -3.8 -0.2 -1.3 1.3 -0.3 -1.3 -1.4 2.1 0.6 0.7 -5.0 1.1 0.9 1.3 -0.5 -0.9 2.9 -0.4 0.5 8 -2.2 1.0 -0.8 -2.9 -1.4 0.4 0.1 -0.4 0.2 -0.0 1.1 -0.5 -0.5 0.7 -0.3 0.8 0.8 -0.7 1.3 -1.1 9 -0.2 -3.5 -6.1 -4.5 0.7 -0.8 -2.5 -4.0 -2.6 0.9 2.8 -3.0 -1.8 -1.4 -6.2 -1.9 -1.6 -4.9 -1.6 4.5

Scoring a sequence to a weight matrix

RLLDDTPEVGLLGNVSTVALAKAAAAL

Which peptide is most likely to bind?Which peptide second?

11.9 14.7 4.3

84nM 23nM 309nM

Page 34: Sequence motifs,  and sequence logos, Neural networks

Prediction accuracy

Pearson correlation 0.45

Prediction score

Measu

red

affi

nit

y

Page 35: Sequence motifs,  and sequence logos, Neural networks

Predictive performance

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

Pearsons correlation

CC 0.45 0.5 0.6 0.65 0.79

Simple Seq.W Seq.W+SCSeq.W+SC+PW

Large dataset

Page 36: Sequence motifs,  and sequence logos, Neural networks

Why we do bioinformatics: Data driven vs. ab initio methods

Limitations of Ab initio predictions of peptide binding to MHC class II molecules. Zhang H, Wang P, Papangelopoulos N, Xu Y, Sette A, Bourne PE, Lund O, Ponomarenko J, Nielsen M, Peters B. PLoS One. 2010 Feb 17;5(2):e9272.

Page 37: Sequence motifs,  and sequence logos, Neural networks

The Bio in Bioinformatics

• Data driven computer science methods (NNs, HMMs, Gibbs samplers etc.) have poor performance on protein datasets

• To give good performance they must• Be combined with information on

amino acid similarities (Dayhoff and followers)

• Take data set size (not enough), and composition (to similar) into account

Page 38: Sequence motifs,  and sequence logos, Neural networks

Good performance can be obtained from few data points

Lundegaard C, Nielsen M, Lamberth K, Worning P, Sylvester-Hvid C, Buus S, Brunak S, Lund O. 2004. MHC Class I Epitope Binding Prediction Trained on Small Data Sets. In ICARIS 2004. (eds. G. Nicosia, V. Cutello, P.J. Bentley, and J.I. Timmis),

Catania, Sicily.

Page 39: Sequence motifs,  and sequence logos, Neural networks

A

F

C

G

Lauemøller et al., 2000

Page 40: Sequence motifs,  and sequence logos, Neural networks

• Neural network

Page 41: Sequence motifs,  and sequence logos, Neural networks

• Neural network

Page 42: Sequence motifs,  and sequence logos, Neural networks

ExamplePeptide Amino acids of HLA pockets HLA Aff VVLQQHSIA YFAVLTWYGEKVHTHVDTLVRYHY A0201 0.131751SQVSFQQPL YFAVLTWYGEKVHTHVDTLVRYHY A0201 0.487500SQCQAIHNV YFAVLTWYGEKVHTHVDTLVRYHY A0201 0.364186LQQSTYQLV YFAVLTWYGEKVHTHVDTLVRYHY A0201 0.582749LQPFLQPQL YFAVLTWYGEKVHTHVDTLVRYHY A0201 0.206700VLAGLLGNV YFAVLTWYGEKVHTHVDTLVRYHY A0201 0.727865VLAGLLGNV YFAVWTWYGEKVHTHVDTLLRYHY A0202 0.706274VLAGLLGNV YFAEWTWYGEKVHTHVDTLVRYHY A0203 1.000000VLAGLLGNV YYAVLTWYGEKVHTHVDTLVRYHY A0206 0.682619VLAGLLGNV YYAVWTWYRNNVQTDVDTLIRYHY A6802 0.407855