social media health ads

Social Media Health Ads Joyce Chan

GoalTo simulate an ad network for pharmaceutical agencies in social media networks

Motivations1. Search on the stream

efficiently- ES percolate vs Luwak

2. Learn how to join streams

Demo

http://52.33.160.140:5601/app/kibana#/dashboard/adNetwork?_g=(refreshInterval:(display:Off,pause:!f,value:0),time:(from:'2016-02-02T18:38:09.659Z',mode:quick,to:'2016-02-03T04:05:25.438Z'))&_a=(filters:!(),options:(darkTheme:!f),panels:!((col:1,id:pharmas_that_pays_the_most,panelIndex:1,row:1,size_x:6,size_y:2,type:visualization),(col:7,id:pharmas_that_wins_the_most_breakdown_by_price,panelIndex:3,row:1,size_x:6,size_y:2,type:visualization),(col:1,id:Condition-Malaria,panelIndex:4,row:5,size_x:12,size_y:2,type:visualization),(col:1,id:'Condition:Psoriasis',panelIndex:5,row:3,size_x:12,size_y:2,type:visualization)),query:(query_string:(analyze_wildcard:!t,query:'*')),title:adNetwork,uiState:())

http://52.33.160.140:5601/app/kibana#/dashboard/adNetwork?_g=(refreshInterval:(display:Off,pause:!f,value:0),time:(from:'2016-02-02T18:38:09.659Z',mode:quick,to:'2016-02-03T04:05:25.438Z'))&_a=(filters:!(),options:(darkTheme:!f),panels:!((col:1,id:pharmas_that_pays_the_most,panelIndex:1,row:1,size_x:6,size_y:2,type:visualization),(col:7,id:pharmas_that_wins_the_most_breakdown_by_price,panelIndex:3,row:1,size_x:6,size_y:2,type:visualization),(col:1,id:Condition-Malaria,panelIndex:4,row:5,size_x:12,size_y:2,type:visualization),(col:1,id:'Condition:Psoriasis',panelIndex:5,row:3,size_x:12,size_y:2,type:visualization)),query:(query_string:(analyze_wildcard:!t,query:'*')),title:adNetwork,uiState:())

Pipeline

Spark Streaming

Luwak search

Join + Filter for Winning bid

Challenges

● spark streaming has high latencies especially when it comes to joining

● finding way to increase throughput by first sorting the join table by winning bid price

Joyce ChanUniversity of Toronto

B.Sc Computer Science & Math

● analytics and data engineer at health care startup

● full stack engineer for Sysomos

● full stack engineer for Granata Decisions Systems

● search & api engineer Mercatus

social media health ads

Data & Analytics