20140918 ceadar case study identitymatch_identifying persons of interest in social network_idiro and...

20
Copyright © CeADAR 2014 1 Copyright © CeADAR 2014 IdentityMatch: Identifying Persons of Interest in Social Networks Thursday 18 th September 2014, Dublin Tuesday 23 rd September 2014, Cork Dr. Oisín Boydell, CeADAR Aidan Connolly, Idiro Kevin Neary, ConnectorsMarketplace

Upload: irish-software-innovation-network

Post on 29-Nov-2014

83 views

Category:

Technology


1 download

DESCRIPTION

Common industry requirement: identifying people of interest in social networks.  CeADAR solution: Combine network based features with content analysis. Approach applied in two different industries on different data sources

TRANSCRIPT

Page 1: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 1 Copyright © CeADAR 2014

IdentityMatch: Identifying Persons of Interest in Social Networks Thursday 18th September 2014, Dublin Tuesday 23rd September 2014, Cork Dr. Oisín Boydell, CeADAR Aidan Connolly, Idiro Kevin Neary, ConnectorsMarketplace

Page 2: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 2

Research Theme

Social Identity Fingerprinting concerns identifying people of interest across social networks

Visualisation & Analytic Interfaces

• ‘Beyond the desktop’

• Ease of interaction

• Changing user behaviour

• Passive analytics

Data Management for Analytics

• Reduce data management effort for analytics

• Data validation

• Relevance of events to relationships

• Data curation (determining useful data)

• Adaptive ETL (Extract, Transform, Load)

Advanced Analytics

• Causation challenge

• Live topic monitoring

• Social trending and contextualisation

• Continuous analytics

• Social Identity fingerprinting

Page 3: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 3

Research Theme

This is a common analytics need within different industries and different types of data.

Social networks? – not just Twitter, Facebook, Google+ etc.

– Telecoms and communications data

– Financial transactions

– Other records of interactions between people or entities

Page 4: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 4

Research Theme

People of interest?

– Wide ranging and dependent on the domain

– Examples: • People with specific skills or expertise

• People exhibiting certain behaviors (fraud, churn, propensity to buy, multi-sim use etc.)

• Influencers in a particular area

• Bots and fake users

Page 5: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 5

Two project partners

Both from different industries with different sources of data, but both share a similar analytics need.

Project Partners

Page 6: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 6

Page 7: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 7

Challenge & Solution

• World class Irish researchers

• Low risk Rapid Prototyping

• Industry-led engagement

model

– easy & convenient

• Analyse Social Signals at Scale

• Convert large amount of raw data

to valuable information

• Integrate data from different

sources

Requirement: - Viable Business Tool

CeADAR Solution: - IdentityMatch Technology

Page 8: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 8

Aidan Connolly, CEO

Page 9: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 9

Idiro’s Reach

Idiro have analysed data for 12% of the world’s population!

Page 10: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 10

Contagion

Page 11: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 11

Samsung users

Apple users

Page 12: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 12

0

1000

2000

3000

4000

5000

6000

Operator Idiro

Marketing Campaign

Over 400% improvement

Page 13: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 13

Dual-SIM Behaviour

● Dual-SIM usage is a major challenge for many mobile operators. ● How can we identify dual-SIM users from non dual-SIM users? ● Enter CeADAR Research Project.

Page 14: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 14

CeADAR Platform Solution

Key approach: Combine both network based features with content analysis

Example network features: – How people are related in the social graph – Diversity of outgoing/incoming connections – Social influence

Example content analysis – Textual analysis of posts, links, profile description etc – Analysis of actions and patterns e.g. time of day of communication type, mobile

top-up amount and frequency etc.

Page 15: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 15

CeADAR Solution: ConnectorsMarketplace

ConnectorsMarketplace required an interactive user-facing solution to aid finding good ‘connectors’ with defined areas of expertise

Specific challenges:

– User friendly and intuitive

– Search over live data (Twitter)

– An iterative, supervised machine learning approach whereby selected results refine the system in further search iterations.

Page 16: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 16

CeADAR Solution: ConnectorsMarketplace

Page 17: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 17

CeADAR Solution: Idiro

Idiro required a solution that could leverage very faint signals in the data

Specific challenges:

– High volume telecoms data

– Ability to identify and exploit very faint signals and patterns to detect dual-sim users

Page 18: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 18

CeADAR Solution: Idiro

By applying machine learning techniques over many different features (both network and content based) we were able to detect dual-sim vs single-sim behavior with 63% accuracy.

?

Page 19: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 19

Conclusion

Common industry requirement: identifying people of interest in social networks

CeADAR solution: Combine network based features with content analysis

Approach applied in two different industries on different data sources

Page 20: 20140918 CeAdar Case Study Identitymatch_Identifying Persons of Interest in Social Network_Idiro and Connectorsmarketplace

Copyright © CeADAR 2014 20

Conclusion

Thanks to our project partners

CeADAR Advanced Analytics research team at UCD

– Dr Gerard Lynch, Dr Guangyu Wu, Dr Jing Su, Hodei Iraola, Dr Oisín Boydell