applications of big data techniques for social analytics

Applications of Big Data Techniques for Social Analytics

Dr. Dickson Lukose

Data Deluge

2

80%

20%

VIDEO IMAGE TEXT

VOICE

ENTERPRISE

IOT

Big Data Summit 2017

Data Deluge: Why?

3Big Data Summit 2017

Convergence

4

Artificial Intelligence

Algorithms

Big Data Summit 2017

Data Lake (Data Swamp) vs Semantic Data Lake

5

DATA LAKE

5

Enterprise Data

Sensor Web

Structured, Semi-Structured & Unstructured

Unstructured (Structured) Structured & Semi-Structured

Structured

Linked Open Data

CRAWLERS DATA HARVESTERS

WE

B

KNOWLEDGE

HA

RV

ES

TE

R

DA

TA

INGESTION ENGINE

Social Media

?DATA

SWAMPSEMANTIC

DATA LAKE

HARMONIZATION

CLEANSINGF

US

ION

DE

DU

PL

ICA

TIO

N

Big Data Summit 2017

Big Data Analytics (BDA) Infrastructure

6Big Data Summit 2017

Social Analytics

Sentiment Analytics Social Network Analytics

Anxiety Analytics Cluster Analytics

Personality Analytics Connector Analytics

Emotion Analytics Influencer Analytics

Concern Analytics Association Analytics

• Social Analytics is an umbrella term that includes a number of specialized analysis techniques, such as social filtering, social network analysis, social channel analysis, sentiment analysis and social media analytics.

• GCS Agile can perform the following big-data analytics:

•To-date, some of the areas this technology been applied to are listed below:

• Monitoring chatter in the Network of People

• Analysing chatter on Public Listed Companies

• Analysing personality, strengths and weakness of Individuals

• Analysing chatter among citizens on Public Services

• Analysing consumer chatter on specific Produce and Service

• Analysing public chatter on Crime in Specific Location.

• Analysing public chatter on specific Prominent People.

Big Data Summit 2017

Social Media Intelligence Process

Big Data Summit 2017

9

Raw Data

Cleansed Data

Relevant Data

Subjectivity Analytics

Statistical Analytics

Insights

Plain raw text

Preprocessed text (remove unwanted text,

characters, symbols)

Relevant data in the context of the topic of

interest

Sentiments, Emotions, Anxiety and

Personality from the relevant data

Statistical analysis to find top servers,

geographic data

Interactive visualization to generate insights

Domain/Context

Ontology

Social Media Intelligence Activities

Big Data Summit 2017

Social Media Intelligence (Interactive Visualization)

10Big Data Summit 2017

11

Social Media Intelligence (Interactive Visualization)

Big Data Summit 2017

12

Raw Data

Cleansed Data

Relevant Data

Network Analytics

Geospatial Analysis

Insights

Harvesting

Cleansing

Filtering

Social

Network

Analytics

Social Network Analytics Process

NETWORK

CLUSTERING ASSOCIATION

INFLUENCERSCONNECTORS

POPULARITY

Big Data Summit 2017

13

Plain raw text

Preprocessed text (remove unwanted text,

characters, symbols)

Relevant data in the context of the topic of

interest

Build relations network and social network

analytics from the relevant data

Interactive visualization to generate insights

Geospatial analysis for displaying social

media content

Raw Data

Cleansed Data

Relevant Data

Network

Analytics

Geospatial Analysis

Insights

Social Network Analytics Activities

Domain/Context

Ontology

Big Data Summit 2017

Social Network Analytics (Visual Analytics)

14Big Data Summit 2017

15

Social Network Analytics (Visual Analytics)

Dr. Dickson Lukose (PhD)

GCS Agile Pty. Ltd.

Level 10, 461 Bourke Street

Melbourne, VIC 3000

Australia

Email: dlukose@gcsagile.com.au

Phone: +61408510817