applications of big data techniques for social analytics
TRANSCRIPT
Applications of Big Data Techniques for Social Analytics
Dr. Dickson Lukose
Data Deluge
2
80%
20%
VIDEO IMAGE TEXT
VOICE
ENTERPRISE
IOT
Big Data Summit 2017
Data Deluge: Why?
3Big Data Summit 2017
Convergence
4
Artificial Intelligence
Algorithms
Big Data Summit 2017
Data Lake (Data Swamp) vs Semantic Data Lake
5
DATA LAKE
5
Enterprise Data
Sensor Web
Structured, Semi-Structured & Unstructured
Unstructured (Structured) Structured & Semi-Structured
Structured
Linked Open Data
CRAWLERS DATA HARVESTERS
WE
B
KNOWLEDGE
HA
RV
ES
TE
R
DA
TA
INGESTION ENGINE
Social Media
?DATA
SWAMPSEMANTIC
DATA LAKE
HARMONIZATION
CLEANSINGF
US
ION
DE
DU
PL
ICA
TIO
N
Big Data Summit 2017
Big Data Analytics (BDA) Infrastructure
6Big Data Summit 2017
Social Analytics
Sentiment Analytics Social Network Analytics
Anxiety Analytics Cluster Analytics
Personality Analytics Connector Analytics
Emotion Analytics Influencer Analytics
Concern Analytics Association Analytics
• Social Analytics is an umbrella term that includes a number of specialized analysis techniques, such as social filtering, social network analysis, social channel analysis, sentiment analysis and social media analytics.
• GCS Agile can perform the following big-data analytics:
•To-date, some of the areas this technology been applied to are listed below:
• Monitoring chatter in the Network of People
• Analysing chatter on Public Listed Companies
• Analysing personality, strengths and weakness of Individuals
• Analysing chatter among citizens on Public Services
• Analysing consumer chatter on specific Produce and Service
• Analysing public chatter on Crime in Specific Location.
• Analysing public chatter on specific Prominent People.
Big Data Summit 2017
Social Media Intelligence Process
Big Data Summit 2017
9
Raw Data
Cleansed Data
Relevant Data
Subjectivity Analytics
Statistical Analytics
Insights
Plain raw text
Preprocessed text (remove unwanted text,
characters, symbols)
Relevant data in the context of the topic of
interest
Sentiments, Emotions, Anxiety and
Personality from the relevant data
Statistical analysis to find top servers,
geographic data
Interactive visualization to generate insights
Domain/Context
Ontology
Social Media Intelligence Activities
Big Data Summit 2017
Social Media Intelligence (Interactive Visualization)
10Big Data Summit 2017
11
Social Media Intelligence (Interactive Visualization)
Big Data Summit 2017
12
Raw Data
Cleansed Data
Relevant Data
Network Analytics
Geospatial Analysis
Insights
Harvesting
Cleansing
Filtering
Social
Network
Analytics
Social Network Analytics Process
NETWORK
CLUSTERING ASSOCIATION
INFLUENCERSCONNECTORS
POPULARITY
Big Data Summit 2017
13
Plain raw text
Preprocessed text (remove unwanted text,
characters, symbols)
Relevant data in the context of the topic of
interest
Build relations network and social network
analytics from the relevant data
Interactive visualization to generate insights
Geospatial analysis for displaying social
media content
Raw Data
Cleansed Data
Relevant Data
Network
Analytics
Geospatial Analysis
Insights
Social Network Analytics Activities
Domain/Context
Ontology
Big Data Summit 2017
Social Network Analytics (Visual Analytics)
14Big Data Summit 2017
15
Social Network Analytics (Visual Analytics)
Dr. Dickson Lukose (PhD)
GCS Agile Pty. Ltd.
Level 10, 461 Bourke Street
Melbourne, VIC 3000
Australia
Email: [email protected]
Phone: +61408510817