sc6 workshop 1: what can big data do for you?

WHAT CAN BIG DATA DO FOR YOU?Integrating Big Data, Software & Communities for Addressing Europe’s Societal Challenges

negative conotation

Big Data has often a

27-Nov-15 www.big-data-europe.eu

Big Data in Marketing


Big Data in Intelligence


BigDataEurope aims to help maximizing the societal value of Big Data

¥  Health, demographic change and wellbeing; ¥  Food security, sustainable agriculture and forestry, marine and

maritime and inland water research, and the Bioeconomy; ¥  Secure, clean and efficient energy; ¥  Smart, green and integrated transport; ¥  Climate action, environment, resource efficiency and raw

materials; ¥  Europe in a changing world - inclusive, innovative and

reflective societies; ¥  Secure societies - protecting freedom and security of Europe

and its citizens.


The three Big Data „V“ – Variety is often neglected

Quelle: Gesellschaft für Informatik

© Fraunhofer-Allianz Big Data 7

Proactive Maintenance at Rolls Royce

New Business Model integrating Sensor Data & Big Data Analytics

Dr. Dirk Hecker

Condition Monitoring, Proactive maintenance, „Power-by-the-hour“,

as-a-service Business Model – payment modell by flight hours

Quelle: www.springboeck.ch/SR_Technics.htm

© Mark Hillary | Flickr


The rolling Smartphone

New Business Models for the Automotive Industry with Data Value Chains

Dr. Dirk Hecker

Windshield wiper as rain sensors for micro wether prognosis

Automotive industry can become data provider for other industries

Que

lle: G

TÜ

Quelle: w

ww

.farming-sim

ulator.com


Predictive Analytics

Dr. Dirk Hecker

From Business Intelligence to Big Data Analytics

Business Intelligence Monitoring Predictive Analytics

What happened before? What happens now? What will happen

soon? What should

happen?

Prescriptive Analytics

„the last Mile“

“prescriptive analytics suggests decision options on how to take advantage of a future opportunity”

Quelle: BMW Quelle: www.7-forum.com Quelle: BMW Quelle: Volvo

BigDataEurope Rationale

¥  Show societal value of Big Data ¥  Lower barrrier for using big data technologies

o  Required effort and resources o  Limited data science skills o  Lack of Generic Architectures, components

¥  Help establishing cross-lingual/organizational/domain Data Value Chains o  Multiple Data Sources o  Required: Integration, Harmonisation


BigDataEurope: Objectives


COORDINATION Stakeholder Engagement (Requirements Elicitation)

SUPPORT Design, Realise, Evaluate

Big Data Aggregator Platform

Create and Manage Societal Big Data Interest Groups

Cloud-deployment ready

Big Data Aggregator Platform

CSA Measures

Results

Stakeholder Engagement Cycle

© Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS

Open-Source Technologies for Big Data Apps (small selection :-)

13


Big Data - Technologies

Volume

Velocity Variety

Storm

14


Batch Function

Speed Function

Data Storage

pages with postings

Batch View

Realtime View m

essa

ge p

assi

ng

message passing

Application

Horizontal Scalability in the Lambda Architecture

15

> volume

> users

> users, volume

> velocity > volume, velocity

Blueprint of the Data Aggregator Platform

¥  Follows typical Lambda Architecture

¥  Integrated on top of existing Big Data distribution ¥  + Semantic Layer (Retaining Semantics using LD approach )

Batch Layer

Speed Layer

Data Storage

Real-time data & Transactions …

Batch View

Real-time View m

essa

ge p

assin

g

message passing

Applications & Showcases

Real-time dashboards

Domain-specific BDE apps

Big Data Analytics In-stream Mining

BDE Platform

& Intelligence

Input data Stream Spatial Social Statistical Temporal Transactional Imagery

Data Aggregator Platform Challenges

¥  Ingest semantic (RDF) and non-semantic (CSV, JSON, XML, …) data o  Integrate various mapping techniques (R2RML, CSV on

the Web, JSON-LD)

¥  preserve semantics, provenance and metadata in Big Data processing chains o  Preserve URI/IRIs o  Preserve triples

¥  Exploit semantics for aggregations


Current Activities – Year#1

¥  2015 BDE Societal Workshops (7) Planned o  Schedule on Website

¥  7 W3C Interest Groups set up: Please Join! o  SC1: HEALTH https://www.w3.org/community/bde-health/join

o  SC2: FOOD & AGRICULTURE https://www.w3.org/community/bde-food/

o  SC3: ENERGY https://www.w3.org/community/bde-energy/

o  SC4: TRANSPORT https://www.w3.org/community/bde-transport/

o  SC5: CLIMATE & ENVIRONMENT https://www.w3.org/community/bde-climate/

o  SC6: SOCIETIES https://www.w3.org/community/bde-societies/

o  SC7: SECURITY https://www.w3.org/community/bde-secure-societies/

www.big-data-europe.eu

BDE Partners

Sören Auer Big Data Europe Coordinator Fraunhofer IAIS & University of Bonn [email protected]

Thanks


¥  Data ¥  Integration is a prerequisite, analytics ¥  Root cause analysis functioning like Human immune

system ¥  Incremental data processing (trends, changes) reduces

the load ¥  Data importance identification ¥  Big data appliance ¥  Medical images, clinical reports ¥  Semantics is a problem – evolving, community driven


Energy/Climate Example: Greenshifting


sc6 workshop 1: what can big data do for you?

Data & Analytics