sc6 workshop 1: what can big data do for you?

Download SC6 Workshop 1: What can big data do for you?

Post on 13-Apr-2017

763 views

Category:

Data & Analytics

0 download

Embed Size (px)

TRANSCRIPT

  • WHAT CAN BIG DATA DO FOR YOU?Integrating Big Data, Software & Communities for Addressing Europes Societal Challenges

  • negative conotation

    Big Data has often a

    27-Nov-15 www.big-data-europe.eu

  • Big Data in Marketing

    27-Nov-15 www.big-data-europe.eu

  • Big Data in Intelligence

    27-Nov-15 www.big-data-europe.eu

  • BigDataEurope aims to help maximizing the societal value of Big Data

    Health, demographic change and wellbeing; Food security, sustainable agriculture and forestry, marine and

    maritime and inland water research, and the Bioeconomy; Secure, clean and efficient energy; Smart, green and integrated transport; Climate action, environment, resource efficiency and raw

    materials; Europe in a changing world - inclusive, innovative and

    reflective societies; Secure societies - protecting freedom and security of Europe

    and its citizens.

    27-Nov-15 www.big-data-europe.eu

  • The three Big Data V Variety is often neglected

    Quelle: Gesellschaft fr Informatik

  • Fraunhofer-Allianz Big Data 7

    Proactive Maintenance at Rolls Royce

    New Business Model integrating Sensor Data & Big Data Analytics

    Dr. Dirk Hecker

    Condition Monitoring, Proactive maintenance, Power-by-the-hour,

    as-a-service Business Model payment modell by flight hours

    Quelle: www.springboeck.ch/SR_Technics.htm

    Mark Hillary | Flickr

  • Fraunhofer-Allianz Big Data 8

    The rolling Smartphone

    New Business Models for the Automotive Industry with Data Value Chains

    Dr. Dirk Hecker

    Windshield wiper as rain sensors for micro wether prognosis

    Automotive industry can become data provider for other industries

    Que

    lle: G

    T

    Quelle: w

    ww

    .farming-sim

    ulator.com

  • Fraunhofer-Allianz Big Data 9

    Predictive Analytics

    Dr. Dirk Hecker

    From Business Intelligence to Big Data Analytics

    Business Intelligence Monitoring Predictive Analytics

    What happened before? What happens now?

    What will happen soon?

    What should happen?

    Prescriptive Analytics

    the last Mile

    prescriptive analytics suggests decision options on how to take advantage of a future opportunity

    Quelle: BMW Quelle: www.7-forum.com Quelle: BMW Quelle: Volvo

  • BigDataEurope Rationale

    Show societal value of Big Data Lower barrrier for using big data technologies

    o Required effort and resources o Limited data science skills o Lack of Generic Architectures, components

    Help establishing cross-lingual/organizational/domain Data Value Chains o Multiple Data Sources o Required: Integration, Harmonisation

    27-Nov-15 www.big-data-europe.eu

  • BigDataEurope: Objectives

    27-Nov-15 www.big-data-europe.eu

    COORDINATION Stakeholder Engagement (Requirements Elicitation)

    SUPPORT Design, Realise, Evaluate

    Big Data Aggregator Platform

    Create and Manage Societal Big Data Interest Groups

    Cloud-deployment ready

    Big Data Aggregator Platform

    CSA Measures

    Results

  • Stakeholder Engagement Cycle

  • Fraunhofer-Institut fr Intelligente Analyse- und Informationssysteme IAIS

    Open-Source Technologies for Big Data Apps (small selection :-)

    13

  • Fraunhofer-Institut fr Intelligente Analyse- und Informationssysteme IAIS

    Big Data - Technologies

    Volume

    Velocity Variety

    Storm

    14

  • Fraunhofer-Institut fr Intelligente Analyse- und Informationssysteme IAIS

    Batch Function

    Speed Function

    Data Storage

    pages with postings

    Batch View

    Realtime View m

    essa

    ge p

    assi

    ng

    message passing

    Application

    Horizontal Scalability in the Lambda Architecture

    15

    > volume

    > users

    > users, volume

    > velocity > volume, velocity

  • Blueprint of the Data Aggregator Platform

    Follows typical Lambda Architecture

    Integrated on top of existing Big Data distribution + Semantic Layer (Retaining Semantics using LD approach )

    Batch Layer

    Speed Layer

    Data Storage

    Real-time data & Transactions

    Batch View

    Real-time View m

    essa

    ge p

    assin

    g

    message passing

    Applications & Showcases

    Real-time dashboards

    Domain-specific BDE apps

    Big Data Analytics In-stream Mining

    BDE Platform

    & Intelligence

    Input data Stream Spatial Social Statistical Temporal Transactional Imagery

  • Data Aggregator Platform Challenges

    Ingest semantic (RDF) and non-semantic (CSV, JSON, XML, ) data o Integrate various mapping techniques (R2RML, CSV on

    the Web, JSON-LD)

    preserve semantics, provenance and metadata in Big Data processing chains o Preserve URI/IRIs o Preserve triples

    Exploit semantics for aggregations

    27-Nov-15 www.big-data-europe.eu

  • Current Activities Year#1

    2015 BDE Societal Workshops (7) Planned o Schedule on Website

    7 W3C Interest Groups set up: Please Join! o SC1: HEALTH https://www.w3.org/community/bde-health/join

    o SC2: FOOD & AGRICULTURE https://www.w3.org/community/bde-food/

    o SC3: ENERGY https://www.w3.org/community/bde-energy/

    o SC4: TRANSPORT https://www.w3.org/community/bde-transport/

    o SC5: CLIMATE & ENVIRONMENT https://www.w3.org/community/bde-climate/

    o SC6: SOCIETIES https://www.w3.org/community/bde-societies/

    o SC7: SECURITY https://www.w3.org/community/bde-secure-societies/

    www.big-data-europe.eu

  • BDE Partners

  • Sren Auer Big Data Europe Coordinator Fraunhofer IAIS & University of Bonn auer@cs.uni-bonn.de

    Thanks

    27-Nov-15 www.big-data-europe.eu

  • Data Integration is a prerequisite, analytics Root cause analysis functioning like Human immune

    system Incremental data processing (trends, changes) reduces

    the load Data importance identification Big data appliance Medical images, clinical reports Semantics is a problem evolving, community driven

    27-Nov-15 www.big-data-europe.eu

  • Energy/Climate Example: Greenshifting

    27-Nov-15 www.big-data-europe.eu