bde sc1 workshop 3 - big data europe (simon scerri)
TRANSCRIPT
BIG DATA EUROPE PROJECT
SC1: Big Data in Health - Final Workshop13.12.2017
Stakeholder Engagement & Activities
M12M6 M18 M24 M30
Coordination & Support Action
2015-17
Where we started…
22-janv.-18www.big-data-europe.eu
Importance of Volume Importance of Velocity
Stakeholder Requirements (1)
Importance of Variety Efficiency of Data Infrastructures
Stakeholder Requirements (II)
Societal Data Value Chain Requirements
Major Results
22-janv.-18www.big-data-europe.eu
Watch: big-data-europe.eu/webinar/
7 Societal Communities
Bringing Communities closer
o Understanding common challenges & needs
o Defining Generic Big Data Architecture
Community Activities
o Yearly workshops (1 per SC)
o Hangouts (SC- specific), Webinars (technical,
general)
Identifying 7 Pilots, showcase value of BD
Platform
22-janv.-18www.big-data-europe.eu
BDE Integrator Platform
Released! Stacks Open Source solutions (Free)
Dockerization
Facilitates integration and
deployment
Plug-and-play BD Platform
Key BDE additions
o Support layer: integrated UI
o Semantification layer
Final Release:
o November 2017 22-janv.-18www.big-data-europe.eu
7 Integrator Platform Instances
22-janv.-18www.big-data-europe.eu
www.big-data-europe.eu/pilot/
Moving Forward…
22-janv.-18www.big-data-europe.eu
Big Data Platform
Open-Source Communityo Maintenance of BD components remains
independent
o Commitment from core BDE consortium team
o Maintenance driven by ‘users’
Users include follow-up projects:
o BigDataOcean, BETTER, NextGEOSS, Special..
Planned series of ‘Semantics in Big Data’
workshop
Standardisation efforts within BDVA
22-janv.-18www.big-data-europe.eu
Data Protection & Security Engineering & DevOps
Standards
Data Processing Architectures
Data Visualisation and User Interaction
Data Analytics
Data Management
Infrastructure Cloud, Communication (5G), HPC, IoT/CPS
Big D
ata Prio
rity Tech
Are
as
Sectors, Applications, Cross-cutting functions
Builds on
Forecasti
ng
SANS
A
Ontari
o
Positioning BigDataEurope into BDVA Ref.
Model
Resource
Management
Layer (Swarm)
Zeppelin
Support Layer
Init Daemon
GUIs
Monitor
App Layer
Forecasting Satellite Image
Analysis
Platform Layer
Spark Flink Semantic Layer
Ontario SANSA SemagrowKafka
Real-time Stream
Monitoring
...
...
Resource Management Layer (Swarm)
Hardware Layer
Premises Cloud (AWS, GCE, MS Azure, …)
Data Layer
Hadoop NOSQL Store CassandraElasticsearch ...RDF Store
Questions & Contacts
www.big-data-europe.eu
22-janv.-18#BigDataEurope
BIG DATA INTEGRATOR
www.github.com/big-data-europe
WEBINARS
big-data-europe.eu/webinar/
PILOT DESCRIPTIONS
https://www.big-data-europe.eu/pilot/
PROJECT COORDINATION (Fraunhofer IAIS)
Prof. Sören Auer, Dr. Simon Scerri, scerri © cs.uni-bonn · de
EIS Department, Fraunhofer IAIS & SDA Department Uni-Bonn,
Germany
BDE Input: Requirements,
Technical, Standardisation
IAIS leads the
Fraunhofer Big Data
Alliance