big data europe first sc5 hangout introduction
TRANSCRIPT
Empowering Communities with Data TechnologiesFraunhofer IAIS - coordinatorSC Workshops
BIG DATA EUROPE
The Motivation – Big Data
Every day, we create 2.5 quintillion bytes of data — so much that 90% of the data in the world today has been created in the last two years alone.
This data comes from everywhere: sensors used to gather climate information, posts to social media sites, digital pictures and videos, purchase transaction records, and cell phone GPS signals to name a few.
This data is big data. Source: IBM
Big Data: Dimensions
www.big-data-europe.eu
Volume
Velocity
Variety
10001010101010101010101001010010101010101001010010101001010010101001010010100101010010101010010101000101010101001010101010101010100101010101010100101010111000101010101010101010100101001010101010100101001010100101001010100101001010010101001010101001010100010101010100101010101
10001010101010101010101001010010101010101001010010
…….………….……………..……..……………
1 0
1000101010101010101010100101001010101010100101oo11
Veracity!
Big Data Dimensions
Health> ClimateEnergyTransportFoodSocietiesSecurity
Big Data in Europe: Challenges, Opportunities
www.big-data-europe.eu
Loremipsumdolors
KSDJOPSCKKSDKA
B
LKASJLLAWWD
S
wpweppepwpisio
we
10101001101010010101
0Data Sources
#1: Compile, Harmonise, Publish10101001101010010101
0
10101001101010010101
0
#2: Interlink, Centralise Access, Explore101010100101010101001011010001010101010010101010100001011010001010101010010101010100100101010100101010101001011010
001010
Bonn, DE
#3: Analyse, Discover, Visualise#4: Mashup, Cross-domain Exploitation
JournalistsCitizens Industry
Authorities
location
location
Weather Maps
ForecastsStatisticsMaritime Data
Data Value Chain Evolution
2 mai 2023www.big-data-europe.eu
Extraction, Curation Quality, Linking, Integration
Publication, Visualization, Analysis
Extraction, Curation, Quality, Linking, Integration, Publication,
Visualization, Analysis
HealthTransport
Security
Extraction Curation Quality Linking Integration Publication Visualization Analysis
Data Repositories Linked Open Data Cloud
Stage 1
Stage 2
Stage 3
Food SocietiesClimate Energy
Rationale Show societal value of Big Data Lower barrier for using big data
technologieso Required effort and resourceso Limited data science skills
Help establishing cross-lingual/organizational/domain Data Value Chains 2 mai 2023
BigDataEurope: Consortium
Stakeholder Engagement Cycle
Data Aggregator Platform: Blueprint
Batch Layer
Speed Layer
Data Storage
Real-time data &
Transactions …
Batch View
Real-time View
mes
sage
pas
sing
message passing
Applications & ShowcasesReal-time dashboardsDomain-specific BDE apps
Big Data AnalyticsIn-stream Mining
BDE Platform &
Intelligence
Input dataStreamSpatialSocialStatistical TemporalTransactionalImagery
+ Semantic Layer (Retaining Semantics using LD approach )
Lambda Architecture
Big Data & Transport Challenges
o We want to hear what you have to say!o Input for BD Aggregator Platform &
Components Opportunities
o We want to broaden your horizons!o We will provide free, useful, cutting-edge
BD tools. 2 mai 2023www.big-data-europe.eu