a biological smart platform for the environmental risk assessment

8

Click here to load reader

Upload: davide-nardone

Post on 22-Jan-2018

85 views

Category:

Data & Analytics


1 download

TRANSCRIPT

Page 1: A Biological Smart Platform for the Environmental Risk Assessment

A Biological Smart Platform for the Environmental Risk AssessmentDAVIDE NARDONE

Page 2: A Biological Smart Platform for the Environmental Risk Assessment

OverviewComponents

• Sensors (e.g., biosensors, enviromental sensors, etc.)• Web-of-Things (WoT) platform• Web Application

Data Analysis System• Aggregation, Analysis and Processing of data-stream (online or offline)

• Cloud and Distributed storage systems• Fuzzy Inference System (FIS)

Goals• Environmental Risk Assessment (ERA), by using qualitative and quantitative responses• Visualization and Sharing information among users

Page 3: A Biological Smart Platform for the Environmental Risk Assessment

Web of Things - Multitier Architecture

Things Sensors, Actuators, Devices

Connectivity Communications, Protocols, Networks

Global Infrastructure

Cloud, Data Center, Software

ApplicationWeb Application, Mobile Application,

Desktop Application

Data Ingestion Big Data, Harvest & Storage of “Thing” data

Data Analysis Soft computing, Mining, Machine Learning

Sensors – temperatures, humidity, water, etc.Actuators – switch, alarm, power, pressure, etc. Devices – mobile, tablets, cameras, etc.

Communication – Wi-Fi, LTE, Ethernet, etc. Protocols – HTTP, MQTT, DDS, etc.Networks – LAN, WAN

Cloud – Public, Private, Hybrid, Iaas, PaaS, Saas. Data Center – Google Cloud, Amazon, etc.Software – IoT Platforms, Dev Kits, APIs, etc.

Streaming, aggregation, data transfer, logging, monitoring, etc.

Modeling, feature extraction and selection, Fuzzy Logic, Visualization, Frameworks, etc.

Health Care, Environmental Monitoring, Environmental Risk Assessment, etc.

Page 4: A Biological Smart Platform for the Environmental Risk Assessment

1-2. Fog: Things and Connectivity

What is a Biosensors?• Analytical device which converts a biological

response into an electrical signals

Components1. Sensitive biological element2. Transducer or detector element3. Electronics and signal processors

Standard Communication Protocols:• WiFi• Bluetooth• RFID• etc.

IoT / WoT Communication Protocols:• MQTT (Message Queue Telemetry Transport)• XMPP (Extensible Messaging and Presence Protocol)• DDS (Data Distribution Service)• AMQP (Advanced Message Queuing Protocol)

Connectivity

Things

• The information may also come from other kind of sensors

Page 5: A Biological Smart Platform for the Environmental Risk Assessment

3.Cloud: Global Infrastructure• Cloud Computing: Model for enabling

ubiquitous, convenient, on-demand networkaccess to a shared pool of configurablecomputing resources (e.g. networks, servers,storage, applications and services).

Public Hybrid Private

SaaSSoftware as a Service

PaaSPlatform as a Service

IaaSInfrastructure as a ServiceLe

vel o

f A

bst

ract

ion

Economies of Scale

Flexibility o

f Pu

rpo

se

Control / Security

• Characteristics:1. On-demand self service2. Broad network access3. Resource pooling4. Rapid Elasticity5. Measured services6. Performace7. Reduced costs8. Reliability9. Multi-tenancy

Page 6: A Biological Smart Platform for the Environmental Risk Assessment

4.Analytics: Data IngestionDEF: A process of obtaining, importing and analyzing data for later use or storage in a database

Apache KafkaKafka is a distributed streaming platform useful for:

• Building real-time streaming data pipelines that reliably get data between systems or applications

Apache Spark StreamingSpark Streaming is an extension of the core Spark API that enables scalable, high-throughput, fault-tolerant streamprocessing of live data streams.

Data Sources

Producer

Producer

Producer

Data IngestionTopic

◾️◾️◾️◾️◾️◾️

◾️◾️◾️◾️◾️◾️

◾️◾️◾️◾️◾️◾️

◾️

◾️

◾️

Aggregation, Analysis and Processing of stream

Consumer

Consumer

Consumer

◾️

◾️

◾️

Spark Executors

◾️

◾️

◾️

Data AnalysisMllibSoft

Computing

Apache Kafka Apache Spark

Page 7: A Biological Smart Platform for the Environmental Risk Assessment

5.Analytics: Data AnalysisMachine Learning

Fuzzy Inference System

Fuzzifier

InferenceEngine

Defuzzifier

Database Rulebase

Knowledge base

Input Output

• Motivation: Modelling thecomplex relationshipsbetween several inputvariables.

• Reason: The ERA processis often performed onincomplete and imprecisedata.

• Feature extraction: PCA, ICA, etc.• Feature selection: Sparse and Redudant Representation (Compressed Sensing, SMRS, etc.)

Page 8: A Biological Smart Platform for the Environmental Risk Assessment

6.Decision: Web ApplicationThe main advantages of WA-based implementation are:• Cross-platform compatibility: WAs are platform independent, namely, the only requirement is a web

browser.• Lightweight: WAs require moderate disk space on the client (especially whether Cloud-oriented).• Integration: WAs integrate easily into other server-side web procedures, such as email and searching.• No upgrade needed: all new features are implemented on the server and automatically delivered to the

users.• Stability: users always run the up-to-date WA version and a failure in the WA does not affect the whole

user sytem.