iexec: blockchain-based fully distributed cloud computing

17
[email protected] [email protected] http://iex.ec Blockchain-based Fully Distributed Cloud Computing

Upload: gilles-fedak

Post on 12-Apr-2017

496 views

Category:

Software


0 download

TRANSCRIPT

Page 1: iExec: Blockchain-based Fully Distributed Cloud Computing

[email protected] [email protected] http://iex.ec

Blockchain-based Fully Distributed Cloud Computing

Page 2: iExec: Blockchain-based Fully Distributed Cloud Computing

The Promise of Ethereum

•  Dapps: Distributed Applications running on the Blockchain

How to satisfy compute/data-intensive DApps ?

Blockchain offer limited computing resources : storage is expensive, slow EVM, high tx latency etc.

Page 3: iExec: Blockchain-based Fully Distributed Cloud Computing

iEx.ec Objective

•  Provides Blockchain-based Distributed Applications access to the off-chain computing resources they need:

–  Computing resources (CPU, GPU, storage) –  Data access (remote storage) –  Applications (compute and/or data-intensive) –  Services (deployed as containers)

Page 4: iExec: Blockchain-based Fully Distributed Cloud Computing

Global Market for Computing Resources

Low cost, Secure, on Demand and Fully Distributed Cloud

Ethereum Blockchain

Page 5: iExec: Blockchain-based Fully Distributed Cloud Computing

Towards Distributed Cloud Computing

•  Benefits of Decentralizing Data-Centers.–  Be$erenergyefficiency–  Dataclosertotheuser

•  Example of next-gen Data-centers

•  Fog/Edge Computing5Gnetwork--In-networkstorageandprocessing

a)Rutgersb)S@mergyc)Qarnot

Page 6: iExec: Blockchain-based Fully Distributed Cloud Computing

Origin of the Technology : Desktop Grid Computing

Using Idle PCs on the Internet to Execute Parallel Applications :

• Maturetechnology

• Advancedfeatures:security,virtualiza@on,QoS

• Manyapplica@ons:Finance,Bio-medical,Chemistry,HighEnergyPhysicsetc…

• EuropeanDesktopGridInfrastructure

• h$p://[email protected]

[email protected]érin&G.Fedak,CRC/Chapmanandall

Page 7: iExec: Blockchain-based Fully Distributed Cloud Computing

XtremWeb XtremWeb-HEP

BitDew SpeQuloS

MapReduce

MPICH-V

2000

•  1st Internet P2P Global Computing Platform•  Bag-of Task Application•  Multi-users & multi-applications

•  Grid & Cloud•  Highly secure•  Virtualization•  Hybrid public/private Infrastructure

•  Parallel computing•  N-faults resilience

20012003

2008 20122010

•  Big Data•  1st Implementation of MapReduce for Internet Computing

•  Large Scale Data Management

•  QoS for Best-effort infrastructure

Building Distributed Cloud

>1M€ EU FP7, ANR funding, ≈100 papers publishedTens of users/applications: Finance, HEP, biomedical research…

Page 8: iExec: Blockchain-based Fully Distributed Cloud Computing

iEx.ec Experiments

ResourceManagementMiddleware(XtremWeb-HEP,BitDew)

EthereumBlockchain

DistributedCloud:Grid5K,SGmergy

ApplicaGons(non-blockchainbased)E-Fast

Page 9: iExec: Blockchain-based Fully Distributed Cloud Computing

Resource Management on the Blockchain

ResourceProvisioning

MarketManagementFramework

MatchmakingTask/Compu@ngresources

Mul@–CriteriaScheduling

Resultcer@fica@on

VerifiedFiletransfer

ResourcePublica@on

ResourceOntology

Page 10: iExec: Blockchain-based Fully Distributed Cloud Computing

E-FAST : E-Services Framework for Knowledge-bAsed Decision SupporT in

Finance

Service Oriented Platform:Integrated,advancedtoolstoanalyzefinancialmarketdata,high-levelservicesthatautoma@callyreacttomarketchangesandproposeinvestmentalterna@ves

Data and Computing-Intensive Methods:Text-mining,NeuralNetworksandGene@cAlgorithms,enhancedbyapplyingrelevantfindingsfromtheefficient-markettheorystudy.

Page 11: iExec: Blockchain-based Fully Distributed Cloud Computing

Selling E-FAST using iEx.ecCustomers access E-FAST services which uses iEx.ec for their execution: Onlypayforresourceswhenaservicehasbeensoldtoacustomer

Page 12: iExec: Blockchain-based Fully Distributed Cloud Computing

iExec Testbed

Grid5000FrenchInfrastructurededicatedforresearchindistributedsystems:• 9sites,1000nodes,8000cores• GPU,XeonPhi,SSD• 10Gbnetwork• Fullyreconfigurable(baremetalaccess)

Page 13: iExec: Blockchain-based Fully Distributed Cloud Computing

S@mergy:install10to100kWserverroomsinbuildingsandcouplingthemwiththeirhea@ngsystemtovalorise

theheatgeneratedbycomputerswhilegedngridofaircondi@onners

Using Stimergy servers as iEx.ec computing resources

Page 14: iExec: Blockchain-based Fully Distributed Cloud Computing

iEx.ec Architecture (Envisioned)

iEx.ecSidechain(Proof-of-ContribuGon)

EthereumBlockchain

DistributedCloud

Blockchain-basedDistributedApplicaGons(Dapps)

ResourceManagement(XtremWeb-HEP,BitDew,Gollem,…)

Sidechain for Cloud

• consensusbasedonoff-chainu@liza@onofresources(Proof-of-Contribu@on)• transcientinforma@on• specificworkload• par@alconsensus

Page 15: iExec: Blockchain-based Fully Distributed Cloud Computing

Proof-of-Contribution

Ensures that action that happen out of the blockchain leads to correct token transaction in the blockchain Example:execu@onofasetofcomputeintensivetask(Bag-of-Tasks)

Dapp Ethereum iEx.ecsidechain DistributedCloud

transac@on Selectresources/applica@ons Fetch&

executeBoT

Resultscer@fica@on

Feasability?:*AsynchronousRPC• GridCoin(h$p://www.gridcoin.us)• EthereumComputa@onMarketplace(seeGithub)• Reputa@on+Resultcer@fica@on(majorityvo@ng,spotchecking,blacklis@ng..)

contract

Page 16: iExec: Blockchain-based Fully Distributed Cloud Computing

Conclusion

iEx.ec: Greener & Smarter Cloud Computing

Page 17: iExec: Blockchain-based Fully Distributed Cloud Computing

Thanks to

Mircea Moca (Universitatea Babeș-Bolyai)

Oleg Lodygesnsky (IN2P3/CNRS/Univ. Paris XI)

DACA, Wanxiang Blockchain Lab

cryptofr slack team, chaintech, asseth