steel: simplified development and deployment of edge-cloud ... · steel: simplified development and...
TRANSCRIPT
![Page 1: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/1.jpg)
Shadi A. Noghabi 𝟏,𝟑, John Kolb 𝟐, Peter Bodik 𝟑, Eduardo Cuervo 𝟑
1. University of Illinois at Urbana-Champaign2. University California, Berkeley3. Microsoft Research
1
Steel: Simplified Development and Deployment of Edge-Cloud Applications
![Page 2: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/2.jpg)
Cloud Services Have Grown$383 Billion market by 2020 (20% annual growth) 1
-- increase in the number and variety of services
21. https: //www.gartner.com/newsroom/id/3815165
>170 services >130 services >70 servicesMany complex multi-service applications have emerged
![Page 3: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/3.jpg)
Growing Interest in the “Edge”
3
Edge 1
Edge 2
Edge 3
Cloud
![Page 4: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/4.jpg)
Growing Interest in the “Edge”
4
Why use the Edge?
• Latency: Edge is close by
• Cost: Reduced cost– network to cloud
– services in cloud
• Availability: Continuous
service despite disconnects
Edge 1
Edge 2
Edge 3
Cloud
![Page 5: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/5.jpg)
Industry at Infancy of Edge-Cloud
5
Complexmulti-serviceapplications
Cloud growth
Emerging Edge-Cloud
environments
Gap
Steel
![Page 6: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/6.jpg)
What is the Gap?
Many optional (in cloud-only) optimizations are crucial in the edge-cloud– More heterogeneity, more failures, limited resources.
– Placement, communication, load-balancing, etc.
→ Essential to readily move services & dynamically adapt
6
![Page 7: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/7.jpg)
However…•Configuring services is cumbersome and error-prone.
•Wide diversity & compatibility constraints in services.
•Optimizations are manual and non-reusable.
7
Steel: A simplified & unified edge cloud framework with modular and automated optimizations
Integrated with productionAzure services
![Page 8: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/8.jpg)
8
Steel
Abstraction (Logical Spec)
Compile DeployMonitor &
AnalyzeFabric
Placement Communication …Optimization Modules
Load Balancing
Applications
Edge-Cloud Ecosystem
AB
CD
![Page 9: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/9.jpg)
Abstraction & Fabric
Abstraction:1. Logical DAG of the application
– Main services & their connections
2. Location of each service
Fabric: physically materializing & connecting services
9
A
B
C
D
A: Edge 1, B: Cloud,…
![Page 10: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/10.jpg)
Optimization Modules
10
PlacementWhere (edge/cloud) to place?
From the large search space
Communicationconfigure edge-cloud links
Adapt to short-term spikes
Load BalancingWhere to move?
Adapt to long-term changes
…
![Page 11: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/11.jpg)
Optimizer Modules
11
PlacementWhere (edge/cloud) to place?
From the large search space
Communicationconfigure edge-cloud links
Adapt to short-term spikes
Load BalancingWhere to move?
Adapt to long-term changes
Added to Steel with ~500 lines of C# code
![Page 12: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/12.jpg)
Evaluation
12
![Page 13: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/13.jpg)
Experimental Setup
Compare many diverse real world applications:1. Data persisting
2. Predictive maintenance
3. BLE sensor analyzer
4. Factory monitoring
5. Statistic generator
6. Anomaly detector
13
![Page 14: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/14.jpg)
Initial Development Effort
14
0
100
200
300
400
Lin
es o
f C
on
figs
Steel current
Steel reducesconfig 1.7x to 4.8xvs. current system
![Page 15: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/15.jpg)
Modification Effort
15
2 4 6 8
0
50
100
150
200
Lin
es o
f C
on
fig
Steel current
Small, almost constantoverhead of ~ 2 lines
of config
![Page 16: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/16.jpg)
Conclusion
Steel: A unified edge cloud framework with modular and automated optimizations
16
Complex multi-serviceapplications
Cloud growth
Emerging Edge-cloud environments
Gap
• Simple Deployment• Easy Move & Adapt• Optimizations
![Page 17: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/17.jpg)
What is Next? What is Hard?
1.Cloud services offering Edge solutions
2.Will a general optimization work for most? How to easily customize?
3.Incorporate developer requirements like SLAs
4.What about security & privacy?
17
![Page 18: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/18.jpg)
Back up slides
18
![Page 19: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/19.jpg)
Cloud is Not an One-Size-Fits-All
19
Latency
< 80ms< 20ms
< 10 ms
…The Cloud is simply too far!
> 70 ms round trip time
![Page 20: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/20.jpg)
Cloud is Not an One-Size-Fits-All
20
Latency
< 80ms< 20ms
< 10 ms
…Y
Resources
… 10s – 100s GB/s
Bandwidth
BatteryEnergyHeating
Not enough resources to use the
Cloud
![Page 21: Steel: Simplified Development and Deployment of Edge-Cloud ... · Steel: Simplified Development and Deployment of Edge-Cloud Applications. Cloud Services Have Grown $383 Billion market](https://reader030.vdocuments.site/reader030/viewer/2022040913/5e89cedf5600293c2c636a77/html5/thumbnails/21.jpg)
Cloud is Not an One-Size-Fits-All
21
Latency
< 80ms< 20ms
< 10 ms
…Y
Resources
… 10s – 100s GB/s
Bandwidth
BatteryEnergyHeating
Privacy & Security
…