cs5950 / cs6030 cloud, iot and big data - wmich.edu aws and gcp •elastic compute cloud (ec2)...
Post on 28-May-2020
0 views
Embed Size (px)
TRANSCRIPT
Cloud, IoT and Big Data 9/3/19
WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 1
CS5950 / CS6030 Cloud, IoT and Big Data
Ajay Gupta B239, CEAS
Computer Science Department Western Michigan University
ajay.gupta@wmich.edu 276-3104
WiSe Lab @ WMU www.cs.wmich.edu/wise
Cloud, IoT and Big Data 2019 1
Acknowledgements • I have liberally borrowed these slides and
material from a number of sources including – Web, AWS Educate – MIT, Harvard, UMD, UPenn, UCSD, UW, Clarkson, . .
. – Amazon, Google, IBM, Apache, ManjraSoft,
CloudBook, . . . • Thanks to original authors including Ives, Dyer,
Lin, Dean, Buyya, Ghemawat, Fanelli, Bisciglia, Kimball, Michels-Slettvet,…
• If I have missed any, its purely unintentional. My sincere appreciation to those authors and their creative mind.
WiSe Lab @ WMU www.cs.wmich.edu/wise
Cloud, IoT and Big Data 2
2009 Gartner IT Hype Cycle of Emerging Technologies
2007
2008
WiSe Lab @ WMU www.cs.wmich.edu/wise
13Cloud, IoT and Big Data
mailto:Ajay.gupta@wmich.edu
Cloud, IoT and Big Data 9/3/19
WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 2
2016 Gartner IT Hype Cycle of Emerging Technologies
2007
2008
WiSe Lab @ WMU www.cs.wmich.edu/wise
14Cloud, IoT and Big Data
2017 Gartner IT Hype Cycle of Emerging Technologies
2007
2008
WiSe Lab @ WMU www.cs.wmich.edu/wise
15Cloud, IoT and Big Data
Top 10 for 2010
WiSe Lab @ WMU www.cs.wmich.edu/wise
16Cloud, IoT and Big Data
Cloud, IoT and Big Data 9/3/19
WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 3
Top 10 for 2017 • Applied AI & Advanced Machine Learning • Intelligent Apps • Intelligent Things • Virtual and Augmented Reality • Digital Twins • Blockchain & Distributed Ledger • Conversational Systems • Mesh App & Service Architecture • Digital technology Pltforms • Adaptive Security Architecture
WiSe Lab @ WMU www.cs.wmich.edu/wise
17Cloud, IoT and Big Data
Gartner
Top 10 for 2018
WiSe Lab @ WMU www.cs.wmich.edu/wise
18Cloud, IoT and Big Data
Gartner
Defining Clouds: There are many views for what is cloud computing?
• Over 20 definitions: – http://cloudcomputing.sys-con.com/read/612375_p.htm
• A compromised definitionJ – "A Cloud is a type of parallel and distributed system consisting of
a collection of inter-connected and virtualised computers that are dynamically provisioned and presented as one or more unified computing resources based on service-level agreements established through negotiation between the service provider and consumers.”
• Keywords: Virtualisation (VMs), Dynamic Provisioning (negotiation and SLAs), and Web 2.0 access interface
WiSe Lab @ WMU www.cs.wmich.edu/wise
19Cloud, IoT and Big Data
http://cloudcomputing.sys-con.com/read/612375_p.htm
Cloud, IoT and Big Data 9/3/19
WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 4
Cloud Services • Infrastructure as a Service
(IaaS) – CPU, Storage: Amazon.com,
Nirvanix, GoGrid….
• Platform as a Service (PaaS) – Google App Engine, Microsoft
Azure, Manjrasoft Aneka..
• Software as a Service (SaaS) – SalesForce.Com
Infrastructure as a Service (IaaS)
Software as a Service (SaaS)
Platform as a Service (PaaS)
WiSe Lab @ WMU www.cs.wmich.edu/wise
20Cloud, IoT and Big Data
Clouds based on Ownership and Exposure
Private/Enterprise Clouds
Cloud computing model run within a company’s own Data Center / infrastructure for internal and/or partners use.
Public/Internet Clouds
3rd party, multi-tenant Cloud infrastructure & services:
* available on subscription basis (pay as you go)
Hybrid/Mixed Clouds
Mixed usage of private and public Clouds: Leasing public cloud services when private cloud capacity is insufficient
WiSe Lab @ WMU www.cs.wmich.edu/wise
21
(Promised) Benefits of (Public) Clouds
• No upfront infrastructure investment – No procuring hardware, setup, hosting, power, etc..
• On demand access – Lease what you need and when you need..
• Efficient Resource Allocation – Globally shared infrastructure, can always be kept busy by serving
users from different time zones/regions... • Nice Pricing
– Based on Usage, QoS, Supply and Demand, Loyalty, … • Application Acceleration
– Parallelism for large-scale data analysis, what-if scenarios studies… • High Availability, Scalable, and Energy Efficient • Supports Creation of 3rd Party Services & Seamless offering
– Builds on infrastructure and follows similar Business model as Cloud
WiSe Lab @ WMU www.cs.wmich.edu/wise
22Cloud Computing
Cloud, IoT and Big Data 9/3/19
WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 5
Cloud Computing Trends: 2015 State of the Cloud Survey
WiSe Lab @ WMU www.cs.wmich.edu/wise
Cloud, IoT and Big Data 23
Cloud Computing Trends: 2015 State of the Cloud Survey
WiSe Lab @ WMU www.cs.wmich.edu/wise
Cloud, IoT and Big Data 24
Cloud Computing Trends: 2015 State of the Cloud Survey
WiSe Lab @ WMU www.cs.wmich.edu/wise
Cloud, IoT and Big Data 25
http://www.rightscale.com/blog/cloud-industry-insights/cloud-computing-trends-2015-state-cloud-survey http://www.rightscale.com/blog/cloud-industry-insights/cloud-computing-trends-2015-state-cloud-survey http://www.rightscale.com/blog/cloud-industry-insights/cloud-computing-trends-2015-state-cloud-survey
Cloud, IoT and Big Data 9/3/19
WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 6
Cloud Computing Trends 2017-18 2017 State of the Cloud Survey
WiSe Lab @ WMU www.cs.wmich.edu/wise
Cloud, IoT and Big Data 26
Gartner: Top 10 technology trends businesses can't afford to ignore
WiSe Lab @ WMU www.cs.wmich.edu/wise
Cloud, IoT and Big Data 27
Technology Trends you can't afford to ignore http://www.gartner.com/webinar/1419114
http://www.firstpost.com/business/biztech/gartner-top-10-technology-trends-businesses-cant-afford-to-ignore-1993621.html
• Computing Everywhere • The Internet of Things • 3D Printing • Advanced, Pervasive and Invisible Analytics • Context-Rich Systems • Smart Machines • Cloud/Client Computing • Software-Defined Applications and Infrastructure • Web-Scale IT • Risk-Based Security and Self-Protection
When will Cloud spending become 50% of IT spending or reach to a several trillion $
business/year?
600?
2020?
30% 1000?
2020?
50%
Guestimate!WiSe Lab @ WMU www.cs.wmich.edu/wise
30Cloud, IoT and Big Data
http://www.rightscale.com/blog/cloud-industry-insights/cloud-computing-trends-2015-state-cloud-survey http://www.firstpost.com/business/biztech/gartner-top-10-technology-trends-businesses-cant-afford-to-ignore-1993621.html http://www.gartner.com/webinar/1419114
Cloud, IoT and Big Data 9/3/19
WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 7
Cloud Computing Challenges: Dealing with too many issues
Uhm, I am not quite clear…Yet another complex IT paradigm?
Virtu aliza
tion
QoS
Se rvi
ce Le
vel
Ag ree
me nts
Resource Metering
Billing
Pricin g
Provisioning on Demand
Utility & Risk Management
Scalability
Reliability
Energy Efficiency
Secu rity
Privacy
Trus t
Le ga
l &
Re gu
lat ory
Software Eng. Complexity
Programming Env. & Application Dev.
WiSe Lab @ WMU www.cs.wmich.edu/wise
31Cloud, IoT and Big Data
• Cloud Computing delivers computational resources on-demand as services that are commoditized and delivered comfortably analogous to traditional utilities such as electricity, gas, water and telephony. Cloud service offerings for compute, storage and communication resources as well as for hosted software and data are growing at a tremendous rate. It is essential to understand how to effectively transform these services into Utilities that provide value to both users and providers. There is also increasing interest from commercial providers to offer business and revenue models around the services they offer. Understanding how these models could be used to provide utility for users, intermediary brokers (aggregators) and providers is also an area of active research.
WiSe Lab @ WMU www.cs.wmich.edu/wise
Cloud, IoT and Big Data 32
What next?
• more on market oriented and technical view of cloud computing… and then onto basics…
• Course info
WiSe Lab @ WMU www.cs.wmich.edu/wise
33Cloud, IoT and Big Data
Cloud, IoT and Big Data 9/3/19
WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 8
What is the course about? • Application programming using clouds
– “toy and simple” programs • System issue