cs5950 / cs6030 cloud, iot and big data - wmich.edu aws and gcp •elastic compute cloud (ec2)...

Cloud, IoT and Big Data 9/3/19

WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 1

CS5950 / CS6030 Cloud, IoT and Big Data

Ajay Gupta B239, CEAS

Computer Science Department Western Michigan University

ajay.gupta@wmich.edu 276-3104

WiSe Lab @ WMU www.cs.wmich.edu/wise

Cloud, IoT and Big Data 2019 1

Acknowledgements • I have liberally borrowed these slides and

material from a number of sources including – Web, AWS Educate – MIT, Harvard, UMD, UPenn, UCSD, UW, Clarkson, . .

. – Amazon, Google, IBM, Apache, ManjraSoft,

CloudBook, . . . • Thanks to original authors including Ives, Dyer,

Lin, Dean, Buyya, Ghemawat, Fanelli, Bisciglia, Kimball, Michels-Slettvet,…

• If I have missed any, its purely unintentional. My sincere appreciation to those authors and their creative mind.

WiSe Lab @ WMU www.cs.wmich.edu/wise

Cloud, IoT and Big Data 2

2009 Gartner IT Hype Cycle of Emerging Technologies

2007

2008

WiSe Lab @ WMU www.cs.wmich.edu/wise

13Cloud, IoT and Big Data

mailto:Ajay.gupta@wmich.edu

Cloud, IoT and Big Data 9/3/19

WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 2

2016 Gartner IT Hype Cycle of Emerging Technologies

2007

2008

WiSe Lab @ WMU www.cs.wmich.edu/wise

14Cloud, IoT and Big Data

2017 Gartner IT Hype Cycle of Emerging Technologies

2007

2008

WiSe Lab @ WMU www.cs.wmich.edu/wise

15Cloud, IoT and Big Data

Top 10 for 2010

WiSe Lab @ WMU www.cs.wmich.edu/wise

16Cloud, IoT and Big Data

Cloud, IoT and Big Data 9/3/19

WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 3

Top 10 for 2017 • Applied AI & Advanced Machine Learning • Intelligent Apps • Intelligent Things • Virtual and Augmented Reality • Digital Twins • Blockchain & Distributed Ledger • Conversational Systems • Mesh App & Service Architecture • Digital technology Pltforms • Adaptive Security Architecture

WiSe Lab @ WMU www.cs.wmich.edu/wise

17Cloud, IoT and Big Data

Gartner

Top 10 for 2018

WiSe Lab @ WMU www.cs.wmich.edu/wise

18Cloud, IoT and Big Data

Gartner

Defining Clouds: There are many views for what is cloud computing?

• Over 20 definitions: – http://cloudcomputing.sys-con.com/read/612375_p.htm

• A compromised definitionJ – "A Cloud is a type of parallel and distributed system consisting of

a collection of inter-connected and virtualised computers that are dynamically provisioned and presented as one or more unified computing resources based on service-level agreements established through negotiation between the service provider and consumers.”

• Keywords: Virtualisation (VMs), Dynamic Provisioning (negotiation and SLAs), and Web 2.0 access interface

WiSe Lab @ WMU www.cs.wmich.edu/wise

19Cloud, IoT and Big Data

http://cloudcomputing.sys-con.com/read/612375_p.htm

Cloud, IoT and Big Data 9/3/19

WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 4

Cloud Services • Infrastructure as a Service

(IaaS) – CPU, Storage: Amazon.com,

Nirvanix, GoGrid….

• Platform as a Service (PaaS) – Google App Engine, Microsoft

Azure, Manjrasoft Aneka..

• Software as a Service (SaaS) – SalesForce.Com

Infrastructure as a Service (IaaS)

Software as a Service (SaaS)

Platform as a Service (PaaS)

WiSe Lab @ WMU www.cs.wmich.edu/wise

20Cloud, IoT and Big Data

Clouds based on Ownership and Exposure

Private/Enterprise Clouds

Cloud computing model run within a company’s own Data Center / infrastructure for internal and/or partners use.

Public/Internet Clouds

3rd party, multi-tenant Cloud infrastructure & services:

* available on subscription basis (pay as you go)

Hybrid/Mixed Clouds

Mixed usage of private and public Clouds: Leasing public cloud services when private cloud capacity is insufficient

WiSe Lab @ WMU www.cs.wmich.edu/wise

21

(Promised) Benefits of (Public) Clouds

• No upfront infrastructure investment – No procuring hardware, setup, hosting, power, etc..

• On demand access – Lease what you need and when you need..

• Efficient Resource Allocation – Globally shared infrastructure, can always be kept busy by serving

users from different time zones/regions... • Nice Pricing

– Based on Usage, QoS, Supply and Demand, Loyalty, … • Application Acceleration

– Parallelism for large-scale data analysis, what-if scenarios studies… • High Availability, Scalable, and Energy Efficient • Supports Creation of 3rd Party Services & Seamless offering

– Builds on infrastructure and follows similar Business model as Cloud

WiSe Lab @ WMU www.cs.wmich.edu/wise

22Cloud Computing

Cloud, IoT and Big Data 9/3/19

WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 5

Cloud Computing Trends: 2015 State of the Cloud Survey

WiSe Lab @ WMU www.cs.wmich.edu/wise

Cloud, IoT and Big Data 23

Cloud Computing Trends: 2015 State of the Cloud Survey

WiSe Lab @ WMU www.cs.wmich.edu/wise

Cloud, IoT and Big Data 24

Cloud Computing Trends: 2015 State of the Cloud Survey

WiSe Lab @ WMU www.cs.wmich.edu/wise

Cloud, IoT and Big Data 25

http://www.rightscale.com/blog/cloud-industry-insights/cloud-computing-trends-2015-state-cloud-survey http://www.rightscale.com/blog/cloud-industry-insights/cloud-computing-trends-2015-state-cloud-survey http://www.rightscale.com/blog/cloud-industry-insights/cloud-computing-trends-2015-state-cloud-survey

Cloud, IoT and Big Data 9/3/19

WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 6

Cloud Computing Trends 2017-18 2017 State of the Cloud Survey

WiSe Lab @ WMU www.cs.wmich.edu/wise

Cloud, IoT and Big Data 26

Gartner: Top 10 technology trends businesses can't afford to ignore

WiSe Lab @ WMU www.cs.wmich.edu/wise

Cloud, IoT and Big Data 27

Technology Trends you can't afford to ignore http://www.gartner.com/webinar/1419114

http://www.firstpost.com/business/biztech/gartner-top-10-technology-trends-businesses-cant-afford-to-ignore-1993621.html

• Computing Everywhere • The Internet of Things • 3D Printing • Advanced, Pervasive and Invisible Analytics • Context-Rich Systems • Smart Machines • Cloud/Client Computing • Software-Defined Applications and Infrastructure • Web-Scale IT • Risk-Based Security and Self-Protection

When will Cloud spending become 50% of IT spending or reach to a several trillion $

business/year?

600?

2020?

30% 1000?

2020?

50%

Guestimate!WiSe Lab @ WMU www.cs.wmich.edu/wise

30Cloud, IoT and Big Data

http://www.rightscale.com/blog/cloud-industry-insights/cloud-computing-trends-2015-state-cloud-survey http://www.firstpost.com/business/biztech/gartner-top-10-technology-trends-businesses-cant-afford-to-ignore-1993621.html http://www.gartner.com/webinar/1419114

Cloud, IoT and Big Data 9/3/19

WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 7

Cloud Computing Challenges: Dealing with too many issues

Uhm, I am not quite clear…Yet another complex IT paradigm?

Virtu aliza

tion

QoS

Se rvi

ce Le

vel

Ag ree

me nts

Resource Metering

Billing

Pricin g

Provisioning on Demand

Utility & Risk Management

Scalability

Reliability

Energy Efficiency

Secu rity

Privacy

Trus t

Le ga

l &

Re gu

lat ory

Software Eng. Complexity

Programming Env. & Application Dev.

WiSe Lab @ WMU www.cs.wmich.edu/wise

31Cloud, IoT and Big Data

• Cloud Computing delivers computational resources on-demand as services that are commoditized and delivered comfortably analogous to traditional utilities such as electricity, gas, water and telephony. Cloud service offerings for compute, storage and communication resources as well as for hosted software and data are growing at a tremendous rate. It is essential to understand how to effectively transform these services into Utilities that provide value to both users and providers. There is also increasing interest from commercial providers to offer business and revenue models around the services they offer. Understanding how these models could be used to provide utility for users, intermediary brokers (aggregators) and providers is also an area of active research.

WiSe Lab @ WMU www.cs.wmich.edu/wise

Cloud, IoT and Big Data 32

What next?

• more on market oriented and technical view of cloud computing… and then onto basics…

• Course info

WiSe Lab @ WMU www.cs.wmich.edu/wise

33Cloud, IoT and Big Data

Cloud, IoT and Big Data 9/3/19

WiSe Lab @ WMU Ajay Gupta www.cs.wmich.edu/wise 8

What is the course about? • Application programming using clouds

– “toy and simple” programs • System issue