how can we take advantage of cloud computing & big data?
DESCRIPTION
How can we take advantage of Cloud computing & big data?. Jordi Torres. Mobile Business & Apps Design master degree at UPC Talent School of Professional and Executive Development. Barcelona, February 2013TRANSCRIPT
![Page 1: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/1.jpg)
HOW CAN WE TAKE ADVANTAGE OF CLOUD COMPUTING & BIG DATA?
Jordi TorresUPC-BSC, February - 2013
MOBILE BUSINESS & APPSDESIGN MASTER DEGREE
![Page 2: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/2.jpg)
CONTENT
1. New Business models2. How do we get here?3. What is Cloud Computing?4. What is Big Data?5. An opportunity for you
![Page 3: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/3.jpg)
YESTERDAY’S BUSINESSFo
to: D
esig
nedI
nBar
celo
na.c
om
![Page 4: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/4.jpg)
TODAY’S BUSINESS
![Page 5: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/5.jpg)
OR NOT?
![Page 6: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/6.jpg)
IS MUSIC A BUSINESS?
![Page 7: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/7.jpg)
BON JOVIEx
empl
ede
Jos
ep V
alor
(IE
SE)
, 20
11
The most downloadesThe best-selling
20101986
![Page 8: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/8.jpg)
BON JOVIEx
empl
ede
Jos
ep V
alor
(IE
SE)
, 20
11
Sold: 28.000.000
![Page 9: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/9.jpg)
BON JOVIEx
empl
ede
Jos
ep V
alor
(IE
SE)
, 20
11
Sold: 28.000.000 Sold: ?
![Page 10: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/10.jpg)
BON JOVIEx
empl
ede
Jos
ep V
alor
(IE
SE)
, 20
11
Revenues: 30.000.000$Concerts tour 2010Revenues: 70.000.000$
![Page 11: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/11.jpg)
BON JOVIEx
empl
ede
Jos
ep V
alor
(IE
SE)
, 20
11
Revenues: 30.000.000$Concerts tour 2010Revenues: 70.000.000$
The business model changed!
![Page 12: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/12.jpg)
THE BUSINESS MODEL
from physical movement to the movement of information
Courtesy: D
ani Urgell –
CIS
CODesintermediation
music: Itunes, spotifybooks: Amazoneducation: e-learning UOC, MITtravels: eDreamsRetail: Zara. . .
The businessmodel changed!
![Page 13: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/13.jpg)
WHERE DATA ARE STORED?
![Page 14: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/14.jpg)
WHERE DATA ARE STORED?Sou
rce:
App
le.c
om.
201
1
![Page 15: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/15.jpg)
INTO CLOUD COMPUTING!
![Page 16: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/16.jpg)
CLOUD COMPUTING
It’s here to stay
![Page 17: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/17.jpg)
CLOUD FORECAST
Source: http://softwarestrategiesblog.com/2012/01/17/roundup-of-cloud-computing-forecasts-and-market-estimates-2012/
Gartner is predicting that the IaaS market to grow by 47.8% through 2015.
IaaSAccording to IDC, by 2015, about 24% of all new business software purchases will be of service‐enabled software with SaaS delivery being 13.1% of worldwide software spending.
SaaS
![Page 18: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/18.jpg)
CLOUD FORECAST
Workload processed in the Cloud
Source: CISCO
http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns1175/Cloud_Index_White_Paper.pdf
![Page 19: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/19.jpg)
CONTENT
1. New Business models2. How do we get here?3. What is Cloud Computing?4. What is Big Data?5. An opportunity for you
![Page 20: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/20.jpg)
HOW DO WE GET HERE?
Pilot ACE, UK.1950
![Page 21: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/21.jpg)
EVERY 15 YEARS …
1950 2012
That has redefined IT and industry in general
TIC
A major technological jump in IT
![Page 22: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/22.jpg)
MAINFRAMES
1950 1980 201019951965 2025
Mainframes
![Page 23: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/23.jpg)
PERSONAL COMPUTERS
1950 1980 201019951965 2025
Mainframes
Personal
Computers
![Page 24: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/24.jpg)
INTERNET
1950 1980 201019951965 2025
Mainframes
Personal
Computers
Internet
![Page 25: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/25.jpg)
INDUSTRIALIZATION OF IT
1950 1980 201019951965 2025
Mainframes
Personal
Computers
Internet
Huge Data Centers
![Page 26: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/26.jpg)
HUGE DATA CENTERS
28.000 m2
Source: http://www.fa
cebo
ok.com
/med
ia/
set/?set=a.190
8426
2096
5185
.470
08.140
3752
8934
5252
40 Mw
![Page 27: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/27.jpg)
HUGE DATA CENTERSFoto: G
oogle
![Page 28: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/28.jpg)
HUGE DATA CENTERSFoto: G
oogle
> football pitch x 4
![Page 29: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/29.jpg)
HUGE DATA CENTERSFo
to: c
orte
sía
BSC
Industrializaton of IT: has arrived!
![Page 30: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/30.jpg)
Source: http://www.google.com/about/datacenters/gallery/images
![Page 31: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/31.jpg)
Source: http://www.google.com/about/datacenters/gallery/images
![Page 32: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/32.jpg)
Source: http://www.google.com/about/datacenters/gallery/images
![Page 33: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/33.jpg)
CONTENT
1. New Business models2. How do we get here?3. What is Cloud Computing?4. What is Big Data?5. An opportunity for you
![Page 34: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/34.jpg)
IT AS A SERVICE
Cloud Computing represents a majorchange in IT servicearchitecture, deliveryand consumption
Foto
: J.T
.
![Page 35: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/35.jpg)
IT AS A SERVICE
Amazon Data Center
Foto: Tutorial SC2011 - Robert Grossman
(*) IaaS
![Page 36: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/36.jpg)
IT AS A SERVICE
More flexible IT, which can adapt to businesses and where costs can be predicted
On-demand self-service
Rapid elasticity
Ubiquitous access
. . . .
Pay per use
![Page 37: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/37.jpg)
EXAMPLE: WORKLOAD
![Page 38: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/38.jpg)
SYSTEM CAPACITY
Demand
Time
Res
ourc
es
Capacity
![Page 39: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/39.jpg)
RESOURCES NOT USED
Demand
Time
Res
ourc
es
CapacityResourcesnot used
![Page 40: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/40.jpg)
WASTE OF RESOURCES
Demand
Time
Res
ourc
es
Capacity€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€€ €€€€€€€€€€€€ €€€€€€€€€ €€€€€€€€€€ €€€€€€€ €€€€€€€€ €€€€€ €€€€€€ €€€€ €€€€ €€
€€€ €
![Page 41: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/41.jpg)
CUSTOMER BEHAVIOR
Res
ourc
es
Demand
Capacity
Time (days)
1 2 3
![Page 42: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/42.jpg)
CUSTOMER BEHAVIOR
Res
ourc
es
Demand
Capacity
Time (days)
1 2 3
![Page 43: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/43.jpg)
CLOUD COMPUTING ELASTICITY
Demand
Capacity
Time
Res
ourc
es
![Page 44: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/44.jpg)
AGILITY FOR SUPPLYINGvs in‐house data center
Foto
s: c
orte
sía
BSC
![Page 45: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/45.jpg)
TYPES OF CLOUDS
Software as a Service (SaaS)
Plataforma as a Service (PaaS)
Infraestructura as a Service (IaaS)
![Page 46: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/46.jpg)
TYPES OF CLOUDS
models of service delivery
Server
Apps
VM
Frameworks
PaaS SaaS
Server
Apps
VM
Frameworks
IaaS
Server
Apps
VM
Frameworks
Tradicional
Server
Apps
VM
Frameworks
![Page 47: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/47.jpg)
INFRAESTRUCTURE AS A SERVICE
Idea : Tutorial SC2011 - Robert Grossman
1 computer in a rack for 120 hours 120 computers in three
racks for 1 hour
![Page 48: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/48.jpg)
Ex IaaS: Amazon Web Services
To create an AWS account go to http://aws.amazon.comTo launch an instance go to
![Page 49: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/49.jpg)
GET STARTED WITH EC2
Follow the Wizard
![Page 50: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/50.jpg)
CONNECT TO INSTANCE
e.g. SSH
![Page 51: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/51.jpg)
TERMINATE INSTANCE
As soon as your instance starts to boot, you're billed for each hour or partial hour that you keep the instance running (even if the instance is idle). When you've decided that you no longer need the instance, you can terminate it.
![Page 52: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/52.jpg)
CLOUD COMPUTING INHIBITORS
Security Privacy Lack of Standards
Data Integrity Regulatory Data
Recovery
Control VendorMaturity ...
![Page 53: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/53.jpg)
CLOUD COMPUTING TODAY
CLOUD
Enterprise resourcesData+ Programs + Hardware
Sep 2011User
electronic devices with identification/computing/storage/communication capabilities
![Page 54: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/54.jpg)
CLOUD COMPUTING TODAY
PRIVATE CLOUDPUBLIC CLOUD
Enterprise resourcesData+ Programs + Hardware
User
electronic devices with identification/computing/storage/communication capabilities
![Page 55: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/55.jpg)
HYBRID CLOUD
Workload
![Page 56: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/56.jpg)
HYBRID CLOUD
capacity
Workload
![Page 57: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/57.jpg)
HYBRID CLOUD
capacity
![Page 58: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/58.jpg)
HYBRID CLOUD
External Provider
![Page 59: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/59.jpg)
EVERYTHING AS A SERVICE
IaaSPaaSSaaS
XaaSDRaaS
SUaaSBDaaS…
![Page 60: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/60.jpg)
CLOUD CAN DRIVE BUSINESS INNOVATIONFo
to: D
esig
nedI
nBar
celo
na.c
om
Taking cost out of company Improve business processes and operational effectiveness Using the cloud to enable new business models
![Page 61: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/61.jpg)
SUMMARY
Sou
rce:
Sec
urity
Gui
danc
e fo
r Critic
al A
reas
of
Focu
s in
Clo
ud
Com
putin
g ,
Apr
il 20
09.
Clo
ud S
ecur
ity A
llian
ce.
Hundreds ofcompanieson stage
![Page 62: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/62.jpg)
CONTENT
1. New Business models2. How do we get here?3. What is Cloud Computing?4. What is Big Data?5. An opportunity for you
![Page 63: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/63.jpg)
TODAY
![Page 64: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/64.jpg)
EVERYBODY CONNECTED
4th year ESO secondary school:100% of students on Facbook
http
://w
ww.
sear
chen
gine
jour
nal.c
om/th
e-gr
owth
-of-s
ocia
l-med
ia-a
n-in
fogr
aphi
c/32
788
![Page 65: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/65.jpg)
A MOBILE FUTURE
http://money.cnn.com/2011/02/09/technology/smartphones_eclipse_pcs/index.htm
![Page 66: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/66.jpg)
INTERNET OF THINGS
Not only will we have mobile devices, but also
http://www.urbiotica.com
![Page 67: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/67.jpg)
INTERNET OF THINGShttp://dow
nload.intel.com/new
sroom/kits/em
bedded/pdfs/ECG
_WhitePaper.pdf
![Page 68: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/68.jpg)
OPEN DATA
![Page 69: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/69.jpg)
BIG DATA?Do you need a definition? is data that becomes large
enough that it cannot be processed using conventional methods.
enough for you? :-)
Deluge of data created dailysocial networks, mobile phones, sensors, science, …
Source:http://www.datacenterknowledge.com/archives/2011/06/28/digital-universe-to-add-1-8-zettabytes-in-2011/?utm-source=feedburner&utm-medium=feed&utm-campaign=Feed:+DataCenterKnowledge+%28Data
![Page 70: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/70.jpg)
“CHULETA”
1 Gigabyte (GB) = 1.000.000.000 byte1 Terabyte (TB) = 1.000 Gigabyte (GB)1 Petabyte (PB) = 1.000.000 Gigabyte (GB)1 Exabyte (EB) = 1.000.000.000 Gigabyte (GB)1 Zettabyte (ZB) = 1.000.000.000.000 (GB)
![Page 71: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/71.jpg)
DEFINING BIG DATA
A more complete definition of Big Data is one that combines three attributes of data:
Source: IBM Book –
Understanding
Big Data
![Page 72: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/72.jpg)
DEFINING BIG DATA
Volume: Large Volumes of data Terabytes, Petabytes, … Data that cannot be stored in conventional RDBMS
Variety Source data is diverse – Web Logs, Application Logs,
Machine generated data, Social network data, etc. Doesn't fall into neat relational structures – Unstructured,
Semi-structured Velocity Streaming data, Complex Event Processing data Velocity of incoming data and Speed of responding to it
![Page 73: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/73.jpg)
WHY IS BIG DATA IMPORTANT
60%Potential increase in retailers
operating margins possible with big data
(*) Source: Big Data: The next frontier for innovation, competition and productivity – Mckinsey Global Institute, July 2011
40% projected growth in global data generated per year vs
5% projected growth in global IT spending
![Page 74: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/74.jpg)
WHY IS BIG DATA IMPORTANT
Data is more important than ever, but the exponential growth of data has overwhelmed most company's ability to manage (and monetize it).
Big Data Challenges Processing such large data sets Storing and Managing Analyzing …
![Page 75: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/75.jpg)
assume 100MB/sec
Storage affordable
![Page 76: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/76.jpg)
assume 100MB/sec
But scanning disks…
![Page 77: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/77.jpg)
assume 100MB/sec more than 5 hours
But scanning disks…
![Page 78: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/78.jpg)
assume 20.000 disks: scanning 2 TB takes 1 second
Source: http://www.google.com/about/datacenters/gallery/images/_2000/IDI_018.jpg
SOLUTION: MASSIVE PARALLELISM
![Page 79: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/79.jpg)
assume 20.000 disks: scanning 2 TB takes 1 second
Source: http://www.google.com/about/datacenters/gallery/images/_2000/IDI_018.jpg
Rethinking data processing is required: MapReduce, …
DATA PROCESSING CHALLENGES
![Page 80: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/80.jpg)
DATA STORAGE CHALLENGES
New Storage technologies are required
RAM vs HHD
Present solutions:
Research:
HHD 100 cheaper than RAMBut 1000 times slower
Solid- state drive (SSD)Not volatile
80
Storage Class Memory (SCM)
![Page 81: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/81.jpg)
Source: gigaom.com/cloud/big‐data‐and‐nosql‐march‐to‐the‐enterprise/
Relational DB can’t support everything:
NoSQL, …
DATA MANAGEMENT CHALLENGES
![Page 82: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/82.jpg)
Solution: the so called “NoSQL systems”
BASE property is sometimes attributed to them(Basically Available, Soft state, Eventual consistency)
Example eventual consistency: Facebook!
DATA MANAGEMENT
82
![Page 83: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/83.jpg)
Data deluge, is it enough?
![Page 84: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/84.jpg)
“Data = Information”?
![Page 85: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/85.jpg)
prediction using data models
The information is non actionable
knowledge
![Page 86: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/86.jpg)
OBTAINING VALUE FROM DATA
86
4
Knowledge
Information
Data
+Volum
e
-+
-
Valu
e
For this we have Data Miningtechniques
• Association• Classification• Clustering• Prediction• ...
The majority of algorithms functionwell in thousands of registers, however at the moment they are impractical for thousands of milions.
![Page 87: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/87.jpg)
CONTENT
1. New Business models2. How do we get here?3. What is Cloud Computing?4. What is Big Data?5. An opportunity for you
![Page 88: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/88.jpg)
AN OPPORTUNITY
![Page 89: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/89.jpg)
AN OPPORTUNITY
1950 1980 201019951965 2025
Ap
plica
tio
ns
Thousandsof applications
Tens of thousandsof applications
Hundredsof applications
Hundreds of thousands
of applications
IT applications and services over the years
![Page 90: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/90.jpg)
AN OPPORTUNITY
1950 1980 201019951965 2025
Ap
plica
tio
ns
Thousandsof applications
Tens of thousandsof applications
Hundredsof applications
Hundreds of thousands
of applications
we'll see millions of new applications and services built on top of these disruptive technologies
Millions ofapplications
![Page 91: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/91.jpg)
AN OPPORTUNITY
1950 1980 201019951965
Millionsof users
Hundreds of Millionsof users
?
Thousandsof users
2025
Use
rs IT users growth
![Page 92: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/92.jpg)
AN OPPORTUNITY
1950 1980 201019951965
Millionsof users
Hundreds of Millionsof users
Billions of users
Trillions of “things”
Thousandsof users
2025
Use
rs IT users growth
thanks to these millions of applications we'll see billions of users and trillions of “things” connected
![Page 93: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/93.jpg)
BIG DATA TALENT
![Page 94: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/94.jpg)
BIG DATA TALENT
![Page 95: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/95.jpg)
CONCLUSION
We have toprepare our businesses for
the explosion of the cloudin a world of mobile technology
and social networks, dominated by the
boom of available information and all in a sustainable way.
![Page 96: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/96.jpg)
www.smartcityexpo.com www.bsc.es/eBusiness
Autonomic Systems and e‐Business Platforms research line at BSC/UPC
![Page 97: How can we take advantage of Cloud computing & big data?](https://reader033.vdocuments.site/reader033/viewer/2022051412/54b6ed2e4a7959ec508b4590/html5/thumbnails/97.jpg)
Thank you for yourattention
Questions?
www.JordiTorres.eu
@JordiTorresBCNBarcelona13-15 November 2012
www.smartcityexpo.com