aws summit - chicago 2016 - new relic - monitoring the dynamic cloud
TRANSCRIPT
![Page 1: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/1.jpg)
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lee Atchison, Principal Cloud Architect and Advocate at New Relic, Inc.
April 19, 2016 – Chicago, IL
Life’s Too Short…... for Cloud without Analytics
Monitoring the Dynamic Nature of Cloud Computing
![Page 2: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/2.jpg)
Safe HarborThis document and the information herein (including any information that may be incorporated by reference) is provided for informational purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc. (“New Relic”) to sell securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and may not be replicated or disclosed without New Relic’s express written permission.
Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a historical fact or refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will include words such as “believes,” “anticipates,”, “expects” or words of similar import.
Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements is included in the filings we make with the SEC from time to time. Copies of these documents may be obtained by visiting New Relic’s Investor Relations website at http://ir.newrelic.com or the SEC’s website at www.sec.gov.
New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no warranties, expressed or implied, in this document or otherwise, with respect to the information provided.
![Page 3: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/3.jpg)
Who am I?
Lee AtchisonPrincipal Cloud Architectand Advocate
Specialize in:Cloud computing
Services & Microservices
Scalability, Availability
28 years in industry7 in Amazon Retail & AWS (Built SW/VG AppStore, AWS Elastic Beanstalk)
4 in New Relic (Architecture Lead, Cloud, Service Migration)
@leeatchison leeatchison
![Page 4: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/4.jpg)
We want better apps faster
DynamicEnvironment
BetterData Center
How do we use the cloud to accomplish this?
![Page 5: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/5.jpg)
Cloud as a Dynamic Tool
![Page 6: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/6.jpg)
Cloud as a “Dynamic Tool for Dynamic Apps”
Use only the resources
you need
![Page 7: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/7.jpg)
Cloud as a “Dynamic Tool for Dynamic Apps”
Use only the resources
you need
Allocate / de-allocate
resources on the fly
![Page 8: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/8.jpg)
Cloud as a “Dynamic Tool for Dynamic Apps”
Use only the resources
you need
Resource allocation is an integral part of
your application architecture
Allocate / de-allocate
resources on the fly
![Page 9: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/9.jpg)
Dynamic Cloud
Resources are:
Application is aware of and is controlling
traditional OPs resources
De-allocatedConsumedAllocated
Auto Scale
![Page 10: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/10.jpg)
Dynamic Cloud
Docker containers:
• Quicker / cheaper startup / shutdown even than EC2 instances
• Easy to consume Docker containers much like you do “processes”
• Perform jobs:– In a script– Off of some queue of job requests
Docker is making the cloud even more dynamic
![Page 11: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/11.jpg)
Dynamic Cloud
100
10K
1M
3.7 M
83 days 333 days
Docker Container Age(Count vs. Hours)
![Page 12: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/12.jpg)
Dynamic Cloud
950,00011% under one minute
Docker Container Age(by Minute Under and Hour)
![Page 13: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/13.jpg)
Dynamic Cloud Technologies
EC2/Spot Instances
Load balancing
Auto Scaling Queues and notifications
Docker
Dynamic Cloud is about scaling
![Page 14: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/14.jpg)
How do I monitor the Dynamic Cloud?
Dynamic Cloud has unique monitoring requirements…
![Page 15: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/15.jpg)
Responsibility (Dynamic Cloud)
Server OS
Server (Virtual)Hardware
Application & Application
Microservices
Application & Application
Microservices
Application & Application
Microservices
Provisioning
• Multiple Applications & Application Microservices &Dynamic services
• Servers &Virtual Hardware &Infrastructure
![Page 16: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/16.jpg)
AWS Infrastructure
Server OS
Server (Virtual)Hardware
CloudWatch
AWS CONSOLE
DASHBOARDS
Application & Application
Microservices
Application & Application
Microservices
Application & Application
Microservices
Provisioning
![Page 17: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/17.jpg)
AWS Infrastructure New Relic work together
Server OS
Server (Virtual)Hardware
CloudWatch
AWS CONSOLE
DASHBOARDS
Application & Application
Microservices
Application & Application
Microservices
Application & Application
Microservices
Provisioning
![Page 18: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/18.jpg)
AWS Infrastructure New Relic work together
Server OS
Server (Virtual)Hardware
CloudWatch
AWS CONSOLE
DASHBOARDS
Application & Application
Microservices
Application & Application
Microservices
Application & Application
Microservices
ProvisioningCloudWatch
& AWS monitoring
New Relic monitors
![Page 19: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/19.jpg)
How do you monitor this?
Server OS
Server (Virtual)Hardware
Application & Application
Microservices
Application & Application
Microservices
Application & Application
Microservices
Provisioning
?How do you monitor this?
![Page 20: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/20.jpg)
Where did it go? It was just here!!!
? The thing you monitored 10 minutes ago…...doesn’t exist
anymore!
![Page 21: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/21.jpg)
Dynamic Cloud
950,00011% under one minute
Docker Container Age(by Minute Under and Hour)
![Page 22: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/22.jpg)
Monitoring the Dynamic Cloud
Very different than monitoring traditional Data Center components
Monitor theCloud Components
themselves
Monitor the lifecycle of the
Cloud Components
![Page 23: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/23.jpg)
Who is impacted by Dynamic Cloud?
Better DataCenter
Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?
Operations
Data center is a data center…
Development
DynamicCloud
![Page 24: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/24.jpg)
Who is impacted by Dynamic Cloud?
Better DataCenter
Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?
Operations
Data center is a data center…
Development
DynamicCloud
What is a container?Why do I care??It was just here, where did it go???
![Page 25: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/25.jpg)
Who is impacted by Dynamic Cloud?
Better DataCenter
Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?
Operations
Data center is a data center…
Development
DynamicCloud
What is a container?Why do I care??It was just here, where did it go???
Cloud architecture is integral to the application architectureDevelopers deeply involved in cloud activities
![Page 26: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/26.jpg)
Change is speeding up
TraditionalData Center
CloudData Center
DynamicCloud
Dynamic Cloud enables better applications faster.
Good Better Best
The way you’ve done things in the past won’t work in the future.
![Page 27: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/27.jpg)
Dynamic Cloud
EC2
Server running application / processes
Docker container
Process running a command
Things happen faster because of…
This ishard
![Page 28: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/28.jpg)
Dynamic Cloud
EC2
Server running application / processes
Docker container
Process running a command
Lambda
Function performing a task or operation
Things happen faster with…
![Page 29: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/29.jpg)
Change is speeding up
TraditionalData Center
CloudData Center
DynamicCloud
Dynamic Cloud enables better applications faster.The rate of change is increasing…
Good Better Best
The way you’ve done things in the past won’t work in the future.
![Page 30: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/30.jpg)
Monitoring just the server
EC2 Instance
Application & Application
Microservices
Server OS
Server (Virtual)Hardware
CloudWatch
AWS CONSOLE
Worked when rate of change was low…
![Page 31: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/31.jpg)
Monitoring just the server
Server OS
Server (Virtual)Hardware
Application & Application
Microservices
Application & Application
Microservices
Application & Application
Microservices
Provisioning
Insufficient in the cloud:
• Rate of change is faster• Problems come up quicker• “Server” isn’t a server anymore• “Provisioning” isn’t provisioning anymore
You need top to bottom monitoring…
You need full stack accountability...
![Page 32: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/32.jpg)
You Need A Solid Monitoring Partner...
Customers
Mobile / Apps / Browser
On-Premises
On Premises Relational Data
EC2
AWSContainer Service
AWS RDSSynthetic Customers
S3
NoSQL
AWS Storage Services
Your Responsibilities
• Application code & 3rd party services• App architecture• Customer experience• On-Premises components
AWS Responsibility:
• Service Availability & Performance• Provisioning & operation of DC• Isolation & security of resources• Service maintenance & innovation
NoSQL
![Page 33: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/33.jpg)
Want to Learn More?
Webinar
Monitoring the Hybrid CloudHow do you measure and make decisions across on-premises data centers, dynamic clouds, and hybrid clouds?
Registration: http://bit.ly/NR421
Webinar: April 21 @ 8 AM PT
![Page 34: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/34.jpg)
Want to Learn More?
Booth #321
![Page 35: AWS Summit - Chicago 2016 - New Relic - Monitoring the Dynamic Cloud](https://reader035.vdocuments.site/reader035/viewer/2022070603/5870d9b91a28ab64768b75a9/html5/thumbnails/35.jpg)
Thank You!Lee Atchison, Principal Cloud Architect and Advocate at New Relic, Inc.
Architecting for ScalePublished by: O’Reilly Media, Available: June 2016www.architectingforscale.com
@leeatchison leeatchison