monitoring performance of enterprise applications on aws: understanding the dynamic nature of cloud...

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Andy Wetzel, Director of Industry Solutions at New Relic, Inc.Donald J. Patti, Program Manager & ScrumMaster, Telesis

20 June 2016

Monitoring Performance of Enterprise Applications on AWS: Life’s Too Short…

... for Cloud without Analytics Monitoring the Dynamic Nature of Cloud Computing

Safe HarborThis document and the information herein (including any information that may be incorporated by reference) is provided for informational purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc. (“New Relic”) to sell securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and may not be replicated or disclosed without New Relic’s express written permission.

Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a historical fact or refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will include words such as “believes,” “anticipates,”, “expects” or words of similar import.

Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements is included in the filings we make with the SEC from time to time. Copies of these documents may be obtained by visiting New Relic’s Investor Relations website at http://ir.newrelic.com or the SEC’s website at www.sec.gov.

New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no warranties, expressed or implied, in this document or otherwise, with respect to the information provided.

Who are We?

Andy WetzelDirector of Industry Solutions

Specialize in:Testing

Monitoring

Performance Optimization

22 years in industry10 in Mercury Interactive / HP

2 in New RelicDid DevOps when it was called “Lean Manufacturing”

@adwetzel andywetzel

Who are We?

Donald J. PattiProgram Manager/ScrumMaster

SBA One Modernization Program

Specialize in:Agile w/Lean

Software Product Development

Coaching & Consulting

20+ years in industryCSM©/CSP© (Scrum Alliance)

SAFe Agilist© (Scaled Agile Academy)

Lean Six Sigma Black Belt/CSSGB© (ASQ)

Project Management Professional© (PMI)

Balanced Scorecard Professional© (BSI) donald.patti@telesishq.com

Avoiding the “Capitol Hill” moment

You have to testify

If app launch / performance is bad

We want better apps faster

BetterData Center

DynamicCloud

Cloud as a Better Data Center

Better Data Center

Resources are allocated to uses, just like in

a data center

Better Data Center

Resources are allocated to uses, just like in

a data center

Provisioning process is faster

Better Data Center

Resources are allocated to uses, just like in

a data center

Lifetime of components is relatively long

Provisioning process is faster

Better Data Center

Resources are allocated to uses, just like in

a data center

Lifetime of components is relatively long

Provisioning process is faster

Capacity planning is still important and still applies

Why use a “Better Data Center”?

ComplianceImprove ApplicationAvailability

(redundancy)

Add new Capacity(faster)

Who is impacted?

Better Data Center Faster Application Launch / Deploy=

Better DataCenter

Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?

Operations

Data center is a data center…

Development

How do I monitor it?

Similar to monitoring any other data center…

Monitoring an application

Typical Server / EC2 Instance

• Application & Application Microservices

• Server OS• Hardware (virtual)

EC2 Instance

Application & Application

Microservices

Server OS

Server (Virtual)Hardware

AWS Monitoring

CloudWatch

• Monitors:– EC2 instance– Virtualization– Hardware– [CPU/Disk/Networking]

• Doesn’t know about:– Server OS– Memory/Filesystem– Processes– Application

• Latency• Error rates• Internal insights

EC2 Instance

Application & Application

Microservices

Server OS

Server (Virtual)Hardware

Amazon CloudWatch

AWS MANAGEMENT CONSOLE

New Relic Monitoring

New Relic

• Monitors (Server):– How O.S. is performing– Processes– Hardware

• Monitors (Application):– App health– App performance– Microservices

• Doesn’t know– Virtualization

EC2 Instance

Application & Application

Microservices

New RelicApplicationMonitoring

Server OS

Server (Virtual)Hardware

New RelicServer

Monitoring

AmazonCloudWatch

AWS MANAGEMENT CONSOLE

DASHBOARDS

AWS New Relic work together

EC2 Instance

Application & Application

Microservices

New RelicApplicationMonitoring

Server OS

Server (Virtual)Hardware

New RelicServer

Monitoring

Amazon CloudWatch

AWS MANAGEMENT CONSOLE

DASHBOARDSAWS / CloudWatch

• Visibility into virtualization• CPU / Disk / Networking

New Relic

• CPU / Disk / Networking• Memory / Filesystem• Processes• Infrastructure components• Application / Microservices:

– Latency– Error rates– App insights CloudWatch

monitors

New Relic monitors

The certify.SBA.gov Launch

About “Certify”

SBA’S BUSINESS CERTIFICATION PLATFORM

Hosted on the AWS Cloud

FedRAMP compliant

Replaces legacy ColdFusion /

Oracle systems

Helps small businesses to

win government contracts

Preparation for Launch

Traditional load, performance & stress testing

Implementation of New Relic

Key milestones

Initial Launch

Chief Administrator’s Press Conference

How we avoided “The Capitol Hill” moment

Used New Relic to identify bottlenecks

Proactive real-time monitoring via New Relic helped us to

better manage go-live

The outcome

Successful launch to the cloud –

infrastructure and new application – in only 7 months

Increase in new certification

applications during the first month

No measurable degradation in

performance for either event

(MRT90 = 3 seconds)

600% 0 7

A better data center for SBA

FedRAMP Compliance &

Rapid ATO

Virtual redundancy via AWS Platform

Auto-scaling of cloud

infrastructure

Cloud as a Dynamic Tool

Cloud as a “Dynamic Tool for Dynamic Apps”

Use only the resources

you need

Resource allocation is an integral part of

your application architecture

Allocate / de-allocate

resources on the fly

Dynamic Cloud

Docker containers:

• Quicker / cheaper startup / shutdown than EC2 instances

• Easy to consume Docker containers much like you do “processes”

• Perform jobs:– In a script– Off of some queue of job requests

Dynamic Cloud

100

10K

1M

3.7 M

83 days 333 days

Docker Container Age(Count vs. Hours)

Dynamic Cloud

950,00011% under one minute

Docker Container Age(by Minute Under and Hour)

EC2 Auto Scaling

Dynamic Cloud Technologies

Mobile / IoTDynamic routing

Load balancing

Data transport

Queues and notifications

Docker

Dynamic Cloud is about scaling

Who Uses It?

Better DataCenter

Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?

Operations

Data center is a data center…

Development

DynamicCloud

What is a container?What is a Lambda?It was just here, where did it go?

Cloud architecture is integral to the application architectureDevelopers deeply involved in cloud activities

How do I monitor the Dynamic Cloud?

Dynamic Cloud has unique monitoring requirements…

Responsibility (Dynamic Cloud)

Server OS

Application & Application

Microservices

Application & Application

Microservices

Application & Application

Microservices

Provisioning

Responsible for the parts you care about

• Application & Application Microservices

Let cloud manage rest

• Infrastructure• Allocation / Provisioning• Scaling

Server (Virtual)Hardware

AWS Infrastructure New Relic work together

Server OS

Server (Virtual)Hardware

AWS CONSOLE

DASHBOARDS

Application & Application

Microservices

Application & Application

Microservices

Application & Application

Microservices

Provisioning

AmazonCloudWatch

AWS Infrastructure New Relic work together

Server OS

Server (Virtual)Hardware

AWS CONSOLE

DASHBOARDS

Application & Application

Microservices

Application & Application

Microservices

Application & Application

Microservices

Provisioning

AmazonCloudWatch

CloudWatch& AWS monitoring

AWS Infrastructure New Relic work together

Server OS

Server (Virtual)Hardware

AWS CONSOLE

DASHBOARDS

Application & Application

Microservices

Application & Application

Microservices

Application & Application

Microservices

Provisioning

CloudWatch& AWS monitoring

New Relic monitors

AmazonCloudWatch

Monitoring the Dynamic Cloud

Very different than monitoring traditional Data Center components

Monitor theCloud Components

themselves

Monitor the lifecycle of the

Cloud Components

Dynamic Cloud

Amazon EC2

Server running application / processes

Docker container

Process running a command

Amazon Lambda

Function performing a task or operation

Monitoring the Dynamic Cloud

Your world is changing fast…

Monitoring the Dynamic Cloud

… your monitoring tools need to help you keep up

Your world is changing fast…

Change is speeding up

TraditionalData Center

Dynamic Cloud enables better applications faster.The rate of change is increasing…

Good

Change is speeding up

TraditionalData Center

CloudData Center

Dynamic Cloud enables better applications faster.The rate of change is increasing…

Good Better

Change is speeding up

TraditionalData Center

CloudData Center

DynamicCloud

Dynamic Cloud enables better applications faster.The rate of change is increasing…

Good Better Best

Lessons learned

Government can be nimble

Lessons learned

Government can be nimble

Avoiding “The Capitol Hill”

moment

Lessons learned

Government can be nimble

Avoiding “The Capitol Hill”

moment

Leverage data driven

decision-making

Lessons learned

Government can be nimble

Avoiding “The Capitol Hill”

moment

Leverage data driven

decision-making

More gains possible via

Dynamic Cloud

Lessons learned

Government can be nimble

Avoiding “The Capitol Hill”

moment

Leverage data driven

decision-making

More gains possible via

Dynamic Cloud

Otherscan help

Thank You!

Andy Wetzel, Director of Industry Solutions at New Relic, Inc.

Donald J. Patti, Program Manager & ScrumMaster, Telesis