accelerating devops pipelines with aws

42
©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Accelerating DevOps Pipelines with AWS Konstantin Wilms, Solutions Architect Rick Houlihan, Solutions Architect

Upload: amazon-web-services

Post on 14-Aug-2015

150 views

Category:

Technology


2 download

TRANSCRIPT

Page 1: Accelerating DevOps Pipelines with AWS

©2015,  Amazon  Web  Services,  Inc.  or  its  affiliates.  All  rights  reserved

Accelerating DevOps Pipelines with AWS

Konstantin Wilms, Solutions Architect Rick Houlihan, Solutions Architect

Page 2: Accelerating DevOps Pipelines with AWS

‘Ops is slowing us down’

Page 3: Accelerating DevOps Pipelines with AWS

‘Devs are going to break things’

Page 4: Accelerating DevOps Pipelines with AWS

‘We can’t train everyone’

Page 5: Accelerating DevOps Pipelines with AWS

Background The End to End Development Pipeline

Page 6: Accelerating DevOps Pipelines with AWS
Page 7: Accelerating DevOps Pipelines with AWS

Production

Build

QA, Integration

& Test

Staging

Artifacts

Page 8: Accelerating DevOps Pipelines with AWS

Manage Store Build Deploy Code

Page 9: Accelerating DevOps Pipelines with AWS

Monitor Provision Deploy Test Build Code

Elastic Beanstalk

OpsWorks

Cloud Watch

Cloud Formation

Code Deploy

Code Commit

Code Pipeline

Integration

Development / QA / I&T Operations

Deployment Agile

EC2

Page 10: Accelerating DevOps Pipelines with AWS
Page 11: Accelerating DevOps Pipelines with AWS

Artifacts – code, data, binaries, containers? …

Page 12: Accelerating DevOps Pipelines with AWS

‘Where do we start?’

Page 13: Accelerating DevOps Pipelines with AWS

Infrastructure Core Base Level Design

Page 14: Accelerating DevOps Pipelines with AWS

MFA, Users,

Groups, Roles

Linked Accounts,

Alerts

Resource Separation

Log & Audit

CloudFormation

Page 15: Accelerating DevOps Pipelines with AWS

Self Service DIY – Sometimes at a Cost

Page 16: Accelerating DevOps Pipelines with AWS

•  BYOS –  Flexibility - but sometimes at a time+complexity price

•  Dependency Hell –  Cross-functional – OSS + Commercial 3rd Party

•  Integration –  Problematic - multiple GUIs, services, etc. often NAS bound

•  Portable –  Most ‘compatible’ with lift and shift (in and out) – to a point

Page 17: Accelerating DevOps Pipelines with AWS

Custom AMIs CloudInit VM Import Marketplace

Page 18: Accelerating DevOps Pipelines with AWS

Infrastructure Services Overview & Application Areas

Page 19: Accelerating DevOps Pipelines with AWS
Page 20: Accelerating DevOps Pipelines with AWS

Elastic Beanstalk Quickly Deploy & Manage Applications

Page 21: Accelerating DevOps Pipelines with AWS

•  Fast and Simple –  Upload code and deploy in minutes, multi-version capable

•  Developer Productivity –  Focus on the code and not the infrastructure

•  Impossible to Outgrow –  Resilience & scalability are built in

•  Complete Resource Control –  Full control over deployed infrastructure

Page 22: Accelerating DevOps Pipelines with AWS
Page 23: Accelerating DevOps Pipelines with AWS
Page 24: Accelerating DevOps Pipelines with AWS

OpsWorks Model & Manage the Entire Stack

Page 25: Accelerating DevOps Pipelines with AWS

•  Supports any Application –  Any architecture via custom Chef recipes, bash scripts & configs

•  Configuration as Code –  Define and deploy from source repositories

•  Automation to run at Scale –  Dynamic configuration and orchestration

•  Resource Organization –  Logically organize and apply permissions to resources

Page 26: Accelerating DevOps Pipelines with AWS

Stack

Page 27: Accelerating DevOps Pipelines with AWS

OpsWorks Stack Define

Instance On-Prem

Install Agent

Stack Integration

Page 28: Accelerating DevOps Pipelines with AWS

CloudFormation Infrastructure as Code

Page 29: Accelerating DevOps Pipelines with AWS

•  Easy to Use & Repeatable –  ‘Describe anything’ via simple JSON-based syntax

•  Full Control –  Open-ended template-based deployment, Callbacks, Triggers

•  Customized via Parameters –  Customize templates at run-time for specific use cases

•  Introspective Deployment –  Build by hand and abstract with CloudFormer

Page 30: Accelerating DevOps Pipelines with AWS
Page 31: Accelerating DevOps Pipelines with AWS

Create Skeleton

Define Resources

Execute

Page 32: Accelerating DevOps Pipelines with AWS

Service Catalog CloudFormation as a Product

Page 33: Accelerating DevOps Pipelines with AWS

•  Product Catalog –  Create custom catalogs containing products incorporating

standard CloudFormation architectures and configurations

•  Centralized Control –  Provides IT with central management over portfolio of services

that end users can browse and launch

•  Full Integration –  Integration with existing self service systems via rich APIs

Page 34: Accelerating DevOps Pipelines with AWS

Create Portfolio

Define Product

Attach Template

Add Constraints

Page 35: Accelerating DevOps Pipelines with AWS

Code Services CodeCommit, CodePipeline, CodeDeploy

Page 36: Accelerating DevOps Pipelines with AWS

•  CodeCommit –  Fully managed source control service for hosting private Git

repositories

•  CodePipeline –  Standardizes and automates your software release process,

allowing you to rapidly release new features to users

•  CodeDeploy –  Deploys your released code to a "fleet" of EC2 instances

Page 37: Accelerating DevOps Pipelines with AWS

Code Commit

Code Pipeline

Code Deploy

Page 38: Accelerating DevOps Pipelines with AWS

CodeCommit CodePipeline CodeDeploy

Page 39: Accelerating DevOps Pipelines with AWS

Summary Wrap Up & Some Things We Missed

Page 40: Accelerating DevOps Pipelines with AWS

•  AWS Lambda & Amazon S3 Events –  Use to plumb up a simple artifact-based CI/CD workflow –  Process all your ancillary data types – media, thumbs, etc.

•  AWS Config –  Continuously track configuration changes to your infrastructure –  Use for Audit, Discovery, Troubleshooting

•  Amazon EC2 Container Service –  Highly scalable, performant container management service –  Docker containers, custom scheduler

Page 41: Accelerating DevOps Pipelines with AWS
Page 42: Accelerating DevOps Pipelines with AWS

NEW YORK