devcontlv 2014 (jan) - diy devops

42
@leonidlm www.leonidmirsky.com DIY DEVOPS

Upload: leonid-mirsky

Post on 08-May-2015

1.040 views

Category:

Technology


2 download

DESCRIPTION

We all know that bringing devops practices to your organisation is hard and very labour intensive task. Despite the fact that for large organisations it is still a real challenge, for small startups and development teams devops practices can be adopted relatively easily. In this talk Leonid will share his experience of bringing devops practices to small organisations, and prove that devops isn't something that you should postpone for a later growth stage, but something you can do (and relatively easy) now, at the first stages of your idea inception!

TRANSCRIPT

Page 1: DevconTLV 2014 (Jan) - DIY DevOps

@leonidlmwww.leonidmirsky.com

DIY DEVOPS

Page 2: DevconTLV 2014 (Jan) - DIY DevOps

LEONID MIRSKYFreelancer (1+ year)Liveperson (5+ years)

About me

Page 3: DevconTLV 2014 (Jan) - DIY DevOps

DevOps is...Chef/Puppet

Page 4: DevconTLV 2014 (Jan) - DIY DevOps

DevOps is...Continuous Delivery

Page 5: DevconTLV 2014 (Jan) - DIY DevOps

DevOps is...Docker

Page 6: DevconTLV 2014 (Jan) - DIY DevOps

“Finishing what agile development started” (www.devops.com)

What is DevOps? (for me, shortly)

DevOps is all about CAMS1. Culture2. Automation3. Measurement4. Sharing

Page 7: DevconTLV 2014 (Jan) - DIY DevOps

Implementing DevOps as after though is hard!

Page 8: DevconTLV 2014 (Jan) - DIY DevOps

DevOps is part of startup engineering course curriculum

https://www.coursera.org/course/startup

Page 9: DevconTLV 2014 (Jan) - DIY DevOps

“For startups, DevOps is business as usual but ...”

http://www.pistoncloud.com/2013/09/is-devops-optional-or-normal/

Page 10: DevconTLV 2014 (Jan) - DIY DevOps

“the longer you’ve had separate dev and ops departments,

the more difficult the cultural shift will be”

http://www.pistoncloud.com/2013/09/is-devops-optional-or-normal/

Page 11: DevconTLV 2014 (Jan) - DIY DevOps

The bigger the organization becomes, the harder it is to introduce DevOps practices

Page 12: DevconTLV 2014 (Jan) - DIY DevOps

Start early!

Page 13: DevconTLV 2014 (Jan) - DIY DevOps

How can we make your startup more DevOps oriented?

Page 14: DevconTLV 2014 (Jan) - DIY DevOps

How much time will it take?

Page 15: DevconTLV 2014 (Jan) - DIY DevOps

Culture

Startup team characteristics:

1. Small agile teams

2. One/two influencers

3. Doitall culture (full stack developers)

Page 16: DevconTLV 2014 (Jan) - DIY DevOps

Probably only small adjustments are needed

Page 17: DevconTLV 2014 (Jan) - DIY DevOps

Culture - try to avoid...

Page 18: DevconTLV 2014 (Jan) - DIY DevOps

Sharing - Internal

WhatsApp (hipchat/...) incidents group

Practice Lessons Learned

Page 19: DevconTLV 2014 (Jan) - DIY DevOps

Sharing - External

Page 20: DevconTLV 2014 (Jan) - DIY DevOps

total work estimate=

1 day

Page 21: DevconTLV 2014 (Jan) - DIY DevOps

Automation - Continuous Deployment

Page 22: DevconTLV 2014 (Jan) - DIY DevOps
Page 23: DevconTLV 2014 (Jan) - DIY DevOps

Automation - Continuous Deployment

Similar tools are available: TravisCI, CircleCI ...

Extremely easy to set up

Relatively cheap monthly subscription

Page 24: DevconTLV 2014 (Jan) - DIY DevOps

Configuration Management requires a lot of your resources

Page 25: DevconTLV 2014 (Jan) - DIY DevOps

Automation - Configuration Management

Instead use a combination of

1. fabric / capistrano / shell scripts

2. AMI / snapshotting

Usually CM can be avoided at the beginning

Page 26: DevconTLV 2014 (Jan) - DIY DevOps

total work estimate=

5 days (1 + 4)

Page 27: DevconTLV 2014 (Jan) - DIY DevOps

Measurement

User Experience

Application

Infrastructure

Page 28: DevconTLV 2014 (Jan) - DIY DevOps

Don’t start from infrastructure monitoring (Nagios)

Page 29: DevconTLV 2014 (Jan) - DIY DevOps

Measurement - Application

Start from measuring the Application

Quick win - NewRelic agent to gather

application stack metrics

Page 30: DevconTLV 2014 (Jan) - DIY DevOps

Measurement - Application

Page 31: DevconTLV 2014 (Jan) - DIY DevOps

Measurement - Application

Instrument your application code and send the

metrics to Librato

Codahale’s presentation ‘metrics metrics

everywhere’ is a must...

http://www.youtube.com/watch?v=czes-oa0yik

Page 32: DevconTLV 2014 (Jan) - DIY DevOps

Measurement - Infrastructure

Add Librato collectors (collectd, ...) to get

additional “free” metrics

Integrate cloudwatch metrics into Librato

http://support.metrics.librato.com/knowledgebase/articles/195366-amazon-aws-cloudwatch-integration-

Page 33: DevconTLV 2014 (Jan) - DIY DevOps

total work estimate=

8 days (1 + 4 + 3)

Page 34: DevconTLV 2014 (Jan) - DIY DevOps

It is only a beginning...

Page 35: DevconTLV 2014 (Jan) - DIY DevOps

When will you need to invest more?

When the business demands more

1. Autoscaling

2. More elaborate automation is needed

3. SaaS/PaaS functionality is too narrow

4. Ops expertise

Page 36: DevconTLV 2014 (Jan) - DIY DevOps

Start simple.Grow with the demand.

Page 37: DevconTLV 2014 (Jan) - DIY DevOps

Thank you!@leonidlm

www.leonidmirsky.com

Design inspiration: https://speakerdeck.com/lara/design-for-performance

Page 38: DevconTLV 2014 (Jan) - DIY DevOps
Page 39: DevconTLV 2014 (Jan) - DIY DevOps

Measurement - Application

Start from measuring the Application

1. NewRelic for “free” application stack

metrics

2. Instrument your app and send the data

to Librato

3. Aggregate logs with Papertrail

Page 40: DevconTLV 2014 (Jan) - DIY DevOps

Measurement

User Experience

Application

Infrastructure

Page 41: DevconTLV 2014 (Jan) - DIY DevOps

Measurement

NewRelic

Librato (instrumentation)

collectd

Page 42: DevconTLV 2014 (Jan) - DIY DevOps

Why DevOps might be hard

Hiring people with relevant devops expertise

Lack of team and management buy-in(http://puppetlabs.com/2013-state-of-devops-infographic)

Cultural change could be hard!