v
Unattended Datacenter Deployment with ZTP
Leslie Carr October 15, 2014
Who is Leslie?
! Operations Engineer ! Google ! Craigslist ! Twitter ! Wikimedia Foundation
(Wikipedia)
Who is Leslie?
! Cumulus Networks®
What is Cumulus Linux?
! Cumulus® Linux® ! Debian based distribution for Network switches
Cumulus Philosophy ! Manage your network switch as a server ! Use existing linux tools to configure network switches ! Current release — Based on Debian wheezy
Cumulus® Linux® Hardware Compatibility List
cumulusnetworks.com 4
v
Installation and Configuration
Traditional Network Gear Process
! Comes preinstalled with (old) software ! Telnet or serial into box ! TFTP new image ! Enable SSH (sometimes with passwords!) ! Copy/paste configuration ! Automation usually restricted to Perl, TCL, and expect
scripts
Normal Server Installation
! Reboot and bios with PXE automatically catches ! TFTP boot image ! New image pulled over via normal means (usually
webserver, sometimes TFTP) ! Pre/post installation scripts runs ! Automation software manages configuration and
administration
Network OS installer discovery and execution ! Like a pre-installed BIOS, PXE, and kickstarter in one ! Implemented through Linux kernel with BusyBox
Donated to the Open Compute Project (OCP) http://www.onie.org
ONIE
Comparison
bare metal server
Server OS
app app app
BIOS and PXE
bare metal switch
Network OS
app app app
Boot Loader and ONIE
Similar to installing a server OS using PXE
Network OS Boot Loader and ONIE
boot into
Boot Loader and ONIE
boot into
ONIE looks for and installs network OS image
Cumulus Linux OS Installation with ONIE
cumulusnetworks.com 10
! Look for installer (“discover”) ! Locally, e.g. USB if available ! Over the network on eth0 • DHCP, IPv6 neighbor, TFTP
! Search for file name and execute ! onie%installer%*,
1
2
Cumulus Linux OS image
! ZTP script execution is triggered on DHClient exit or by USB Stick
• USB support in releases 2.5 and up
! Script must contain CUMULUS%AUTOPROVISIONING,,
! Can be in the following languages : • Perl • Python • Ruby • Shell
ZTP Execution
ZTP Script USB
USB looks for a specific file name “waterfall” waterfall,=,[,
'cumulus%ztp%',+,arch,+,'%',+,vendor,+,'_',+,model,+,'%r’,+,revision,,'cumulus%ztp%',+,arch,+,'%',+,vendor,+,'_',+,model,'cumulus%ztp%',+,vendor,+,'_',+,model,'cumulus%ztp%',+,arch,'cumulus%ztp’,],,Example,:,/mnt/usb/cumulus%ztp%powerpc%cel_smallstone%rUNKNOWN,,/mnt/usb/cumulus%ztp%powerpc%cel_smallstone,,/mnt/usb/cumulus%ztp%cel_smallstone,,/mnt/usb/cumulus%ztp%powerpc,,/mnt/usb/cumulus%ztp,
ZTP with DHCP example dhcp.conf
! ddns%update%style,none;,! default%lease%time,4320;,! max%lease%time,8640;,! authoritative;,
! option&cumulus,provision,url&code&239&=&text;&
! subnet,192.168.0.0,netmask,255.255.255.0,{,! ,range,192.168.0.100,192.168.0.200;,! ,option,routers,192.168.0.1;,! ,option,domain%name%servers,192.168.0.1;,! ,option,domain%name,"lab.mycompany.com";,! &option&cumulus,provision,url&"http://192.168.0.2/demo.sh";&! },
During the DHCP process over eth0 (management interface), Cumulus Linux will request DHCP option 239. This option is used to specify the custom provisioning script. It will also send the following headers:
Header,,,,,,,,,,,,,,,,,,,,,,,,Value,,,,,,,,,,,,,,,,,Example,%%%%%%,,,,,,,,,,,,,,,,,,,,,,,,%%%%%,,,,,,,,,,,,,,,,,%%%%%%%,User%Agent,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,CumulusLinux%AutoProvision/0.4,CUMULUS%ARCH,,,,,,,,,,,,,,,,,,CPU,architecture,,,,,,powerpc,CUMULUS%BUILD,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,1.5.1%5c6829a%201309251712%final,
CUMULUS%LICENSE%INSTALLED,,,,,Either,0,or,1,,,,,,,,,1,CUMULUS%MANUFACTURER,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,dni,CUMULUS%PRODUCTNAME,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,et%7448bf,CUMULUS%SERIAL,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,XYZ123004,CUMULUS%VERSION,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,1.5.1,CUMULUS%PROV%COUNT,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,0,
CUMULUS%PROV%MAX,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,32,
ZTP
ZTP Example with Puppet
1,#!/bin/bash,
2,
3,function,error(),{,
4,,echo,%e,"\e[0;33mERROR:,Provisioning,failed,running,$BASH_COMMAND,at,line,$BASH_LINENO,of,$(basename,$0),\e[0m",>&2,
5,,exit,1,
6,},
7,trap,error,ERR,
8,#,Allow,Cumulus,testing,repo,
9,sed,%i,/etc/apt/sources.list,%e,'s/^#\s*\
(deb.*testing.*\)$/\1/g',
10,
11,#,Upgrade,and,install,Puppet,
12,apt%get,update,%y,
,
13,apt%get,upgrade,%y,
14,apt%get,install,puppet,%y,
15,,
16,echo,"Configuring,puppet",|,wall,%n,
17,sed,%i,/etc/default/puppet,%e,'s/
START=no/START=yes/',
18,
19,service,puppet,restart,
20,
21,#,CUMULUS%AUTOPROVISIONING,
22,
23,exit,0,
,
,
Video
/var/lib/cumulus/autoprovision.conf
! [discovery],! count,=,1,! max,=,32,
! [provisioning],! enabled,=,True,! complete&=&True&! datetime,=,1413314146,! method,=,DHCP,Option,! detail,=,http://192.168.0.1/provision.sh,
! Because Debian based, we can do everything via puppet ! users ! interface configuration ! routing software (Quagga) configuration
Puppet
Video!
ZTP Example with Ansible
1,#!/bin/bash,
2,
3,function,error(),{,
4,,echo,%e,"\e[0;33mERROR:,Provisioning,failed,running,$BASH_COMMAND,at,line,$BASH_LINENO,of,$(basename,$0),\e[0m",>&2,
5,,exit,1,
6,},
7,trap,error,ERR,
8,URL="http://wbench.lab.local/ansible_authorized_keys”,
9,mkdir,%p,/root/.ssh,
10,,
11,/usr/bin/wget,%O,/root/.ssh/authorized_keys,$URL,
12,,
13,#CUMULUS%AUTOPROVISIONING,
14,exit,0,,
Video
Success!
! ZTP ! http://cumulusnetworks.com/docs/2.2/user-guide/
system_management_diagnostics/provisioning.html Example Code
! https://github.com/CumulusNetworks/cldemo Cumulus Workbench
! http://cumulusnetworks.com/cumulus-workbench/ Twitter
! @lesliegeek
Find out more!
© 2014 Cumulus Networks. Cumulus Networks, the Cumulus Networks Logo, and Cumulus Linux are trademarks or registered trademarks of Cumulus Networks, Inc. or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. The registered trademark Linux® is used pursuant to a sublicense from LMI, the exclusive licensee of Linus Torvalds, owner of the mark on a world-wide basis.
! Thank You!
cumulusnetworks.com
Bringing the Linux Revolution to Networking
