Automation is amazing

Siim VismanNovember 2015

Who am I?

• With the company for 8 years

• Operational Tools Team Leader

• Responsible for Infrastructure Automation Development and Configuration Management domains.

Today’s topics

•Introduction and overview

•SiteManager - SM

•Product Operation Management System - POMS

•Deployment Activation Tool – DAT

•Summary and Conclusion

About Playtech

• Established in 1999 in Tartu.• Shares are traded on London Stock Exchange main

market.• Development offices are in five countries:

• Estonia, United Kingdom, Sweden, Bulgaria and Ukraine.

• Over 5000 employees around the world, ~670 in Estonia.

• Main R&D Centre is located in Tartu.

Infrastructure around the Globe

• 100 Private clouds• 3 000 Physical servers• 25 000 Virtual machines

FinlandEstoniaLatviaUK

Isle of Man Alderney GibraltarIrelandBelgiumFranceSpainItalyMalta

Kahnawake(Canada)

Mexico Curacao Philippines

Taiwan

Singapore

Sites Orchestration General Concept

POMS

Site Manager

Orchestrators

Production site

DNS

LDAP

Repository

Site Services

ESXiRepository

DNS

LDAP

Puppet master

Custom reporting

Central Services

vCenter

ConfDB

CMDB

EJBCA

Why we started with Automation?

•Support Business growth

•Reduce time to Market

•Improve maintainability

•Provide best solutions to our customers

Today’s topics

•Introduction and overview

•SiteManager - SM

•Product Operation Management System - POMS

•Deployment Activation Tool – DAT

•Summary and Conclusion

Vision of SiteManager

•Reduce time to market •One-stop-shop•Enforce policies all over the infrastructure•Unified infrastructure layout•Enhance security•Orchestration •API to simplify integrations

SiteManager•Tool to manage sites throughout their full lifecycle

•Single interface for accessing underlying infrastructure layers:• Hardware – Hypervisor, DB, VMs• Network – DNS, Firewall, Load-balancer• Playtech products

•Managing VM anti-affinity rules•Automatically updates Configuration Management data in CMDB

Everybody loves screenshots!

Key benefits of SiteManager

• Create a new site running on Playtech platform 6600% faster than previously

• Main datasource for configuration management

• Improved patch and access management

• Standardizing configuration installation all over company

• APIs for other automation and data collection tools

Today’s topics

•Introduction and overview•SiteManager - SM•Product Operation Management System - POMS•Deployment Activation Tool – DAT•Summary and Conclusion

Vision of POMS

•Cross site data queries

•Deployment tool for Release Management

•Delegation of common tasks

•Easy integration with existing tools

POMS features

•Auto-discovery of services and configuration

•Sitebooks

•Custom SQL Query

•Reports interface for predefined reports

•Mass deployment interface

•Plugins’ compliant design

Everybody loves screenshots!

Key benefits of POMS

•50% less time spent on all routine deployment tasks

•Up to 2000% less time spent on cross-site data requests

•Quick overview of situation in all prod sites

•POMS is a useful tool for 30% of Playtech Estonia employees

Today’s topics

•Introduction and overview

•SiteManager - SM

•Product Operation Management System - POMS

•Deployment Activation Tool – DAT

•Summary and Conclusion

Deployment Activation Tool• Software component which is created to provide an

API to start, stop, restart and activate Playtech components in sites

• Adheres to the dependency requirements described in the ICR

• Provides seamless downtime functionality during change operations

• Allows to change product and middleware versions• A deployment affects up to 45 different services

SITE

DAT

Start/Stop/Activate Get version from VM For every version

activate run discovery In case of restart –

poll healthcheck, if restart has been done

F5 for Web services

Poll healthcheck every 15 sec In case of NOK or NMC, redirect (new)

connection to another node

SM API

Restart Activate Puppet run/install Get/Set VM software CMDB update

VM

Get/Set version Start | Stop | Restart Run discovery

SERVICE Healthcheck {OK, NMC, NOK}healthcheck

Activate/RestartStart/Stop

Activate/RestartStart/Stop

Get versoinRun discovery

Puppet run

POMS

Restart Activate Puppet run/Install Set VM software

Orchestration

CMDBSM DB

Get/Set VM current software

Target list

Discovery

ICR Repo

Packagesand

dependances

Packageinformation

healthcheck

Today’s topics

•Introduction and overview

•SiteManager - SM

•Product Operation Management System - POMS

•Deployment Activation Tool – DAT

•Summary and Conclusion

Conclusion

•Using all these automation tools – we have increased our ability to maintain systems about 2000%• Before we managed to maintain about 1500 systems• Today we are able to maintain 25 000 systems

•Policy Engine• Compliance with the company software policy: 99,9%• Ability to apply policy on different levels:

• Global, Site, Service, Component

If you do something more than once – write a script!

Thank you!

Q & A

Automation is amazing – isn’t it?