kirin user story: migrating mission critical applications to openstack private cloud
TRANSCRIPT
Copyright © 2015 NTT DATA Corporation
Wednesday, 28 October 2015Atsushi Koga, Motoki Kakinuma
User Story:Migrate all Kirin enterprise applications to OpenStack private cloud
Copyright © 2015 NTT DATA Corporation 2
1.Introduction
3Copyright © 2015 NTT DATA Corporation
My Personal Journey
OracleDBHP-UX
CEP( BigData )
ESB
SOA OpenStackVDI
1997-2001
2002-2008
2009-2011
2012-
Telecom
Telecom
Various types...
Manufacturing
Clinet/Server
Realtime Billing
Troubleshooting
Kirin,etc ・・・・
Technical Skill
NTT DATA Corporation Atsushi Koga
IoT ?
Industry
4Copyright © 2015 NTT DATA Corporation
Corporate Data■ Name: NTT DATA Corporation■ Head Office: Toyosu Center Building, 3-3, Toyosu 3-chome, Koto-ku, Tokyo 135-6033, Japan■ Established: May 23, 1988■ Common Stock: \142,520 million (as of March 31, 2014)■ Fiscal Year: April 1 to March 31 of the following year■ URL: http://www.nttdata.com
■ Business Areas: - System integration - Networking system services - Other business activities related to the above
1. About NTT DATA
1988 NTT DATA Communications Systems Corporation spun off into a separate company from NTT1995 Listed on the Second Section of the Tokyo Stock Exchange 1996 Changed English name to NTT DATA Corporation Listed on the First Section of the Tokyo Stock Exchange
2007 Achieved consolidated net sales of \1 trillion2008 20th anniversary of establishment2012 Start of four-year Medium-Term Management Policy (covering the period to March 31, 2016)2013 25th anniversary of establishment
Overview of NTT DATA History
5Copyright © 2015 NTT DATA Corporation
Provides high-value-added global IT services that support manufacturing, distribution,
services, media, communications and other business activities.
Offers platforms and solutions that support cutting-edge IT services.
Provides high-value-added IT services that support public administration,
healthcare, finance, settlement and other
systems that form the social foundation.
Segments of NTT DATA
Enterprise IT Services(E-IT)
Public & Financial IT Services
(P&F)
Provides high-value-added IT services in overseas markets.
Solutions & Technologies(S&T)
Global Business(GB)
Note: Per-segment data includes internal transactions.
1. About NTT DATA
6Copyright © 2015 NTT DATA Corporation
EMEA
APAC
ChinaAmericas
Latin America
APACEMEA China AmericasBases : 27 cities
Bases : 79 cities
Bases : 13 cities
拠点数 : 57 cities
Provide seamless support around
the world
Choose suitable resources from
all over the world
Achieve best practices and gain
new insights
Approx. 75,000 persons deployed in 42 countries and regions around the world.
Status of Overseas Bases 1. About NTT DATA
7Copyright © 2015 NTT DATA Corporation
Kirin Group Overview ( December, 2014 )
Trade NameDate of IncorporationPaid-in CapitalHead OfficeNumber of EmployeesBusiness
Kirin Holdings Company, LimitedFebruary 23, 1907 ( Kirin Brewery Co., Ltd. )102 billion yenNakano, Tokyo39,922Alcohol Beverages, Soft Drinks, Pharmaceuticals, Biochemical, etc…
Corporate Philosophy
8Copyright © 2015 NTT DATA Corporation
8
(Unit: 100 million yen)
Business Segment ( December, 2014 )
Copyright © 2015 NTT DATA Corporation 9
2.Project Overview
10Copyright © 2015 NTT DATA Corporation
Kirin System OverView (1) Application
11Copyright © 2015 NTT DATA Corporation
Kirin System OverView (2) Infrastructure
Solving creaky infrastructure becomes an big issue in Kirin.• Kirin has managed various types of infrastructure as below.
Main DC 2
AWS
Sub DC
Back-up Center
Solaris
Linux
Solaris
Linux
BCP
Main DC 1
Mainframe
HP-UX, AIX
ESX4X
HyperV, ESX5X
Linux
Windows
VDI
VDI
BCP
12Copyright © 2015 NTT DATA Corporation
Issues to be solved in Kirin (1)
FAT シンクラ0
100
200
300
400
500
600
700
About 2,000Number of Servers
Almost 50% of the servers should be replaced due to
EOSL
2015 2016 2017 20182014……
13Copyright © 2015 NTT DATA Corporation
HW Maintenance
DC/NW Fee
Labor Costs
SW Maintenance
Others
Drastic reduction in Infrastructure cost
As-Is To-Be2015 2018
Issues to be solved in Kirin (2)Management Strategy
14Copyright © 2015 NTT DATA Corporation
Why we adopt OpenStack?
- Simple Architecture.- Extensive enterprise level experience over the world.- Quick bug report and fix by community members.
- Not just an IaaS, there is a possibility to be a PaaS with customize.- Start small, go big.
- “Selecting optimal hardware for each customer” is NTTDATA’s way.
Sophisticated
Flexibility
VendorNeutral
15Copyright © 2015 NTT DATA Corporation
Our Challenges
Full Automation
• Deployment automation
• Testing automation
Mass migration
• Mission Critical• Minimal downtime• Quick migration
Drastic cost reduction
• Operational efficiency
• Small start to avoid buying extra server
scale
migration
maintopic
One-Stop deployment
16Copyright © 2015 NTT DATA Corporation
Estimated introduction effects
Apply for
deploy
confirmby
adminInternal review
Requirement definition
Design server
Build&
TestReleas
e
Full automated deployment methods
Usual deployment methods
Apply for
deploy
confirmby
adminInternal review Build & Test Releas
e
FULL AUTOMATION
Cost reduction effect estimate: 75% OFF per server
Copyright © 2015 NTT DATA Corporation 17
3. Details of Kirin OpenStack
18Copyright © 2015 NTT DATA Corporation
Kirin OpenStack Overview
Kirin OpenStack is fully automated and optimized private cloud system.
KirinOpenStack
3. Consistent inventory management
+
1. Deployment automation 2. Testing automation
19Copyright © 2015 NTT DATA Corporation
Kirin EA user sends a deployment request to the Kirin EA(web application), then build process is started automatically.
1. Deployment automation
User Kirin EA(Web application)
OpenStack
Request Build
Kirin OpenStack
20Copyright © 2015 NTT DATA Corporation
1. Deployment automation
Kirin EA enables to us, 3 Operating systems deployment
• Windows Server 2012 R2/2008 R2• Red Hat Enterprise Linux 6.6
11 middleware deployment• Java, Apache, Tomcat, Hinemos, JP1, Security
Software, SQL Server, etc..
800+ parameters setting• Kernel parameter, create OS user/group, create DB user,• Active Directory, Windows-Feature, etc...
21Copyright © 2015 NTT DATA Corporation
Kirin EA screen sample
password
disk
hostname
network
middleware
select versioncheck if
install
1. Deployment automation
22Copyright © 2015 NTT DATA Corporation
Kirin EA screen sample (e.g. Apace HTTP Server)
change paramater of kernel settings (/etc/sysctl.conf)
change parameter of /etc/sysconfig/httpd
change parameter of /etc/httpd/httpd.conf
1. Deployment automation
23Copyright © 2015 NTT DATA Corporation
Kirin EA registers instances with Big-IP/Hinemos automatically.
Operator1. Deployment
Request
2. Deployment automation
1. Deployment automation
Kirin EA
3. register
Big-IP
24Copyright © 2015 NTT DATA Corporation
Kirin EA suspends balancing/monitoring setting from Big-IP/Hinemos automatically.
Resume also works.
Operator1. Instance
stop
3.Stop instances
1. Deployment automation
Kirin EA
2. suspend
Big-IP
25Copyright © 2015 NTT DATA Corporation
2. Testing automation
Mission: “Getting automatically tested server.”
Testing automation enables to reduce the costs almost exactly zero compared to usual manually methods.
Kirin EA testing automation consists of,• Parameter test• Function test (e.g. process-start/stop, log error check)• Apache-Tomcat(modjk) connectivity test• DB access test• Load-balancing(BIG-IP) test• Monitoring(Hinemos) test ..etc
26Copyright © 2015 NTT DATA Corporation
2. Testing automation
• Testing tools1. Serverspec
• Parameter check, state check, command result check..etc
2. Original scripts BIG-IP test
• Health check works correctly?• Failover works correctly in the case of server down?
Hinemos test • Registered correctly?• Monitoring is started correctly?
DB (Oracle) test• Databases access works correctly with new user?
describe file('/etc/sysconfig/i18n') do its(:content) { should match("^LANG=ja_JP.UTF-8") }end
e.g.
27Copyright © 2015 NTT DATA Corporation
• Test result is reported automatically.• In the case of Linux deployment with full middleware, +140
test cases will be executed.
2. Testing automation
Test results summary
Automated test report
Test result summaryOK or NG
Server information
Test score
28Copyright © 2015 NTT DATA Corporation
• Before Kirin OpenStack implementation, IT assets were managed inconsistent way.
3. Consistent inventory management
…by the way, how many servers we have?does anyone know it?
29Copyright © 2015 NTT DATA Corporation
3. Consistent inventory management
• Kirin EA uses “metadata service” in order to tag servers with metadata.
• Kirin EA user can get all server list anytime.
“application number": "12345",“sector name”: “sales group", “ipaddress-01": “10.1.10.23",
"os": "Windows2012R2“,“cpu”: “2”,
“memory”:”8GB”middlewares:[
“Java JRE 8u60” “Apache Tomcat”
・・・
metadata sampleget sever list!
30Copyright © 2015 NTT DATA Corporation
3. Consistent inventory management
• Kirin EA also manages servers which are moved from other infrastructure by P2V or V2V.
• Operator inputs metadata manually on each server after migration.
P2V V2V
EOLEOL
metadatametadata
31Copyright © 2015 NTT DATA Corporation
How we implemented OpenStack?
• Install OpenStack was completely easy. IBM OpenStack provides each OpenStack Component as a
VMWare virtual server. • Implementation of availability.
Use the VMware HA technology.
Compute Cluster
OpenStack components
VMware HA
Storage
Controller ClusterVMware #1 VMware #2
nova
cinder
neutron
keystone
VMware HA
32Copyright © 2015 NTT DATA Corporation
How we use the OpenStack?
• OpenStack version: Icehouse• Virtual technology: VMware• Used components:
• Nova, Cinder, Neutron, Keystone.
Implementing OpenStack is NOT our primary purpose.
Stable, cost effective, easy to use and easy to operate platform is customer requirement.
We implemented OpenStack as simple as possible.
Copyright © 2015 NTT DATA Corporation 33
4. Summary and suggestions
34Copyright © 2015 NTT DATA Corporation
Summary and suggestion
Summary
Suggestion
It is sufficient to implement IaaS with OpenStack as an enterprise level.
Not only automated building, but also automated testing is effective.
Retaining aging IT infrastructure with OpenStack will spreads more and more in Japan.
1. Using OpenStack as PaaS Fast and easy implementation of PaaS function on
OpenStack is helpful.
2. Hybrid Cloud API compatibility for AWS
3. Software-defined infrastructure with converged infrastructure Free from management of Storage on OpenStack.
Copyright © 2011 NTT DATA Corporation
Copyright © 2015 NTT DATA Corporation
All product names mentioned are trademarks or registered trademarks of the respective companies. 記載されている商品名はみな各社の商標または登録商標です