openstack vps kvm oname com 3 g ipv6

OpenStack + KVM + ipv6 = .com VPS 2013

1

OpenStack + KVM + IPv6 = .com VPS 2013

OSC 2013 Spring, Tokyo: 2013/02/23http://www.slideshare.net/chroum/2012-osc-kyoto-openstack-vps-kvmhttp://www.slideshare.net/chroum/openstack-vpskvmonamecom2snapshot

GMO

OpenStack + KVM + ipv6 = .com VPS 2013

2

.com VPS

VPS

OpenStack Diablo(Nova compute, Nova Network, Keystone, Glance)

; Ubuntu 12.04.2 LTS + Ubuntu cloud

Ubuntu(?)trunk Grizzly

Quantum Network (Open vSwitch plugin)

NIC(IP)(NIC)

IPv6 IPv4 Dual Stack Network

OpenStack + KVM + ipv6 = .com VPS 2013

3

(, Naoto Gohko)

Twitter: @naoto_gohko , Facebook:

: GMO

:

: GMOSI-er

:

Bekkoame INTERNET, 3WEB, webmail, .com web

.com VPS VZ(Virtuozzo) ;

GMO;

.com VPS KVM ;

OpenStack + KVM + ipv6 = .com VPS 2013

4

GMO(1) .com VPS VZ (2) GMO

GMO Public (Xen, KVM)

GMOGMO VPS

(3) .com Desktop

API

KVMwebLB(Brocade ADX)Fusion-IO

KVMPlesk

Hyper-V3, Thin ClientWindows8

Virtuozzo(OpenVZ)OSswapBest Effort

.com VPS KVMLinux KVMVPS

EL6, KVM

SQALE (payperboy&co)

PaaSAPI

VDI, Desktop

Hyper-V VM, Windows

OpenStack + KVM + ipv6 = .com VPS 2013

5

GMO http://cloud.gmo.jp/

TGS 2012

LB/ Fusion IO ioDriveUnit, US-Unit

OpenStack + KVM + ipv6 = .com VPS 2013

6

Xen (CentOS 5.3 dom0 + Xen 3.2)

Scientic Linux / CentOS 6.0 KVM ( CentOS 6.3)

==> VPS-KVMOpenStack Diablo.com VPS KVM

/

GMO

OpenStack + KVM + ipv6 = .com VPS 2013

7

Rubygithubdeployweb

Ruby on RailsSinatraPaaS

SQALE (Payperboy&co, PaaS)

==> web, dbdeploy

OpenStack + KVM + ipv6 = .com VPS 2013

8

.com VPS VZ (Virtuozzo)VPS VZ(Virtuozzo := OpenVZ)

VirtualHostOS (OS)

Linux (FreeBSDReactOS)Swap (OpenVZswap)diskHostOOMkiller

VPS KVM==> OpenStack(OpenVZ, LXC)

OpenStack + KVM + ipv6 = .com VPS 2013

9

.com VPS KVM

(native KVM)

ISO uploadOSLive CD boothttp/https/sshvirtIO ON/OFFGMO()VIF(spoongIP)REST API

OpenStack Diablo().com VPS KVM

OpenStack + KVM + ipv6 = .com VPS 2013

10

VPS

web (.Net + IIS) Windows Server

DB (mysql, Oracle)

(Linux KVM)websocket-VNC(noVNC)ssh/html5 consolesftprabbitmqdhcpldap(dhcp, ssh)nova/keystone DB(mysql)nova Manage/API/Glance

ISO upload storage (GlusterFS, NFS)

Linux KVM (nova Compute) CentOS 6.xnova Compute, collectd, kvm

OpenStack + KVM + ipv6 = .com VPS 2013

11

.com VPS KVM

L3 SWL3 SW

consoleconsole consoledhcp

Internet

consolevnc

API / ManageAPI/nova Manage

mqmqAPI / Managemysql dbnova DBkeystone DB

sftpsftp

API / Managemysql db

/ DB

StorageStorage

ISO storage(NFS)

mqldap

API / Manageweb (.Net)

API

nova Computenova Compute

nova Computenova Compute

nova Compute

nova Computenova Compute

nova Computenova Compute

nova Compute

glance

RAID 10 local disk RAID 10 local disk

OpenStack + KVM + ipv6 = .com VPS 2013

12

.com VPS KVM

Flat DHCP + VLAN bridge(FirewallLinux bridge)

GMONet() L3 SW(dhcp relay) L2 SW Rack L2 SW Linux bonding(act.-stan.) Linux VLAN Linux bridge VM VIF(tap - virtio NIC)

OpenStack + KVM + ipv6 = .com VPS 2013

13

.com VPS KVM

L3 SWL3 SW

Internet

GMO core backbone

consoledhcpnova Compute

L3 SWL2 SW

eth0

bond0

eth1

bridge.VLAN1

bridge.VLAN2

bridge.VLAN3

VMeth0

VMeth0

VMeth0

VMeth0

consoleldap

libvirt network lterebtalbestc htb (iproute)collectd

L3 SWdhcp relaydhcp

LDAPVMMAC ADDRESSIP

Flat

OpenStack + KVM + ipv6 = .com VPS 2013

14

; Ubuntu 12.04.2 LTS Ubuntu cloud

OpenStackFolsom releasetrunkGrizzly

==> (Diablo)==> OpenStack Folsom, Grizzly==> Full Stack (Nova, Compute, Quantum, Glance, Swift, Cinder, Keystone)==> (, )IaaS==> OS(Ubuntu 12.04.2 LTS)

2012/Folsom2013/01APItrunk Grizzly

OpenStack + KVM + ipv6 = .com VPS 2013

15

Ubuntu 12.04.2 LTS Ubuntu cloud;

- OpenStack(build)

* trunk Grizzly* OpenStackcommit* .deb pkgbuild

- kernel()* KVM: Nested KVM* KVM + Qemu: 9p(Plan9)FS[virtFS]network* KVM, Xen, LXC

nova-compute-kvm, nova-compute-xen, nova-compute-lxc

- Quantum; ns(Name Space) routing* 192.168.1.0/24IP

OpenStack + KVM + ipv6 = .com VPS 2013

16

Ubuntu 12.04.2 LTS Ubuntu cloud:

- build

* .deb pkgbuilddpkg.deb

- Ubuntudisk* Mirror...

- Hardware(Driver)- LTS 12.04.1 ==> 12.04.2

* Linux kernel (3.2 >> 3.5)* CentOSlibvirtw

OpenStack + KVM + ipv6 = .com VPS 2013

17

trunk Grizzly; ?

Grizzly Network Interface

- Folsom* (2/20)Grizzly-3>> merged* Quantum, Nova* trunk Grizzly Ubuntu

html5SPICE- VNC&

Bare Metal OpenStack (Proxy compute)- IPMIHardImage Deploy

(NTT DoCoMo, ) LBaaS; LB as a service

- Load Balancer(baseHA Proxy, plugin)- L3()L4, L7

https://launchpad.net/~openstack-ubuntu-testing/+archive/grizzly-trunk-testing

https://wiki.ubuntu.com/ServerTeam/OpenStack

$ sudo add-apt-repository ppa:openstack-ubuntu-testing/grizzly-trunk-testing

$ sudo cat > /etc/apt/sources.list.d/grizzly.list

OpenStack + KVM + ipv6 = .com VPS 2013

19

trunk Grizzly Jenkins build...

>> 4386 1728

0 2624

0 0 34

0

https://jenkins.qa.ubuntu.com/view/Openstack_Testing/view/Grizzly/?

w(jenkins build status)

@@

OpenStack + KVM + ipv6 = .com VPS 2013

20

Quantum Network (Open vSwitch plugin)

Nova NetworkQuantum Network

Open vSwitch plugin==> OpenFlowpluginGrizzly()==> Folsom QuantumFlat VLAN + gre tunnel network

(Open vSwitch 1.9(trunk)VXLAN==> Quantumgre

OpenStack + KVM + ipv6 = .com VPS 2013

21

Quantum Network (Open vSwitch plugin)

QuantumSDN

gre tunnelEdge OverlayVLAN

==> Hardware SW(10GBase-T)

==> Edge SWOpen vSwitchsFlowgre tunnel

OpenStack + KVM + ipv6 = .com VPS 2013

22

Quantum Network (Open vSwitch plugin)

Quantum Folsom

==> FolsomL3 agentL3Flat Quantum cloud-init w

==>

==> Grizzly()

OpenStack + KVM + ipv6 = .com VPS 2013

23

.com VPS KVM

L3 SWL3 SW

Internet

GMO core backbone

consoledhcpnova Compute

L3 SWL2 SW

eth0

bond0

eth1

bridge.VLAN1

bridge.VLAN2

bridge.VLAN3

VMeth0

VMeth0

VMeth0

VMeth0

consoleldap

libvirt network lterebtalbestc htb (iproute)collectd

L3 SWdhcp relaydhcp

LDAPVMMAC ADDRESSIP

OpenStack + KVM + ipv6 = .com VPS 2013

24

Quantum Open vSwitch plugin network gre tunnel>> gre1 hop

ovs>> = Compute+Net Node

gre tunnelOVS VLAN?

Network Node

Compute NodeCompute Node

DHCP Node

VM 1 VM 2 VM 1 VM 2

DHCP server10.0.1.2/24

10.0.1.3 10.0.1.4 10.0.1.5 10.0.1.6

Network Interface

patch port + OpenFlow rule

OVS br-tun

OVS br-tunOVS br-tun

OVS br-tun

OVS br-int

10.0.1.1

iptablesip6tables

OVS br-int

OVS br-int OVS br-int

WAN8.8.0.1

8.8.0.2, Floting IPs

8.8.0.1Public IP GRE

https://review.openstack.org/#/c/21819/1/

OpenStack FolsomNICVMNetwork

==>> NIC(nova)(Quantum)==>> FolsomGrizzly

OpenStack + KVM + ipv6 = .com VPS 2013

26

()(docs.openstack.org)Simple Flat Network Model

VPS

Mixed Flat and Private Network Model

NIC

Shared Network10.0.0.0/24

Tenant Bvm 1

10.0.0.3

Tenant Avm 2

10.0.0.4

Tenant Cvm 1

10.0.0.5

Tenant Avm 1

10.0.0.2

Physical Router

gw: 10.0.0.1

Simple Flat Network Model

Shared Network10.0.0.0/24

Tenant Bvm 1

10.0.0.3172.21.0.3

Tenant Avm 2

10.0.0.4172.20.0.4

Tenant Cvm 1

10.0.0.5

Tenant Avm 1

10.0.0.2172.20.0.2

Physical Router

gw: 10.0.0.1

Mixed Flat and Private Network

Tenant A Private Network172.20.0.0/24

Tenant Bvm 2

10.0.0.6172.21.0.6

Tenant B Private Network172.21.0.0/24

OpenStack FolsomIPv6 only

IPv6 IPv4 Dual Stack NetworkQuantumdhcp agentdnsmasq==> dhcp==> dhcp agentISC dhcp(IPv6, IPv4Dual Stack)==> ISC dhcp + openldapIPv6

IPv4 : 32bit192.168.32.24/24>> .

192 : 8bit10(0 ... 255)=2^8

IPv6 : 128bit

2400:cafe:beef:a00f:0000:0000:0000:0001/64>> : :

2400 : 14bit 16 4bit*32128bit

webVirtualHostNameBaseVirtualIPv4==> SNISSL NameBase Virtual==> IPv6IP Virtual

OpenStack + KVM + ipv6 = .com VPS 2013

28

IPv6 IPv4 Dual Stack Network

IPv4 : 32bit192.168.32.24/23>> /23Global IP

IPv6 : 128bit (Dual Stack)

2400:cafe:beef:a00f:0192:0168:0032:0024/64>> (10)

>> /64

IPv6IPv6 IPDefault dhcpGlobalIPv6(Private)

OpenStack + KVM + ipv6 = .com VPS 2013

29

IPv6 IPv4 Dual Stack ()

dhcpMAC ADDRESSIP

>> OpenStack dhcp agentDual Stack>> dhcp agentDual Stack

>> IPv6, IPv4dnsmasq

ISC dhcp(dhcp agent?)>> ISC dhcpopenldap>> nova, quantumIPopenldap>> RA(IPv6)IPv6ISC dhcpdstateless

OpenStack + KVM + ipv6 = .com VPS 2013

30

IPv6 IPv4 Dual Stack ; dhcpd

IPv6, IPv4

>> Dual Stack(VLAN)dhcpd, dhcpv6d

>> ldapdhcp(v4), dhcp(v6)

OpenStack + KVM + ipv6 = .com VPS 2013

31

IPv6 IPv4 Dual Stack ; dhcpd

DHCP Node

ISC DHCP server10.0.1.2/24

OVS br-tun

OVS br-int

ISC DHCPv6 server2400:cafe:beef:a00f::/64

OpenStack + KVM + ipv6 = .com VPS 2013

32

OpenStack FolsomGrizzly

Quantum; SDN>> OpenFlow

Ubuntu 12.04 LTSHost OS(KVM, Qemu, libvirt, kernel)

IPv6 IPv4 Dual StackOpenStack() dnsmasq

OpenStackx >>

OpenStack + KVM + ipv6 = .com VPS 2013

33

(2)

10GBase-T2013>>

>> GMO>> Gluster + Swift proxy Interface

ISO uploadweb

OpenStack + KVM + ipv6 = .com VPS 2013

34

OSC

60 1GB Plan(nginxWordPress)

OpenStack + KVM + ipv6 = .com VPS 2013

35

Special Thanks!GMO Internet Inc., System Div., SI Team and Cloud Team,Hostingh Team

OpenStack + KVM + ipv6 = .com VPS 2013

36

: TGS 2012 (GMO)

Honda Fit