vt445-1: linux on power8 trends and directions mitec june 2016 smith/linuxonpowertrends2016 .pdf ·...
TRANSCRIPT
© Copyright IBM Corporation 2016.
VT445-1:Linux on POWER8Trends and Directions
Tracy SmithStrategic InitiativesClient Technical ExecutiveIBM - [email protected]
MITEC June 2016
© 2016 IBM Corporation
Welcome to the waitless world
2
New Enterprise value is coming from the use of IT to engage clients & leverages the confluence of 5 important technology trends
© 2016 IBM Corporation
Welcome to the waitless world
3
Enterprise value is rapidly changing. Computing continues to evolve from Data Center systems and Databases.
Cross Platform Operating System of choice: Linux
Operating Systems:Unix/AIX, IBM i, z/OS, MVS, VM, Windows
Windows, iOS, Linux
© 2016 IBM Corporation
Welcome to the waitless world
4Source: IDC Forecast
Linux servers will account for 38% of all server revenue - Windows servers will be 50% by 2019Linux is growing at 8% while Windows is growing at only 3% a year through 2019
CGR
3%
8%
Unix
38%
50%
Share2019
8%CGR
© 2016 IBM Corporation
Welcome to the waitless world
5
Topics
The Linux on POWER strategies Software: Standardize around open source Hardware: Disrupt the industry with open innovation
The Linux distributions RedHat RHEL, Canonical Ubuntu, SUSE SLES, CentOS
IBM’s Power Systems KVM on Power Docker on Power Accelerators on Power – FPGA, GPUs
© 2016 IBM Corporation
Welcome to the waitless world
6
Linux on Power Strategy - Same Linux Experience, Better Results
Ecosystem
• OpenSource and ISV support • Little endian base - OpenStack API support• The Three Major Linux Distros • OpenPOWER Foundation• Digital purchasing enabled from IBM
Linux is a common base
Value add Infrastructure
Supported by Canonical
• Comprehensive Portfolio• Price/performance advantaged Linux only offerings• POWER8 Processor built for data• CAPI technology• OpenPOWER Community Innovation
Solutions Differentiated for Client Value
• Big Data and Analytics• Delivering differentiated integrated
solutions leveraging in-memory, flash, and acceleration technologies
• Cloud• Delivering tailored offerings and reference
configurations to Services Providers and MSPs
• Open Source• Deliver optimized e-Commerce and Big
Data business application stacks from operating systems to scripting languages and databases
Infrastructure matters
© 2016 IBM Corporation
Welcome to the waitless world
77
5 IBMers contributing to Linux and Apache Projects
1999
IBM is investing in ecosystems and open innovation
100+ OpenPOWER-based innovations under way
2015 50k+ IBMers contributing to 150+ open organizations
1. Source: https://developer.ibm.com/start/
© 2015 IBM Corporation
1
1
© 2016 IBM Corporation
Welcome to the waitless world
8
IBM Linux engineering assertions for Power
Virtualization / Containers
Linux Operating Systems
Cloud Infrastructure
Supported by Canonical
Linux = Common LinuxKVM = Common KVM
Containers = ContainersOpenStack = OpenStack
Bare-metal supportKVM guest support
PowerVM LPAR support
© 2016 IBM Corporation
Welcome to the waitless world
9
Linux rolling out – latest statusRHEL 7.2 available (BE & LE)
• Announced and available - November 2015• Continues to deliver both LE and BE versions – LE is where the investments continue• Both LE and BE runs in PowerVM LPARs and in KVM guests• LE supports “L” and “LC” systems bare-metal• LE supports Nvidia K80 GPUs bare-metal in the S822LC• LE introduces RHEL support for CAPI adapters (phase 1 support)
CentOS 7.2 ppc64le now available • Normal “community supported” operating system. No formal IBM support.
Ubuntu 16.04 LTS (LE only) now available - April 2016
Ubuntu 15.10 (LE only) available • Continues to be POWER8 LE only.• Delivers an updated CAPI interface (phase 2 support)• Supports “L” and “LC” systems bare-metal• Selected features will roll into Ubuntu 14.04.x LTS release in the future
SLES 11 SP4 (BE only) being updated for larger memory footprint on E880 systems • Up to 32TB in a single LPAR
SLES 12 SP1 (LE only) available • Continues to be Power8 LE only• Support “L” systems bare-metal – “LC” expected to be added in next update
© 2016 IBM Corporation
Welcome to the waitless world
10
RHEL 7.2 (BE and LE)• RHEL 7.2 now available • Runs in POWER8 exploit mode on P8• BE with POWER7 in p7compat mode• LE now exploits P8 bare-metal “L” and “LC”• CentOS 7.2 ppc64le now available • RHEV for Power available
RHEL 6 (BE only)• RHEL 6 U5 on POWER8 (P7compat mode)• Full support of POWER6 and POWER7 (native mode)
Fedora (LE)• Power support since Fedora 16• Fedora 20 introduces Power8 support• Fedora 25 actively being worked – LE is the focus• Docker enabled in Rawhide, Fedora 23
Supported Add-ons• Jboss, High performance network add-on
➢
➢
➢
Same Linux source and distribution release schedules as x86.Simplified x86 application porting and migration with little endian distributions.Enterprise support for all three Enterprise Offerings – available from IBM or distributors.
Power Linux support
New
SLES 12 SP1 (LE only)• SLES 12 SP1 now available • Runs in POWER8 exploit mode on P8 • LE not supported on POWER7 systems• Exploits P8 bare-metal “L”
SLES 11 SP4 (BE only)• Runs in selective POWER8 exploit mode on P8• Full support of POWER6 and POWER7 (native mode)• Current base for SAP HANA engagements
OpenSUSE (LE)• openSUSE 12.2 introduced updated POWER support• openSUSE 13.2 introduces POWER8 support• Docker now enabled in “Tumbleweed”
Supported Add-ons• SUSE Linux Enterprise HA
Ubuntu 16.04 LTS (LE only)• 16.04 available now - April 2016• Runs in POWER8 exploit mode on P8• LE not supported on POWER7 system• Exploits P8 bare-metal “L” and “LC”• Delivers KVM host capability
Ubuntu 14.04.x LTS (LE only)• 14.04.4 available today. “.5” will be last update.• Exploits P8 bare-metal “L” and “LC”• KVM hosting enabled (14.04.2)
Ubuntu standard releases (LE only)• 15.10: “LC” enablement, CAPI enhancements• 15.04: Docker enablement, initial FPGA support• 14.10: Nvidia K80 GPU support
Debian (LE) • POWER8 LE supported with Jessie (v8) release
Supported Add-ons• JuJu charms, MaaS (metal as a service), Landscape
© 2016 IBM Corporation
Welcome to the waitless world
11
Partnering to provide a complete support solution for implementing and managing the Linux operating system in enterprise server and cloud
environments
• IBM now delivers consistent little endian support for the enterprise across leading Linux distributors: Red Hat, SUSE, Ubuntu
• One Contract, One Phone Number for Linux environment support
• IBM’s support approach focuses on speed to resolution
• Seamless collaboration on multi-vendor products as your single source provider
LE LE LE
IBM Supports Linux for the Enterprise
© 2016 IBM Corporation
Welcome to the waitless world
12
Hypervisor/OS Support for POWER8 Scale-Out Servers
•As of 10/5/15 announce2015
2015
© 2016 IBM Corporation
Welcome to the waitless world
13
Linux on Power transitions to little endian
Standard Release Support Extended Release Support Release/updateRed Hat lifecycle information - https://access.redhat.com/support/policy/updates/errata/SUSE lifecycle information – https://www.suse.com/lifecycle/Ubuntu lifecycle information - https://wiki.ubuntu.com/Releases
Today20092006 2007 2008 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019
SLES 12 (4Q14)
14.04 LTS (4/14) LE
LE
RHEL 7 (6/14) BE
Projected release/update
14.10 (10/14) LE
7.1LE
15.04 (4/15) LE15.10 (10/15) LE
RHEL 6 (11/10)BE
SLES 11 (3/09)BE
7.2
16.04 LTS LE
LE17.04LE
LE 17.10
16.10
© 2016 IBM Corporation
Welcome to the waitless world
14
Little endian simplifies software on Power POWER8 processors support execution in both big endian (BE) and little endian mode (LE) Most compiled open source software is designed (defacto) to run in little endian mode. Linux on Power has chosen to exploit little endian (LE) processor mode based on OpenPOWER partner feedback.
Eases the migration of applications from Linux on x86. Enables simple data migration from Linux on x86. Simplifies data sharing (interoperability) with Linux on x86. Improves Power I/O offerings with modern I/O adapters and devices, e.g. GPUs.
LE distributions for Linux on Power does NOT mean x86 applications magically run: applications must still be compiled for Power. LE enablement is facilitating discussions with new partners and software providers for Linux on Power AIX and IBM i will remain BE
BE and LE are simply different ways of ordering of how data is stored. Important in 1980.Not as important in 2013.Market has moved.
© 2016 IBM Corporation
Welcome to the waitless world
15
What is the deal with Big Endian (BE) and Little Endian (LE)?It is how you store values (bytes) in memory
For example: 2427130573 (in Decimal) 90AB12CD (in Hexadecimal)• It will take 4 bytes of memory to store this number
Big Endian (“Big End First”)Memory 1000 1001 1002 1003Value 90 AB 12 CD
90 AB 12 CD
Memory 1000 1001 1002 1003Value CD 12 AB 90
Little Endian (“Little End First”)
More Info: http://en.wikipedia.org/wiki/Endianness
POWER8 is Bi-Endian. The system supports both Big Endian and Little Endian operating Systems on
the same system, at the same time, in LPARs or in KVM guests. The latest Ubuntu, RHEL and SLES releases all support LE.
Used by mainframe, pre-POWER8 with Linux, SPARC, Macintosh AIX and IBM i have been and will remain “BE”
Used by Intel x86, VAX/VMS and now POWER8 with Linux
© 2016 IBM Corporation
Welcome to the waitless world
16
Where is Linux LE and BE going?The latest operating systems from SUSE and Canonical and Red Hat are available in LE mode -- starting with POWER8-based systems
• SLES 12, all Ubuntu ppc64le releases, RHEL 7 • Footnotes:
• Ubuntu has an older BE powerpc release originally targeted for older processors and Power-Mac • RHEL 7 continues to be currently available as a BE based operating system
Future new Enterprise Linux versions are expected to continue on a LE focused approach• IBM’s product, technology, software, and solution offerings for Linux on Power are expected to
continue to focus on LE more strongly in the future
• Bare-metal boot on POWER8 and future POWER9 systems are developed on the LE base
• Nvidia’s GPU adapters are dependent exclusively on the LE base
There are numerous examples of other Linux offerings which continue to have community advocates and enthusiasts for BE based versions (powerpc, ppc64, etc) which demonstrates the depth and interest from the Power ecosystem. See next chart.
© 2016 IBM Corporation
Welcome to the waitless world
17
Big Endian and Little Endian LinuxBE
powerpcBE
ppc64LE
Ppc64le (or el)Debian in general Yes Yes Yes
Debian v9 (“stretch”) Yes No Yes
Fedora No Yes Yes
RHEL 6.x No Yes No
RHEL 7.x No Yes Yes
Future RHEL new version for Power9 No No Yes
SLES 11 No Yes No
SLES 12 No No Yes
Future SLES new version for Power9 No No Yes
Ubuntu 14.04.x Yes No Yes
Ubuntu 14.10, 15.04, 15.10 Yes No Yes
Ubuntu 16.04.x Yes No Yes
Future Ubuntu new version for Power9 tbd No Yes
© 2016 IBM Corporation
Welcome to the waitless world
18
Built with open innovationput your data to work across the enterprise
Designed forBig Data
Open Innovation Platform
Superior Cloud Economics
IBM Power Systems built on
© 2016 IBM Corporation
Welcome to the waitless world
19
Unstructured Content / Data Analytics• Content Analytics• Discovery• Search• Text Mining• Cognitive Platforms• Rich Media Analytics• Language Analytics• Hadoop
Structured Data Analytics• End-User Query• Reporting and Analysis Tools• Predictive Analytics• GIS
Structured Data Management• Relational Database Management Systems
(RDBMS)• Non-relational Database Management
Systems (NRDBMS)• Database Development and Management• Data Integration and Access
CGR
13%
11%
10%
8%
Source: IDC 2015 Workload Study and Forecast
Data management workloads are the fastest growing in the Linux market Leading that growth is the use of Linux for unstructured data
13%CGR
© 2016 IBM Corporation
Welcome to the waitless world
20
RELATIONALOracle SQL Server
DB2 MySQL
The world of data is changing
Growth Drivers
• Open Source Databases
• Big Data / Unstructured data
• Large volume of transactions
• Scalability and agility
• Cost and efficiency
NoSQL is the Fastest Growing Sector
Redis
In MemoryNoSQL
Addressing changing data paradigms
Open Source Alternatives for traditional Relational DB
“By 2018, more than 70% of new in-house applications will be developed on an OSDBMS and…”
“50% of existing commercial RDBMS instances will have been converted or will be in process.”
GARTNER
© 2016 IBM Corporation
Welcome to the waitless world
21
• Majority of ISVs in the Gartner Challenger or Leaders Quadrant are on Power and have been or are being optimized – with compelling price/performance
• Additional ISVs in the Gartner MQ that are on Linux on Power, showing strong promise
• Another 6 being recruited: Percona, Marklogic, Basho, Areospike, Couchbase
Gartner Magic Quadrant for Operational DBMS – Linux on Power availability
Gartner Magic Quadrant for Operational Database Management Systems (10/12/15)
*
**
** Available as IOP instead of Hortonworks* Available in Open Source as CassandraPorted or Porting on LOP
Recruiting
Key
*** Oracle on AIX, DB2 and SAP on both AIX and LoP
***
***
Focus on a prioritized set of Data Providers for optimization and ecosystem development
CHALLENGERS LEADERS
VISIONARIESNICHE PLAYERS
© 2016 IBM Corporation
Welcome to the waitless world
22
Why Power Systems?
© 2016 IBM Corporation
Welcome to the waitless world
23
4XThreads per core*
4X Mem. Bandwidth*
5XMore cache*
SMT=Simultaneous Multi-Threading
These design decisions result in best performance for data centric workloads like: Database, NoSQL, Big Data Analytics, e-Commerce, Machine Learning
POWER8: Designed for data to deliver breakthrough performance
POWER8SMT8
x86Hyperthread
Parallel Processing
POWER8pipe
Data flow
x86 pipe POWER8
x86 POWER8 + OpenPOWER
x86
© 2016 IBM Corporation
Welcome to the waitless world
24
What's the hardware technology strategy?Open is good: disrupt the industry with open innovation
XC ATXC AT
System Operating Environment Software Stack
A modern development environment is emerging based on tools and services
CloudSoftware
OperatingSystem / KVM
Standard OperatingEnvironment
(System Mgmt)
Software
Power Open Source Software Stack Components
ExistingOpen Source
Software Communities
Firmware
Hardware
New OSS Community
OpenPOWERTechnology
OpenPOWERFirmware
CAPP
PCIe
POWER8
CAPI over PCIe
“Standard Power Products” – 2014
Hardw
are
“Custom Power SoC” – Future
Customizable
Framework to Integrate System IP on Chip
Industry IP License Model
Multiple Options to Design with Power Technology Within OpenPOWER
© 2016 IBM Corporation
Welcome to the waitless world
25
Business Applications
Web, Java Apps and Infrastructure
Database
Analytics & ResearchWorkload requirements
Compute intensive High memory bandwidth Floating point High I/O rates
Workload requirements HPC/HP
A apps
High quality of service Scalability Flexible infrastructure Resiliency and security
Workload requirements
Handle peak workloads Scalability High quality of service Large memory footprint
Workload requirements
IBM InfoSphere BigInsightsBig Data Big Data
Critical workloads run on Linux on Power
Highly threaded Throughput oriented Scale out capable High quality of service
© 2016 IBM Corporation
Welcome to the waitless world
26
The OpenPOWER Foundation is an open ecosystem,
using thePOWER Architecture to serve
the evolving needs of customers.
• Moore’s law no longer satisfies performance gain
• Numerous IT consumption models
• Mature Open software ecosystem
Open Developmentopen software, open hardware
Collaboration of thought leaderssimultaneous innovation, multiple disciplines
Performance of POWER architecture amplified capability
• Rich software ecosystem
• Spectrum of power servers
• Multiple hardware options
• Derivative POWER chips
Market Shifts New Open Innovation
26
The OpenPOWER Foundation
Technology FAB
I/O Networking Storage
FW Open Source SYS
ODM OEM
SW Linux ISV Open Source
Chip SoC Dev IP Dev Technology
FAB
I/O Networking Storage
FW Open Source SYS
ODM OEM
SW Linux ISV Open Source
Chip SoC Dev IP Dev
WEB 2.0 Data Center MSP Cloud
Members And growing ….
120+
© 2016 IBM Corporation
Welcome to the waitless world
27
IBM, Mellanox, and NVIDIA awarded $325M
U.S. Department of Energy’s CORAL Supercomputers
IBM & UK’s STFC Partner for Big Data & Cognitive Computing Research in £313M Partnership
CORAL: Leadership Class Supercomputers
5X – 10X HIGHER APP PERF THAN CURRENT SYSTEMS5X – 10X HIGHER APP PERF THAN CURRENT SYSTEMS
US & UK Research Establishments Select OpenPOWER Based Supercomputers
http://www.stfc.ac.uk/news/new-facility-helps-uk-business-exploit-high-performance-computing/
http://energy.gov/articles/department-energy-awards-425-million-next-generation-supercomputing-technologies
© 2016 IBM Corporation
Welcome to the waitless world
28
28
© 2016 IBM Corporation
Welcome to the waitless world
29
Power S8xx1‐2 sockets, 2U‐4U
Scale‐out
POWER8 Virtualization
Power E8xx4‐8 sockets
PurePower
Linux BE Apps mainly in market but LE is future and strategic focusWith all virtualization enabled for LE Distros SLES 12, Ubuntu & RHEL 7.1LE PowerVM June 2015 release finished complete LE enablement on P8 systems
IFLs
Power S8xx LLinux Scale‐out
RHEV for Power
Power S8xx LCLinux Scale‐out
Bare Metal Supported w/Ubuntu 14.04.3, RHEL 7.2LE, SLES 12 SP1, Ubuntu 16.04
Bare Metal Supported w/Ubuntu 14.04.3, RHEL 7.2LE
Ubuntu 16.04
2015
RHEV for Power
© 2016 IBM Corporation
Welcome to the waitless world
30
Software SolutionsSoftware Solutions
Power ISVsPower ISVs
Linux Open SourceLinux Open Source
WebSphere Application Server
Powered by
Linux Distributions(with KVM)
Linux Distributions(with KVM)
Robust solutions from IBM, ISVs & the Open Source Community
© 2016 IBM Corporation
Welcome to the waitless world
31
The IBM SDK for Linux on PowerIntegrated Development Environment (IDE)
Includes IBM Advance Toolchain Integrates classic Linux performance analysis tools Plus, value‐added tools for Linux on Power !
For developing, porting, and optimizing C/C++ applications for Linux onPower Provides tips and fixes on migrating and optimizing Available for x86_64, ppc64, and ppc64le Works on most Linux distributions (Red Hat, SUSE, Ubuntu, Fedora, ...)
“Built on Eclipse” is a registered trademark of the Eclipse Foundation
© 2016 IBM Corporation
Welcome to the waitless world
32
IBM is the real threat to Intel’s server dominance“The level of support behind the OpenPOWER Foundation leads me to believe that IBM has a real chance at ending Intel's server chip monopoly.” [Motley Fool]
“If you need to handle massive amounts of computational data faster than you are now, IBM has rolled out new systems just for you.”[CIO-Today]
On Nov. 17th, CRN announced that IBM Power Systems S822L won a 2014 Tech Innovator award. [CRN]
OpenPower Sees Momentum Going Into 2015 [eWeek]
Rackspace to Reduce Intel Reliance With IBM-Led Group [Bloomberg]
POWER8 is everything Intel's Xeon wants to be when it grows up[Seeking Alpha]
What the industry is saying
© 2016 IBM Corporation
Welcome to the waitless world
33
POWER8 Linux Only scale-out servers for clusters, cloud and Enterprise RAS
S822L2 socket, 2U, Up to 24 cores
S812L1 socket, 2U, Up to 12 cores
S824L2 socket, 4U, Up to 24 cores
“L”Server line
PowerVM or PowerKVM PowerVM or PowerKVM PowerVM or PowerKVM
Clients value RAS & price/performance
S822LC2 socket, 2U, Up to 20 cores
S812LC1 socket, 2U, Up to 10 cores, 14 HDDs
“LC”Server line
For Big Data For Commercial Computing
S822LC2 socket, 2U, Up to 20 cores
For High Performance Computing2015
PowerKVM
Clients value open innovation and TCA
* Pricing is based on web pricing for S812LC http://www-03.ibm.com/systems/power/hardware/s812lc/buy.html
PowerKVM PowerKVM
© 2016 IBM Corporation
Welcome to the waitless world
34
Server model IBM Power S822LC HP DL380 Gen9
Processor / cores Two 3.32 GHz, 8-core POWER8 processor
Two 2.3 GHz, 18-core, Intel E5-2699 v3 Haswell processors
Configuration 128 GB, 2 x 1TB SATA 7.2K rpm HDD, 1 Gb 2-port, 2 x 16gbps FCA
System Cost-Server + RHEL OS + EDB Annual Subscription @ $1,750 per core
$47,446($18,147 + $1,299 + $28,000)
$93,539($29,240 + $1,299 + $63,000)
EDB pgbenchTotal Transactions per Second 406.6k 500.2k
TPS per dollar 8.57 tps/$ 5.35 tps/$
60% better
IBM Power S822LC
(16-core, 128GB)
$18,147
HP DL380 Gen9(36-core, 128GB)
$29,240
EnterpriseDB 9.4and
Linux on POWER8Vs.
Linux on Intel Haswell
Pricing is based on web pricing for S822LC http://www-03.ibm.com/systems/power/hardware/s822lc-commercial/buy.htmlEDB 9.4 http://www.enterprisedb.com/products-services-training/subscriptions-powerand HP DL380 Gen9 https://h22174.www2.hp.com/SimplifiedConfig/Index
EnterpriseDB 9.4 - IBM Power S822LC ($US) - vs. HP with Haswell
•Results are based on IBM internal testing of single system and OS image running with pgbench work load at scale factor of 1000 and are current as of March 16, 2016. Individual results will vary depending on individual workloads, configurations and conditions. OS and EDB support price is for 1 year duration and Hardware is 3 yr standard support.•IBM Power System S822LC; 16 cores / 64 threads, POWER8; 3.3 GHz, 128 GB memory, EDB 9.4, RHEL 7.1•Competitive stack: HP Proliant DL380 Gen9; 36 cores / 72 threads; Intel E5-2699 v3; 2.3 GHz; 128 GB memory, EDB 9.4, RHEL 7.1•Both tested configurations represent the highest processor frequency for that specific processor
1.8XBetter per
core
Higher POWER8 per-core performance generates
significant TCO savings
WebPrices
© 2016 IBM Corporation
Welcome to the waitless world
35
• 10, 12 Cores• 3.0 – 3.52 GHz• KVM, PowerVM, Bare metal
• 16, 20, 24 Cores• 3.0 – 4.15 GHz• KVM, PowerVM, Bare metal
70 PVUs for IBM SW on any Core running Linux70 PVUs for IBM SW on any Core running Linux
• 20, 24 Cores• 3.0 GHz, 3.42• (1‐2 NVidia GPUs)• Bare metal
PowerE870
• 8 to 80 Cores• 4.0 ‐ 4.19 GHz• 8TB memory• PowerVM
PowerE880
• 8 ‐ 192 Cores• 4 ‐ 4.35 GHz• 16TB memory• PowerVM
PowerE850
• 16 to 48 Cores• 3.0 – 3.7 GHz• 4TB memory• PowerVM
Clients value performance and reliability and TCO in
the Scale‐Out Space
Clients value enterprise class features, robustness
Clients value converged
infrastructure
Power S824L
Power S822L • S822/S822L nodes
• Storwize V7000• OpenStack Mgmt• PowerVM, KVM (1H16)
Linux on POWER8 – Winning with Clients Across the Portfolio
• 16, 20, 24 Cores• 3.0 – 4.15 GHz• 0‐2 NVidia GPUs• KVM, PowerVM, Bare metal
Power S822LC
Power S812LC
• 16, 20 Cores• 2.92 – 3.32 GHz• 0‐2 NVidia GPUs• KVM, Bare metal
• 8, 10 Cores• 2.92 – 3.32 GHz• 14 LFF drives• KVM, Bare metal
Clients value open innovation and TCA/TCO
Power S812L
2015
2015
2015
Designed for big data
Ideal for data in the
cloud
© 2016 IBM Corporation
Welcome to the waitless world
36
KVM on Power enables open deployment
H/W Management- Custom scripting- Heavily Automated- Open technologies
Platform Management- Custom management- Cloud based
– Bring base components in parity with KVM on x86 – “KVM should be KVM”– Co-exists peacefully with other end-points, whenever makes sense.– Enables hybrid clouds with common management environments
Manage
Provision
Deploy
Procure
xCat, PuppetChef, custom scriptsPXE, IPMI
OpenStackCustom Scripts
IBM product (PowerKVM) provides integration with IBM Cloud products
Enables KVM products from Linux vendors –Ubuntu KVM, RHEV, others
Manage
Provision
Deploy
Procure
Strategy:
© 2016 IBM Corporation
Welcome to the waitless world
37
PowerKVM feature / function deliveredGA 2.1
June 2014“Open Cloud”
Bug fixes Full host I/O Adapter support PCI Passthrough Support Guest Dynamic DMA support Guest EEH oVirt/VDSM 3.4 tech preview ESA agent integration PMLinux integration Mixed Mode BE & LE Guests EnergyStar SW enablement
Fast sleep, Deep Winkle In-band power throttle notification
Open vSwitch GRE tunneling Transparent Huge Page (thp) Guest support P8 Micro Partition Prefetch (mpp) exploitation
PCI passthru for nVIDIA (Tech. Preview) Guest hot add / remove (CPU and Memory) Dynamic Micro-Threading PowerKVM bare metal management via
OpenStack OpenStack Ceilometer support for Power
platform sensors and hardware counters Install improvements – automated installations Storage mobility Performance Improvements – Interrupt
Optimizations
GA 2.1.1Oct. 2014
“Refresh”
GA 3.1Nov. 2015
“Enterprise virtualization”
Supported GuestsBE – RHEL 6.5, SLES 11 SP3, RHEL 7.0LE – Ubuntu 14.04 LTS
Supported Hardware with GA 2.xS812L, S822L
Additional Supported GuestsBE – RHEL 6.6LE – SLES 12.0, Ubuntu 14.10
New
Dynamically create/delete VM's ST, SMT2, SMT4 guests P8 basic support
Static split core support SMT=8 host/guest enablement
CPU, memory, I/O affinity Memory over-commit Memory sharing – data dedup (KSM) Limited host I/O adapters Platform RAS
Memory error handling, Error logs, EEH, Power RAS tools
Host hot plug I/O VM migration PAPR-style paravirt interface Linux “virtio” virtual I/O devices USB emulation Guest VGA over VNC Livbirt, virsh Guest boot firmware (SLOF) All BE or all LE guests Kimchi virtualization management PowerVC SCE
© 2016 IBM Corporation
Welcome to the waitless world
38
PowerKVM 3.1
Customer benefits•Enables ecosystem for simpler porting of I/O drivers and host software•Provides new I/O options with improved performance and quality of service controls•Provides more flexibility for dynamically adding VM resources•Automatically sets Micro-Threading on the system based on the workload requirements
What’s new / key features•PowerKVM Host now runs in Little Endian Mode•SRIOV NIC Adapter Support•vCPU and Memory Hot plug support•Dynamic Micro-Threading
PowerKVM is the Open Choice for Power Systems Virtualization and is being enhanced to support new improved I/O and improved availability, performance and reliability.
New
© 2016 IBM Corporation
Welcome to the waitless world
39
KVM on Power directions1.Encouraging KVM across the operating systems and partners
• IBM PowerKVM -- RHEV for Power -- Ubuntu KVM -- others 2.Expand the ecosystem - OpenPower
• Deliver repository for KVM on Power technologyopen-power.org based. Presented at April 2016 OpenPOWER summit Base HostOS support for successive generations of processors, platforms, technologiesVirtualization layer to support legacy OS on new platforms – HAL like layer
3.Expand and extend KVM and technology virtualization• SRIOV enablement and exploitation • Research and extend accelerator technologies - FPGA and GPU virtualization• Performance optimizations
© 2016 IBM Corporation
Welcome to the waitless world
40
Docker Availability on POWER
• Docker Engine available as part of base distribution packages from Ubuntu 15.04 and Fedora 23 onwards
• Docker can be built from source on various Linux distros on POWER
• Ubuntu, RHEL 7, SLES 12 etc• Master builds are available here: https://master.dockerproject.org
• Refer for more info - https://www.ibm.com/developerworks/library/l-docker
• Docker image registry can be compiled on different Linux on POWER distributions
• Multi-arch registry is work in progress https://gist.github.com/estesp/a3546f3cf24d2fc9cecc
• IBM is working with the community to make additional images available for POWER in Docker Hub
• https://hub.docker.com/u/ppc64le/• Ubuntu, Debian, gcc are already available
© 2016 IBM Corporation
Welcome to the waitless world
41
IBM Power team creating Docker images for Power
• Starting from the general porting work for Open Source on Power, the team is also creating Docker images for Power
• Target is to have the top 100 most popular1 Docker containers available on Power by YE15, currently in the 70's
• Once dockerfiles are created, the changes are being merged back into the open source communities
• We are working with the Dockerhub image build community to have Power container images built for and available in DockerHub
• Base images have already gone through this process and are available today https://hub.docker.com/u/ppc64le/
Note 1: driven by DockerHub usage metrics
© 2016 IBM Corporation
Welcome to the waitless world
42
Docker on POWER: SummaryDocker is available to use on POWER platforms today
• Same code and open source model as used in the industry today• Exact Same Usability and Experience as on other platforms for developers• Same Build process as other platforms in the indsutry• Same tool chains and Modern Scripting Languages available for Power• Growing ecosystem of dockerized applications for POWER and increasing
community engagement
Docker is Better on POWER– Greater System Capacity to run Typical Cloud Native Docker Workloads– More containers per system lowers cost of operations for service providers– Power excels at data oriented workloads running in containers
You can run thousands Docker containers on a single POWER system
© 2016 IBM Corporation
Welcome to the waitless world
43
Workload Accelerators and Power
Field ProgrammableGate Array
GraphicsProcessingUnit
FlashSystem
Description
Reconfigurable hardware
Task customized, low latency, low power
1000s of simple cores
High bandwidth, floating point, and parallelism
Fast non-volatile storage
High IOP storage access
ExampleUse Cases
Compression, encryption, high speed streaming, search, Monte Carlo simulations
Deep neural networks, simulations, JAVA, Hadoop, graphics
In memory databases, data aggregation
Power ChipIntegration
Coherent Accelerator Processor Interface(CAPI)
PCIe (today);NVIDIA NVLink (SOD*)
Coherent Accelerator Processor Interface(CAPI)
*All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
© 2016 IBM Corporation
Welcome to the waitless world
44
Coherent Accelerator Processor Interface
Non-CAPI
Off-ChipAccelerator
Core
Memory
PC
IP
CI
CAPI
FPGAw/CAPI
AcceleratorP8Core
MemoryP
CI
PC
I
CAPI is a platform to enable accelerationCAPI provides an infrastructure to improve performance of an application through FPGA acceleration
Enables customer-defined acceleration within the processor complexCAPI allows implementation of a wide range of accelerators to optimally address many different challenges
Each implementation is a unique CAPI Solution
© 2016 IBM Corporation
Welcome to the waitless world
45
CAPI and GPU directions – OpenPower technologies
OpenPower technologies continue to drive innovation for Power systems
Linux LE distros deliver the support for FPGA CAPI, Flash CAPI, and GPU implementations
POWER9 will improve the CAPI implementation
Nvidia’s GPU roadmap for K80, Pascal with NVLink, and Volta with enhanced NVLink is supported by Power systems and Linux.
In the future, research teams are working on the challenges of virtualizing – sharing – FPGA and GPU resources.
© 2016 IBM Corporation
Welcome to the waitless world
46
1. Migration from Intel
3. Proprietary technology
4. Application performance
2. Software availability
5. Cost of solution
Little Endian support makes porting Linux on x86 applications even easier
OpenPower Foundation brings innovative solutions to Power Platform
Cutting edge open source technologies such as dockerand Apache Spark are available on POWER8 today
POWER8 Delivers Over 2x Performance Compared to x86
POWER8 Solutions Are 2x Cost Effective than x86
Summary: All Perceived Barriers Removed
© 2016 IBM Corporation
Welcome to the waitless world
47
Linux on Power Community(developerWorks)
Power Systems Linux Portal(Product Information)
www.ibm.com/systems/power/software/linux/
@ibmpowerlinuxplus.google.com/communities/100156952249293416679
http://openpowerfoundation.org/
The OpenPOWER Foundation
Learn more about Linux on Power Systems
© 2016 IBM Corporation
Welcome to the waitless world
48
Thank You!