Manila, an update from Liberty, OpenStack Summit - Tokyo

Download Manila, an update from Liberty, OpenStack Summit - Tokyo

Post on 14-Apr-2017




0 download

Embed Size (px)


<ul><li><p> Manila An Update from Liberty </p><p>October 29, 2015 OpenStack Summit - Tokyo </p></li><li><p>Akshai Parthasarathy </p><p>Technical Marketing Engineer, NetApp </p><p>@akshai </p><p>Sean Cohen </p><p>Principal Product Manager, Red Hat </p><p>@SeanCohen_RH </p><p>Thomas Bechtold </p><p>OpenStack Cloud Engineer, SUSE </p><p>Today's Presenters </p></li><li><p>Agenda </p><p> What is Manila? Why use Manila? </p><p> Use Cases Sahara Containers </p><p> Liberty Updates Distributions Integration </p><p> SUSE Demo RedHat Demo </p><p> Upcoming in Mitaka Share Replication Demo Q+A </p></li><li><p>Manila: The OpenStack Shared File Service Program Bringing self-service, shared file services </p><p>to the cloud </p></li><li><p>Manila History </p><p> Beginnings Juno </p><p> Incubated Project Community Inception Puppet Support Share Servers Tempest Integration </p><p> Kilo Driver Modes DevStack Plug-in Storage Pools Default Share Type Manage/Unmanage Manila UI </p></li><li><p>Manila Today - </p><p> Production Ready Number of Drivers: 14 Blue Prints Completed: 51 Major Blue Prints: </p><p> Share Instances REST API Microversions Experimental APIs Extend &amp; Shrink Consistency Groups (CGs) Share Migrations etc. </p></li><li><p>Manila Deployment Options and Benefits </p><p> Single Storage Virtual Machine (SVM) / Multi SVM driver_handles_share_servers=False/True Benefit </p><p> Network Plugins </p><p> Standalone Network Plugin Nova Network Plugin Neutron Network Plugin Benefit </p></li><li><p>Contributions/New Entrants </p><p>Welcome and Thank You: CloudBase Solutions Fujitsu Scality NEC NTT Letv Cloud Computing and others </p><p> Source:;metric=loc&amp;release=liberty </p><p> Code Contributions Reviews </p></li><li><p>Why Use Manila? </p><p> Shared File Services Spending Total Capacity </p><p> IDC: Age of Cloud File Services Why not? </p></li><li><p>Use Cases </p></li><li><p>Standalone Share File Services Management </p><p> Replace Legacy Systems Improve SLA Integrate with Automation Frameworks </p></li><li><p>Enterprise Applications </p><p> Lower Cost, Heterogeneous Infrastructure Application Porting: Move Workloads to OpenStack </p></li><li><p>DevOps/Continuous Integration </p><p> Pluggable Infrastructure Storage Service Catalog </p><p> Analytics Containers Snapshots &amp; Clones Consistency Groups </p></li><li><p>New in Liberty </p></li><li><p>Share Instances </p><p>Needed for features like: </p><p> share migrations </p><p> replication </p></li><li><p>REST API Microversions </p><p> </p><p>Example: </p><p> client 1 with server 1 =&gt; version 2.3 </p><p> client 1 with server 2 =&gt; version 2.3 </p><p> client 2 with server 1 =&gt; version 2.5 client 2 with server 2 =&gt; version 2.10 </p></li><li><p>Experimental APIs </p><p> Expected to change at any time can be removed without </p><p>deprecation period Usage: needs to set header X-</p><p>OpenStack-Manila-API-Experimental: true </p><p> </p><p>@api_version(min_version='2.1', max_version='2.9') def show(self, req, id): .... stuff .... </p><p>@api_version(min_version="2.4", experimental=True) def my_api_method(self, req, id): .... stuff .... </p></li><li><p>Extend &amp; Shrink </p><p> </p></li><li><p>Consistency Groups (CGs) </p><p> grouping different shares together for the purpose of application data protection (focus of snapshots for disaster recovery) </p><p> example use case: database data and log files are on different shares when doing snapshots for both shares, the data on the shares must be consistent </p><p> supported actions create CG with mutliple shares create snapshot of CG create CG from snapshot </p></li><li><p>External CI For All Drivers </p><p>And others ... </p></li><li><p>Oversubscription </p><p> Tunable for setting provisioned capacity and a subscription ratio added </p><p> Addresses 'infinite' and 'unknown' drivers reported capacity that may lead to oversubscription </p><p> thin_provisoning support needed </p></li><li><p>Share Migrations </p><p> Share Migration allows a share to be migrated from one host pool to another hostpool through the "manila migrate " command, as well as allowing to perform migration between different backends. </p><p> Basic implementation The fallback approach for migration is rsync. </p><p>Slow, inefficient Vendors can utilize API for optimized </p><p>migration </p></li><li><p>Availability Zones </p><p> The availability zones support which was inherited from Cinder was reworked this cycle: </p><p> Added public API extension Allow to preserve AZ if creating a share </p><p>from a snapshot and set AZ in Share API or Share Manager. </p><p> AZs will benefit share replication and also give end users control of the locality of their data w.r.t. consumers of the data. </p></li><li><p>Sahara Integration </p><p> Use cases Stores binaries for job templates - NFS is ideal for this case Input and output data sources - Manila-provisioned HDFS and NFS offers more </p><p>options Mount NFS share API </p><p> Binaries and data I/O from an NFS share path New development in Sahara this cycle Mount shares at cluster creation or auto-mount when a share is used for EDP </p><p> Manila-provisioned HDFS Data sources and data processing on Sahara-external clusters Testing and process verification of extant Manila features this cycle </p><p> Coming soon - NFS Hadoop driver (run jobs on your NFS shares) </p></li><li><p>Sahara Integration - Current Implementations </p><p> Data sources on Manila-provisioned HDFS </p><p> API to mount NFS shares to clusters (job binaries and data sources) </p><p>Images by Weiting Chen (Intel) </p></li><li><p>Manila + Containers Ceph Example Simply mount --bind share into container namespace NFS re-export from host </p><p> mount and export fs on host private host/guest net avoid network hop from NFS </p><p>service VM Host mounts CephFS Bind Manila share/volume into </p><p>container Further integration requires </p><p>integration with both Nova and Manila to manage the attach/detach process </p><p>HOST </p><p>M M </p><p>RADOS CLUSTER </p><p>CONTAINER </p><p>MANILA </p><p>NATIVE CEPH </p><p>CEPH.KO </p><p>NOVA </p></li><li><p>Distributions Integration </p></li><li><p>Manila in SUSE OpenStack Cloud </p><p> The Manila service is tech preview in SUSE Cloud 5 </p><p> Fully supported in SUSE OpenStack Cloud 6 </p><p> Crowbar deployment tool integration </p><p> Controller HA </p><p> NetApp driver </p><p> Custom driver possible </p></li><li><p>Manila in SUSE OpenStack Cloud 6 (Beta) </p><p> </p></li><li><p>Manila in RHEL OpenStack Platform 7 </p><p> The Manila service is tech preview in RHEL OpenStack Platform 7 </p><p> RHEL OpenStack director deployment tool Offer integration with </p><p> GlusterFS native Gluster NFS NetApp drivers </p><p> Manila Certification program in RHEL OpenStack Platform 8 </p><p> Introducing NFS-Ganesha and Gluster Automated Volume Management (based on Heketi) </p></li><li><p>Manila in RHEL OpenStack Platform 7 (Preview) </p><p>; </p></li><li><p>Upcoming </p><p>in Mitaka </p></li><li><p>Upcoming in Mitaka </p><p> Mount Automation Rolling Updates Export Location Metadata Manila QoS Capability Lists Interaction Between New Features Share Migration Loose-ends Remove All Extensions Architectural Directions For New 1st-party Drivers Share Replication </p></li><li><p> Non Disruptive Operations High Availability </p><p> Availability Zones Failures within an AZ </p><p> High Availability Solution Clustered Storage </p><p> Failure of an AZ High Availability Solution </p><p> Share Replication </p><p>Manila State of the Art: Share Replication </p></li><li><p>Demo #3: Share Replication </p></li><li><p>GET INVOLVED WITH MANILA! Manila Resources </p><p> </p><p> #openstack-manila on IRC (Freenode) Weekly meetings @ Thursday, 15:00 UTC </p><p> NetApp: Red Hat: Suse: </p></li><li><p>MANILA RELATED SESSIONS </p><p> MANILA GENERAL SESSIONS </p><p> Manila and Sahara: Crossing the Desert to the Big Data Oasis: Tuesday, Oct 27 12:05pm OpenStack Manila Hands-on Lab Session: Tuesday, Oct 27 2:00pm The State of Ceph, Manila, and Containers in OpenStack: Wednesday, Oct 28 4:40pm </p><p> UPCOMING MANILA SESSION </p><p> Manila contributors meetup: Friday, Oct 30, 9:00am </p></li><li><p> Q&amp;A </p><p>October 29, 2015 OpenStack Summit - </p><p>Tokyo </p></li></ul>


View more >