ceph and storage management with openattic - suse most - 2016-06-07
TRANSCRIPT
![Page 1: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/1.jpg)
Ceph and Storage Management with openATTICSUSE Monthly Open Source Talks
2016-07-06
Lenz Grimmer <[email protected]>
![Page 2: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/2.jpg)
2
openATTIC – Our Vision
─Develop an open source alternative to proprietary
storage management systems
─„Traditional” unified storage (NAS/SAN)
─Support Ceph for scale-out scenarios
─Backed with commercial support and services
![Page 3: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/3.jpg)
3
openATTIC – Notable Recent Changes
─ Removed Enterprise/Community Edition split
─ Now fully under the GPLv2
─ Removed requirement for CLA
─ DCA (Signed-off-by) is all that's needed
─ Public Jira Bug Tracker
─ Public Pull requests / code reviews on BitBucket
─ Development/Release Branch
─ Entire code base (Backend/WebUI/Test/Docs) in one branch
![Page 4: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/4.jpg)
4
openATTIC – What Sets us Apart?
─ Focus on data center storage management
─ Support both SAN and NAS functionality without limitations
─ Fully Open Source (GPLv2)
─ No arbitrary functional restrictions
─ Low entrance barrier for adoption
─ Based on Linux / OSS tools
─ Multiple Linux distributions (Debian/Ubuntu/Red Hat/SUSE)
─ Well-established technology stack (e.g. drivers, hardware support)
─ Broad user base
![Page 5: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/5.jpg)
5
─Modern Web UI
─RESTful API (Software-Defined Storage)
─Unified Storage─NAS (NFS, CIFS, HTTP)─SAN (iSCSI, Fibre Channel)
─LVM, XFS, ZFS, Btrfs, ext3/4
─Volume mirroring (DRBD®)
─Multi-node support
─Monitoring (Nagios/Icinga) built-in
─Ceph management and monitoring (WIP)
─Development sponsored by it-novum
openATTIC – Open Source Storage Management
![Page 6: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/6.jpg)
6
─Backend─Python (Django)─Django REST Framework
(RESTful API)─Linux tools for storage
management, e.g. LVM, LIO, filesystem utilities, DRBD, etc.
─Nagios/Icinga & PNP4Nagios (Monitoring and Graphing)
─Web Frontend─AngularJS (JS framework)─Bootstrap (HTML, CSS, and
JS framework)─Uses REST API exclusively
─Automated Test Suites─Python Unit Tests─REST Backend Tests
(Gatling)─WebUI Tests
(Protractor/Jasmine)
openATTIC – Components
![Page 7: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/7.jpg)
7
openATTIC – High Level Architecture
![Page 8: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/8.jpg)
8
openATTIC – Installation on SUSE Linux
─OBS Project filesystems:openATTIC
─Packages available for openSUSE Leap 42.1 & SLES12
─Thanks to Eric Jackson (swiftgist) for the support!
─Feedback is welcome!
![Page 9: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/9.jpg)
9
openATTIC – Storage Development Roadmap
─ Add Disk and Storage Pool Management to the API & WebUI
─ Creating/Modifying LVM Volume Groups / MD RAID setups
─ Creating/Modifying Btrfs/ZFS Pools (incl. RAID setups)
─ Automatic discovery of disks/pools (via udev)
─ Monitoring Disk health (SMART)
─ Manage HW RAID controllers
─ Add volume mirroring support to the WebUI
─ Extend SAN functionality (more iSCSI/FC features)
─ Public Roadmap on the openATTIC Jira/Wiki to solicit community feedback
![Page 10: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/10.jpg)
10
openATTIC – Ceph Management Challenges
─Managing and monitoring Ceph is complex
─Many tools exist (e.g. Calamari, Intel VSM, ceph-dash)
─Limited functionality, unclear roadmaps
─Finding the best approach for managing Ceph
![Page 11: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/11.jpg)
11
openATTIC – Ceph Management Goals
─Create a management & monitoring GUI tool
─A tool that administrators actually want to use
─That scales without becoming overwhelming
─Still should allow changes to be made elsewhere, without
becoming inconsistent
![Page 12: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/12.jpg)
12
openATTIC – Ceph Management Implementation
─Which Ceph Management API?
─How to manage a distributed system?
─How to monitor the cluster‘s health/performance?
─How to perform remote management tasks?
─How to monitor cluster nodes in a scalable way?
![Page 13: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/13.jpg)
13
Django REST Framework
Django Models
Client (GUI)
REST API
DB
(PostgreSQL)
nodb
Python librados / librbddjango.db.models
openATTIC – “NoDB” Django models
![Page 14: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/14.jpg)
14
openATTIC – Current Ceph Development Status
─ “NoDB” backend architecture / framework in place
─ Create and map RBDs as block devices (volumes)
─ Pool Management Web UI (table view)
─ OSD Management Web UI (table view)
─ RBD Management Web UI (table view)
─ Monitor a cluster health and performance
─ CRUSH Map Editor
─ Support for managing multiple Ceph clusters
![Page 15: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/15.jpg)
15
openATTIC – Attending SUSE Hackweek
─ June 24th – July 1st
─ https://hackweek.suse.com/
─ openATTIC Team visited SUSE HQ in Nuremberg
─ Implementation design decisions
─ Salt integration
─ New features implemented
─ Ceph Monitoring Dashboard
─ Ceph RBD Management
![Page 16: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/16.jpg)
16
openATTIC – Ceph Management REST API
https://wiki.openattic.org/display/OP/openATTIC+Ceph+REST+API+overview
![Page 17: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/17.jpg)
17
openATTIC – Ceph Development Roadmap
─ Ceph Cluster Status Dashboard incl. Performance Graphs
─ Extend Pool Management
─ OSD Monitoring/Management
─ RBD Management/Monitoring
─ CephFS Management
─ RGW Management (users, buckets keys)
─ Deployment, remote configuration of Ceph nodes (via Salt)
─ Public Roadmap on the openATTIC Wiki to solicit community
feedback: http://bit.ly/28PCTWf
![Page 18: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/18.jpg)
18
openATTIC – Storage Management Dashboard
![Page 19: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/19.jpg)
19
openATTIC – Volume Management
![Page 20: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/20.jpg)
20
openATTIC – API Recorder
![Page 21: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/21.jpg)
21
openATTIC – Ceph Pool List
![Page 22: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/22.jpg)
22
openATTIC – Ceph OSD List
![Page 23: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/23.jpg)
23
openATTIC – Ceph RBD list
![Page 24: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/24.jpg)
24
openATTIC – Create Ceph RBD
![Page 25: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/25.jpg)
25
openATTIC – Ceph CRUSH map editing
![Page 26: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/26.jpg)
26
─ www.openattic.org
─ demo.openattic.org
─ blog.openattic.org
─ docs.openattic.org
─bitbucket.org/openattic
─tracker.openattic.org
─@openATTIC
─openATTIC
openATTIC – Resources
![Page 27: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/27.jpg)
SUSE CERTIFIED LINUX PROFESSIONAL ACADEMYTechnical Training for SUSE Linux Enterprise Server 12
No Cost Flexible 12-Week Online Training This popular training model is for technical sales/engineering employees of
SUSE partners interested in learning to install and manage SUSE Linux
Enterprise Server 12 (SLES 12). Participation in our SUSE Academy also
offers no-cost exam vouchers for participants seeking SUSE certification.
Learn through self-study of the SLES 12 curriculum and weekly webinar
reviews with our field-experienced instructor.
Each Academy participant will need 5-7 hours per week to self-study the
SLES 12 course assignments, plus 1 hour each week to attend a webinar
review of the key concepts studied. Certification is not required to participate.
Contact your company’s Partner Executive to ask to be sponsored in our
next Academy.
![Page 28: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/28.jpg)
28
Questions / Discussion
![Page 29: Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07](https://reader034.vdocuments.site/reader034/viewer/2022042604/58a930691a28ab3f778b523f/html5/thumbnails/29.jpg)
29
Thank you!