goldstone overview

Download Goldstone Overview

Post on 26-Jan-2015




0 download

Embed Size (px)


An introduction to Solinea's goldstone application. Goldstone is a tool that OpenStack cloud operators can use to help see the structure and health of their cloud.


  • 1. Accelerating Adoption of Open Infrastructure May 2014 Goldstone Overview

2. Copyright 2014 Solinea, Inc. Solinea at a Glance CUSTOMERSOVERVIEW Industry Focus Open Infrastructure, OpenStack Headquarters San Francisco, CA Founded January 2013 Geographies Asia, USA PAST DEPLOYMENTS TEAM Major US Telco US Infrastructure Service Provider North Asian Telco Global Electronics Manufacturer Global Gaming Company Top 5 Global Automotive Firm Tier 1 Network Provider Risk Management Analytics Easter Europe CSP OpenStack Distro Provider Security Analytics Firm Leading SDN Provider 3. Copyright 2014 Solinea, Inc. Solinea Services Conceive Architect Integrate Adopt Conceive the cloud strategy for existing and new cloud services to drive customer adoption Architect the cloud platforms based on market demand and internal capabilities Implement the cloud offerings and integrate them into the existing infrastructure & processes Operate the cloud, transfer knowledge, train the team and enable rapid adoption 4. Copyright 2014 Solinea, Inc. Complexity Reigns in Cloud (not just OpenStack) 5. Copyright 2014 Solinea, Inc. Same Problems, Different Clouds Every cloud Solinea built needed operational tools Tired of integrating series of expensive tools that didnt exactly match the need 6. Copyright 2014 Solinea, Inc. Cloud Operators Need Tools Require full FCAPS suite of functionality Fault Configuration Accounting Performance Security Need history to determine normal operations Troubleshooting is very important 7. Copyright 2014 Solinea, Inc. Existing OpenStack Tools Ceilometer Metering tool Aimed at accounting information of FCAPS model No management No troubleshooting Horizon Cloud user focused No history Security challenges No troubleshooting Synchronous only - no scheduling of tasks 8. Copyright 2014 Solinea, Inc. Common Monitoring Tools Nagios and Zabbix Monitoring tool only - no management capabilities Scalability issues for larger cloud Not OpenStack specific - requires significant customization Requires agents on each node 9. Copyright 2014 Solinea, Inc. Areas of Focus Discover Map OpenStack topology Present map view for sysadmin Report Display key metrics specific to OpenStack Alert sysadmin on abnormalities Analyze Calculate key indicators Provide guidance on troubleshooting 10. Copyright 2014 Solinea, Inc. Manage and Monitor OpenStack The Goldstone Deep Space Communications Complex (GDSCC), commonly called the Goldstone Observatory, is located in the U.S. state of California's Mojave Desert. Operated for the Jet Propulsion Laboratory, its main purpose is to track and communicate with space missions. It is named after Goldstone, California, a nearby gold-mining ghost town. (Because everyone asks) 11. Copyright 2014 Solinea, Inc. Cross-Product Resource View Service resource view of OpenStack cloud topology Self-discovered and auto-updating Discovers across availability zones Drills down into individual services 12. Copyright 2014 Solinea, Inc. Nova Discovery View 13. Copyright 2014 Solinea, Inc. Cinder Discovery View 14. Copyright 2014 Solinea, Inc. Detailed Resource Inspection Popup provides full details on the chosen resource 15. Copyright 2014 Solinea, Inc. Glance Discovery View 16. Copyright 2014 Solinea, Inc. Keystone Discovery View 17. Copyright 2014 Solinea, Inc. Log Viewing, Filtering, and Searching 18. Copyright 2014 Solinea, Inc. API Performance Database keeps long history of events Analysis to provide key performance metric - API response time 19. Copyright 2014 Solinea, Inc. Key Metric Reporting 20. DEMO 21. Copyright 2014 Solinea, Inc. Goldstone Architecture 22. Copyright 2014 Solinea, Inc. Anatomy of an OpenStack Message Most projects use a similar format Date: 2014-05-02 14:10:57.278 PID: 3609 Level: INFO Prog: oslo.messaging._drivers.impl_qpid ID: [-] Msg: Connected to AMQP 23. Copyright 2014 Solinea, Inc. Shipping via rsyslog (conf.d) rsyslog.d/10-goldstone.conf file: $WorkDirectory /var/lib/rsyslog # where to place spool files $ActionQueueFileName fwdGoldstone # unique name prefix for spool files $ActionQueueMaxDiskSpace 1g # 1gb space limit (use as much as possible) $ActionQueueSaveOnShutdown on # save messages to disk on shutdown $ActionQueueType LinkedList # run asynchronously $ActionResumeRetryCount -1 # infinite retries if host is down local0.* @@ # nova local1.* @@ # glance local2.* @@ # neutron local3.* @@ # ceilometer local4.* @@ # swift local5.* @@ # cinder local6.* @@ # keystone 24. Copyright 2014 Solinea, Inc. Logstash Input input { tcp { port => 5514 # matches port that rsyslog ships to type => syslog # insert a type field to identify this as an incoming message from syslog } } 25. Copyright 2014 Solinea, Inc. Logstash Filtering filter { magic_happens_here: { tokenizing, pattern matching, categorization, transformation, etc. } } 26. Copyright 2014 Solinea, Inc. Logstash Output output { elasticsearch { host => localhost port => 9200 protocol => http } } 27. Copyright 2014 Solinea, Inc. Result in ES: photo credit: Robbert van der Steeg via photopin cc 28. Copyright 2014 Solinea, Inc. Goldstone Availability Currently in early access program Available free of charge Sending out batches of installations in weekly waves for support reasons (installer) Next batch goes out on June 15th Tell us about your environment and register: 29. Copyright 2014 Solinea, Inc. Goldstone Requirements Goldstone server 4GB RAM x64 CPU CentOS / RHEL 6.5 Network access to OpenStack servers on management network Logs need to be forwarded to this server Requires OpenStack Icehouse 30. Copyright 2014 Solinea, Inc. Goldstone Roadmap Regular point release updates during OpenStack development periods Releasing version 1 (Asteroid) now Major release to coincide with OpenStack Juno release in October Version 2 due at OpenStack Summit Paris (Blackhole) Concentrating on reporting and analysis features 31. John Stanford, VP Development; Ken Pepple, CTO; Thank You


View more >