visualisation and forecasting on it capacity planning data
DESCRIPTION
This is a presentation recently given at UK CMG around linking visualisation and forecasting tools with capacity planning and performance data from distributed and mainframe systems.TRANSCRIPT
![Page 1: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/1.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
ADVANCED VISUALISATION ON MAINFRAME
RMF AND SMF DATA
(APPLYING BIG DATA SOLUTIONS TO IT SYSTEM UTILISATION DATA)
ANDREW GADSBY, MAINFRAME BUSINESS [email protected]
MIKE WROOT, MAINFRAME TECHNICAL [email protected]
![Page 2: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/2.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
ABSTRACT ANDREW GADSBY and MIKE WROOT
Title:
Advanced Visualisation and Analytics on Mainframe RMF and SMF Data
(Applying Big Data techniques to IT system utilisation data)
Abstract:
Much has been written about applying analytics to Big Data problems and how advanced visualisation techniques allow
businesses to create new value from Big Data. At SAS we are seeing many customer facing organisations make
extensive use of new visualisation techniques to derive significant business value from the mass of data available to
them.
IT also suffers from its own Big Data problem with the 4 V’s (volume, velocity, variety and variability) applying to IT
systems performance and capacity data. We wondered if it would be possible to apply Big Data visualisation and
analytic techniques to mainframe RMF and SMF data. In particular, we wanted to understand if analysis in this way
could deliver value back into IT.
This session will present an overview of the approach we took to analyse and visualise this data, and illustrate some of
the value that could be derived from such analysis. We will also give a live demonstration of our solution.
![Page 3: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/3.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
AGENDA ADVANCED VISUALISATION
• Introductions
• How are Your Business Users Looking at their Data?
Demonstration
• How does IT undertake capacity reporting today?
• Linking Visualisation to Capacity Reporting and Forecasting
Demonstration
• Observations and Conclusion
![Page 4: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/4.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
ACKNOWLEDGEMENT FROM THE MAGIC CIRCLE….
![Page 5: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/5.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
AGENDA ADVANCED VISUALISATION
• Introductions
• How are Your Business Users Looking at their Data?
Demonstration
• How does IT undertake capacity reporting today?
• Linking Visualisation to Capacity Reporting and Forecasting
Demonstration
• Observations and Conclusion
![Page 6: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/6.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
“The Greatest Value Of A Picture
Is When It Forces Us To Notice
What We Never Expected To See.”John W. Tukey, Exploratory Data Analysis 1977
![Page 7: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/7.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
BUSINESS USERS
VIEWVISUALISATION OF BIG DATA
• Visually Exploring Their Data Using Tablets
• User Self Service is Becoming the Norm
• Speed of Thought Investigation and Discovery
• Building Analytical Data Warehouses (ADW)
• Improved Decision Taking Across the Business
• Static Reports are No Longer Acceptable
![Page 8: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/8.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
Central Entry Point Integration Role-Based Views
DELIVERPREPARE EXPLORE DESIGN
• SAS®
Mobile BI - native tablet applications delivering interactive reports
• Web and PDF
• Manage data• Load and join data• Create calculated
columns
• Perform ad-hoc data exploration
• Insights generated through analytic visualizations
• Create dashboard style reports for web or mobile
IN-MEMORY ANALYTICS ENGINE
SAS®VISUAL
ANALYTICSA SOLUTION FOR FASTER, SMARTER DECISIONS
www.sas.com/visualanalytics
![Page 9: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/9.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
DEMONSTRATION
SAS® VISUAL ANALYTICS
MEGACORP
![Page 10: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/10.jpg)
![Page 11: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/11.jpg)
![Page 12: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/12.jpg)
![Page 13: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/13.jpg)
![Page 14: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/14.jpg)
![Page 15: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/15.jpg)
![Page 16: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/16.jpg)
![Page 17: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/17.jpg)
![Page 18: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/18.jpg)
![Page 19: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/19.jpg)
![Page 20: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/20.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
AGENDA ADVANCED VISUALISATION
• Introductions
• How are Your Business Users Looking at their Data?
Demonstration
• How does IT undertake capacity reporting today?
• Linking Visualisation to Capacity Reporting and Forecasting
Demonstration
• Observations and Conclusion
![Page 21: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/21.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
HOW I.T. LOOKS AT
PERFORMANCE
DATA
VISUALISATION OF I.T. DATA
• Mainframe e.g. MXG, MICS using SMF and RMF data
• Distributed e.g. SAR, NMON…
• Static Reports - GIFs
• Export to Excel
![Page 22: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/22.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
AGENDA ADVANCED VISUALISATION
• Introductions
• How are Your Business Users Looking at their Data?
Demonstration
• How does IT undertake capacity reporting today?
• Linking Visualisation to Capacity Reporting and Forecasting
Demonstration
• Observations and Conclusion
![Page 23: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/23.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
LINKING
VISUALISATION TO
I.T. DATA
EXAMPLE HIGH-LEVEL ARCHITECTURE
SAS® VISUAL ANALYTICS ENVIRONMENT
Desktop
Web
Mobile
SAS VA CLIENTS
SMF/RMF
SAR
OpenView
AWR
Workspace Server
Mid-Tier
VA Server
Co-Located Data Storage
Co-Located Data Storage
Co-Located Data Storage
SAS® LASR Analytic Server
LASR Cluster
![Page 24: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/24.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
DEMONSTRATION
SAS® VISUAL ANALYTICS FOR I.T.
MEGACORP I.T.
![Page 25: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/25.jpg)
![Page 26: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/26.jpg)
![Page 27: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/27.jpg)
![Page 28: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/28.jpg)
![Page 29: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/29.jpg)
![Page 30: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/30.jpg)
![Page 31: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/31.jpg)
![Page 32: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/32.jpg)
![Page 33: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/33.jpg)
![Page 34: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/34.jpg)
![Page 35: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/35.jpg)
![Page 36: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/36.jpg)
![Page 37: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/37.jpg)
![Page 38: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/38.jpg)
![Page 39: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/39.jpg)
![Page 40: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/40.jpg)
![Page 41: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/41.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
OBSERVATIONS &
CONCLUSIONSVISUALISATION OF I.T. DATA
• Loading and Visualisation of the underlying data was the easy bit
• Understanding what the data means is critical
• Just because you can view things a certain way doesn’t mean it makes sense!
• Good news here as a capacity planning expert you will still keep your job
• Correlation is hard
• Drill down from CPU utilisation at point of time to recreate workload/job step view
is difficult
• Resolving this needs effort at data preparation / load time
• Changes way that capacity planning and forecasting is approached
• Could drive significant reduction in static report production on mainframe (CPU saving ? )
• We are Continuing Development of this Technology and Use Case
![Page 42: Visualisation and forecasting on IT capacity planning data](https://reader033.vdocuments.site/reader033/viewer/2022051514/54c332664a7959e71b8b469a/html5/thumbnails/42.jpg)
Copy r ight © 2012, SAS Insti tute I nc . All r i ghts r eserved.
QUESTIONS?
THANK YOU