s016579 data-optimization-spectrum-control-brazil-v2

1IBM Systems Technical Events | ibm.com/training/events

© Copyright IBM Corporation 2017. Technical University/Symposia materials may not

be reproduced in whole or in part without the prior written permission of IBM.

Data optimization: How to verify your storage is being used efficiently

• Tony Pearson• Master Inventor and Senior IT Architect• IBM Corporation

• Bryan Odom

• Technical Pre Sales

• IBM Corporation




� This session explores three scenarios for optimizing storage and using the thousands of performance data records that you have collected but have no time to examine in detail. Based on real-world customer experiences with the analytics functions in Spectrum Control Advanced Edition, we share key scenarios that show how you can leverage the Advanced Edition to help you in each of these cases:

1. When you need more storage what type and tier does you workload actually need?

2. After new storage added, what's the best way to evenly redistribute the workload?

3. When it's time to retire an aging storage device, where should you move the volume to?

Abstract




This week with Tony Pearson

Day Time Topic

Tuesday 13:45Introduction to IBM Cloud Object Storage System and

its Applications (powered by Cleversafe)

Wednesday

9:00 IBM Hybrid Cloud Storage Solutions

10:15Data optimization: How to verify your storage is being

used efficiently

15:00 Managing Risks with Data Footprint Reduction




Device Perspective:Looking at storage

environment from the

device level, for

performance and

replication functions

Data Perspective:Looking at storage

environment from the

host level, for data

stored in file systems

and databases

Fabric Perspective:Looking at storage environment from the

fabric level, how it all gets connected together

IBM Spectrum Control – Different Perspectives




IBM Spectrum Control and Virtual Storage Center

IBM Virtual Storage Center

• Storage Analytics• Policy-based

Automation• Service level

provisioning

IBM Spectrum Control Advanced Edition

IBM Spectrum Control Base Edition• VMware

IBM Spectrum Virtualize

IBM Spectrum Control Standard Edition• Capacity Planning

and Provisioning• Performance

Monitoring and Alerts

IBM Copy Services Manager

Base Edition

IBM Spectrum Snapshot

StandardEdition

IBM Spectrum Snapshot

StandardEdition

IBM Spectrum Control Storage Insights

• Reclaim space• Optimize data

placement• Monitor capacity

and performance

On-premises

Off-premises




Spectrum Control Advanced Analytics

� Cloud Configuration

– Assigning Tiers to storage

– Creating service classes

� Provisioning

– Leveraging service classes to provision storage

– Prevents create a hot spot for new volumes

� Optimization

– Volume migration based on work load at the volume or pool level

� Data Transformation

– Migrating volumes based on workload

– Migrating volumes to newer hardware

� Reclamation * New in Spectrum Control since Version 5.29

– Identifying orphaned LUNs that can be reclaimed




Is your data on the ‘right’ storage tier?

� Requirements change over time

� Data owners are risk averse

� Users don’t see the total cost

� Rationing resources is unpopular

… but the biggest challenge has been:

� No objective way to determine what the ‘right

tier’should be!

…so data stays on top tier storage (expensive)

• Resources that should be spent on innovation

are wasted on infrastructure inefficiencies

Challenges:

50-60%

Optimal Storage Tier Distribution

�Tier 0

�Tier 2

�Tier 3

�Tier 1

20-25%

15-20%

1-5%

�-�0 �-�1%

Typical Storage Tier Distribution

70%

�Tier 0

�Tier 2

�Tier 3

�Tier 1

Storage Optimization: Tiering Overview




Benefits of using Spectrum Control

� Reduced labor costs

– Helps to identify problems in the storage environment

– Single step execution reduces multiple manual steps needed to resolve issues

– Scheduled execution enable optimizations to be run at less disruptive times without

manual oversight

� Reduced storage costs

– Re-tiering and balancing will result in a better utilized storage environment

– Transform actions can re-characterize volumes to achieve higher storage utilization

� Proactive and reactive performance resolution

– Identifies and addresses performance problems caused by unbalanced storage pools

and improperly tiered volumes




SVC Easy Tier versus Spectrum Control Analytics

� Why should you not simply create one hybrid storage pool in SVC?

Here are some reasons that might prevent you from using the most easiest

setup of a tiering implementation with just one large hybrid storage pool:– You might have more than one location, so you will need more than one storage pool

– You might have to separate internal customers from one another (multi tenancy) so you need more than one pool

– If availability is a concern for you, than you probably don’t want to add more than one storage system into one pool

– Workload isolation

– If you have: You will likely use:

or a combination of Easy Tier and VSC Tiering because the two are complementary

Use Easy Tier

Use Spectrum Control

– A small number of pools– Only hybrid pools (with mirroring)

– Many different drive technologies:SSD/Flash, 146GB 15krpm, 600GB 10krpm, 1,2TB 10krpm,2TB NL-SAS, 4 TB NL-SASand/or multiple RAID levels




1. When you need more storage capacity, what type and tier does you workload actually need?



Use Cases




Storage Optimization: Tiering across pools

Spectrum Control will only give one recommendation per volume.

Volume movement could be up or down multiple tiers based on performance data analysis.

Spectrum Control Optimization can help determine the best place to move the volumes based on the real work

load




When will you need more storage?

� Go to:Groups � Tiers

� Look for dates in

“Zero Capacity”

Note: you can sort

on this column

– <Date> when no free

space is left

– None – no or

negative growth

– Depleted – no space

left in tier

� The “Growth”

columns provide

a trend




Tier Capacity Charts

� Tab Capacity shows how the Tiercapacity changed over time




Hot Data

� Once a hot (very active) volume is found, how is

a more appropriate location (tier) found for that

volume?

� Moving the volume to a higher tier of storage with capacity may cause other problems:

� The target pool could be pushed past acceptable response based on the added load

� Volumes that were performing well in the target may degrade due to contention

Cold Data

� The same situation occurs for cool

volumes, how is a more

appropriate location (tier) found for

that volume?

� Blindly moving a volume to another

storage pool without any metrics is

just a guess … there is a better

way

Storage Optimization: Tiering at the volume level




Volume Optimization: Analyze Tiering

� Identify the volume(s) to be analyzed

� Take note of the current Tier

� Right click the volume(s) and select Analyze Tiering




Determining Optimized Placement

� Select the storage pools from a list.

� Another option would be to select the target location based on capacity pools.





� Select the storage destination pools from a list.

� Targets can include one or more storage pools spanning multiple tiers of storage.




Here is one way to get the limits

Tier 1: 552 x 1.0 ≈ 550

Tier 2: 557 x 0.5 ≈ 280

Tier IO/GiB

Tier 1 0.5 � 1

Tier 2 0.1 - 0.5

Tier 3 0.01 - 0.1

I/O Density rules of thumb





� Define how many days worth of data to be analyzed.

� Select days to be included in the analysis

� Select times of the day to be included in the analysis

� Co-locate volumes

� Volume IO Rate / IO Density

� Maximum Pool I/O rate.

� Click “Analyze”





Green Checkmark indicates analysis

successful

RecommendationsShow results of analysis




Execute Now or Schedule for Later

Schedule or Execute the recommendations.

Schedule for a later time, perhaps weekend

Execute recommendations now




Analyze All Volumes in a Storage Pool

� Process can apply to all volumes in a storage pool

Spectrum Control can help you balance your workload

across pools.




Pool Optimization: Analyze Tiering


� Define which days to be included in the analysis

� Define which times of the day to be included in the analysis

� Co-locate volumes assigned to the same server or hypervisor.

� Volume I/O Rate or Volume I/O Density

� Maximum pool I/O rate




Pool Optimization: Analyze Tiering

Identifies only the volumes that should be moved to different tier







Use Cases




Storage Optimization: Balancing workload across the same tier

Even with one tier of storage, there can be hot

spots where the workload is not balanced

across the pools.

“I only have one tier of storage, so I cannot have

a hot spot“

Spectrum Control can help balance the work

load across pools!




Pool Optimization: Balance Pools

� Identify the pool(s) you want to balance

� Right click the pool(s) and select Balance Pools

Spectrum Control can help you balance your work load across pools within a tier.






� Define days of the week to be included in the analysis

� Define times of the day to be included in the analysis

� Co-locate volumes assigned to the same server or hypervisor





The analysis shows a number of volumes that can be migrated across different pools of the same tier to balance the workload.







Use Cases




Transform Storage: Host Level Migration

Spectrum Control can help transform volumes of Storage behind IBM Virtualized disks




Transform Storage: Host Level Migration

Select the target pools for migration




Transform Storage: Volumes Within A Pool

Transform storage can also be used to all volumes in a storage pool




Transform Storage: Volumes Within A Pool

Using the volumes tab under the pool select the target volume(s)

� Recommendations can be scheduled

� Can be used when migrating data to a new hardware platform




Summary

Optimization and Transformation available in Virtual Storage Center and Spectrum Control Advanced Edition

Analytics determines which volumes to be moved and where to move them

Spectrum Virtualize used to move data from one storage system, pool or tier to another

– SAN Volume Controller

– FlashSystem V9000

– Storwize V7000 and V5030




Your feedback about this session is very important to us.

Submit a survey at:

ibmtechu.com




–Spectrum Control Knowledge Center

• https://www.ibm.com/support/knowledgecenter/SS5R93

–Spectrum Control Support Matrix

• http://www-01.ibm.com/support/docview.wss?uid=swg21386446

–Latest downloads for Spectrum Control

• http://www-01.ibm.com/support/docview.wss?uid=swg21320822

Spectrum Control support links




� http://www.ibm.com/training/events

� shape the future of storage management– Learn what’s on the horizon and provide feedback that reflects your needs

– Watch designs progress from wireframes to implementation

– Sign up here:https://www-304.ibm.com/software/support/trial/cst/forms/nomination.wss?id=5306

� refining functions and provide more diverse test situations– Get access to beta code and provide feedback on new functionality

– Lab advocates will help you understand and work with new functions

– Collaborate with experts and other customers

– Sign up here: https://www-304.ibm.com/software/support/trial/cst/forms/nomination.wss?id=5336

� check your enhancement ideas with other users– Use Request for Enhancements (RFE) on DeveloperWorks

– No enrolment required: https://www.ibm.com/developerworks/rfe/

Session reference links




SVC Easy Tier versus VSC Tiering Analysis

SVC Easy Tier VSC Tiering Analysis

Purpose Find and optimize hottest extents Move workloads between pools

Optimization strategy

Avoids creation of hot spots on mdisks, based on “knowledge” of micro tiersDoes only act if there is a large variation of the response times (skew)

Multiple Strategies:• Standard: move volumes out of tier/pool if

activity limit is exceeded. • Advanced: depending on policy settings

(IO rate or IO density and/or age)

Analysis • Monitors cumulative response time per MDisk (in the same pool).

• Runs continiously

• Monitors activity score per pool (in the same tier) over multiple days

• On-demand or scheduled

Granularity Extent Volume, but analysis can be initiated for storage system, pools, volumes, servers or hypervisors

Boundary/type of pool

Hybrid pools (tiering within pools also called micro tiering) � can potentially reduceavailability

One or more Tiers (each tier can be multiple pools)

Analysis timeframe Cannot be adjusted Can be adjusted

Automation/Control

• Completely automatic • semi-automated tool for lifecyclemanagement

• Range of tiers determined by service class

Initial tier placement

Depends on available capacity and cannot be controlled� Tiering?

Tier determined by service class settings and current workload

Move/swap One tier at a time Volume can “jump” across multiple tiers

Life Cycle Mgmt No yes

Also included Balancing of mdisks within pool Balancing workload across multiple pools of the same tier level




IBM Tucson Executive Briefing Center

� Tucson, Arizona is home for

storage hardware and software

design and development

� IBM Tucson Executive

Briefing Center offers:

–Technology briefings

–Product demonstrations

–Solution workshops

� Take a video tour!

– http://youtu.be/CXrpoCZAazg




About the Speaker

Tony Pearson is a Master Inventor and Senior IT Architect for the IBM Storage product line. Tony joined IBM Corporation in

1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on storage topics

covering the entire IBM Storage product line, IBM Spectrum Storage software products, and topics related to Cloud Computing,

Analytics and Cognitive Solutions. He interacts with clients, speaks at conferences and events, and leads client workshops to

help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and virtualization

solutions.

Tony writes the “Inside System Storage” blog, which is read by thousands of clients, IBM sales reps and IBM Business Partners

every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1

most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume

I through V.

Over the past years, Tony has worked in development, marketing and consulting for various storage hardware and software

products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in Electrical

Engineering, both from the University of Arizona. . Tony is an inventor or co-inventor of 19 patents in the field of electronic data

storage.

9000 S. Rita Road

Bldg 9032 Floor 1

Tucson, AZ 85744

+1 520-799-4309 (Office)

[email protected]

Tony Pearson

Master Inventor

Senior IT Architect

IBM Storage




Email:[email protected]

Twitter:twitter.com/az990tony

Blog: ibm.co/Pearson

Books:www.lulu.com/spotlight/990_tony

IBM Expert Network on Slideshare:www.slideshare.net/az990tony

Facebook:www.facebook.com/tony.pearson.16121

Linkedin:https://www.linkedin.com/in/az990tony

Additional Resources from Tony Pearson




Continue the conversation

view eventhighlights

talk to techexperts

connect with attendees

read trainingarticles

IBM SystemsTechnical EventsLinkedIncommunity

Join todaybit.ly/IBMTechUconnect




Continue growing your IBM skills

ibm.com/trainingprovides a comprehensive portfolio of skills and careeraccelerators that are designed to meet all your training needs.

If you can’t find the training that is right for you with our Global Training Providers, we can help.

Contact IBM Training at [email protected]




Trademarks and Disclaimers

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.

Other product and service names might be trademarks of IBM or other companies. Information is provided "AS IS" without warranty of any kind.

The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.

All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.

Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM representative or Business Partner for the most current pricing in your geography.

Photographs shown may be engineering prototypes. Changes may be incorporated in production models.

© IBM Corporation 2017. All rights reserved.References in this document to IBM products or services do not imply that IBM intends to make them available in every country.

Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml.

ZSP03490-USEN-00