building better management storage reports for unified ... · reports. small to medium size storage...

49
BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED STORAGE SYSTEMS Moshe Karabelnik Global Storage and Backup Manager Verint Systems

Upload: others

Post on 26-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIEDSTORAGE SYSTEMS

Moshe KarabelnikGlobal Storage and Backup ManagerVerint Systems

Page 2: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 2

Table of Contents Introduction ..................................................................................................................... 5

What differentiate management storage reports from other storage reports? .................. 5

SRM vs. Report suggested in this article ......................................................................... 6

Create a management storage report .............................................................................. 7

Step 1: Decide on a report format ................................................................................ 7

Step 2: Understand who the report potential readers are ............................................. 7

Step 3: Decide what to discuss in the storage report ................................................... 8

Step 4: Determine number of disks of each type in each storage system .................. 10

Step 5: Calculate RAW capacity ................................................................................ 11

Step 6: Write the Overview of the systems section .................................................... 11

Step 7: Write the Technologies and features implemented section ............................ 12

Step 8: Decide how to represent Basic capacity utilization ......................................... 14

Capacity model ...................................................................................................... 14

Capacity in VNX and VNXe implementations ......................................................... 16

Capacity model for environments utilizing deduplication and/or compression ......... 17

Step 9: Collect capacity information from the storage systems .................................. 19

Manual collection of capacity information from the storage systems ....................... 19

Collect Pool capacity in VNX system ...................................................................... 19

Collect LUN capacity in VNX system ...................................................................... 20

Collect SAN Used capacity in VNX system ............................................................ 20

Collect Storage Pool for File capacity in VNX system ............................................. 21

Collect File System capacity and File System Used capacity in VNX system ......... 21

Collect Pool capacity in VNXe system .................................................................... 22

Collect Shared Folders capacity and used capacity ............................................... 22

Collect Generic iSCSI storage resource capacity ................................................... 23

Automatically collect storage system capacity information ..................................... 23

Page 3: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 3

VNX automatic collection ....................................................................................... 23

Collect Pool capacity in VNX system ...................................................................... 24

Collect LUN capacity in VNX system ...................................................................... 24

Collect Storage Pool for File capacity in VNX system ............................................. 24

Collect File System capacity and used capacity in VNX system ............................. 24

VNXe automatic collection ..................................................................................... 25

Collect Pool capacity in VNXe system .................................................................... 25

Collect storage resource capacity in VNXe system ................................................ 25

Shared Folders....................................................................................................... 25

iSCSI storage resource .......................................................................................... 26

VMware NFS Data Stores ...................................................................................... 26

VMware VMFS Data Stores ................................................................................... 26

Exchange 2007/2010 resource ............................................................................... 26

Hyper-V resource ................................................................................................... 26

Automating the process .......................................................................................... 26

Step 10: Collect performance utilization of the storage system .................................. 27

Collect SP utilization for VNX systems ................................................................... 27

Collecting performance for VNXe systems ............................................................. 28

Step 11: Place and arrange information collected above into a spreadsheet ............. 29

Step 12: Write the Basic capacity utilization section of the report ............................... 30

Step 13: Write the Basic performance utilization section of the report ........................ 30

Step 14: Write the Availability section of the report .................................................... 30

Step 15: Write the Backup and Replication section of the report ................................ 32

Step 16: Write the Activities related to the storage systems section of the report ....... 33

Step 17: Write the Open Issues section of the report ................................................. 33

Step 18: Add explanations where needed .................................................................. 33

Step 19: Recheck the report information before sending it ......................................... 33

Page 4: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 4

Step 20: Send the report ............................................................................................ 33

Appendix 1: References ................................................................................................ 34

Appendix 2: Example of creating a report using the suggested procedure .................... 35

Systems discussed in this example ........................................................................... 35

Step 1 ........................................................................................................................ 35

Step 2 ........................................................................................................................ 35

Step 3 ........................................................................................................................ 35

Step 4 ........................................................................................................................ 35

Step 5 ........................................................................................................................ 36

Step 6 ........................................................................................................................ 36

Step 7 ........................................................................................................................ 36

Step 8 ........................................................................................................................ 36

Step 9 ........................................................................................................................ 36

Step 10 ...................................................................................................................... 37

Step 11 ...................................................................................................................... 37

Step 12 – Step 20 ...................................................................................................... 38

Appendix 3: Example of management storage report .................................................... 39

Disclaimer: The views, processes, or methodologies published in this article are those of

the author. They do not necessarily reflect EMC Corporation’s views, processes, or

methodologies.

Page 5: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 5

Introduction Storage systems are a core component of a corporate data center, driving IT system

stability and availability. Many services rely heavily on storage functionality, including

financial and customer relationship applications, server virtualization, messaging

systems, and corporate file systems to name a few.

Due to this, it is important to keep management informed on the status of the storage

systems. One of the roles of the storage team in the IT organization is to create and

publish periodical storage reports for management.

There are tools that can create such reports automatically, for example, Storage

Resource Management (SRM) tools. However, for various reasons, not every

organization wants to adopt such tools. Additionally, there are always issues that no

automatic reporting mechanism could raise. For example, specific storage or

infrastructure requests from Line of Business (LOB) or a list of open issues regarding the

storage systems.

This Knowledge Sharing article suggests a step-by-step procedure for creating such

reports. Small to medium size storage environments can easily create reports manually

following the steps demonstrated. While this article concentrates on EMC Unified VNX®

and VNXe® platforms, experienced storage administrators can adopt the same

procedure for other storage systems as well.

What differentiate management storage reports from other storage reports? Management reports should be easy to read, informative, not too technical. Other report

types usually include mostly charts and numbers.

The report suggested in this article should balance technical details and a more general

view. It also contains specific explanations in addition to charts and numbers. The

purpose of this format is to enable the reader to quickly grasp the status of the storage

systems and also make the report interesting and appealing. This improves the chances

that readers will not quit reading the report after a page or two.

Page 6: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 6

SRM vs. Report suggested in this article The main benefit of SRM tools is the ability to create a report in a few minutes even if

you have a large storage environment. However, on the downside, such reports tend to

be too technical. Chances are, the average manager may not be interested in such a

report; it could be good for some but not for all.

SRM reports cannot be aware of a specific business environment; For example, new

requirements due to mergers and acquisitions and LOB requirements. Building the

storage report using the procedure suggested here should address such issues.

Meanwhile, there is the option to build a report using a SRM tool and then incorporate

additional business aspects to it. This is also a great option for a management report.

The following is a 20-step procedure for creating a management storage report. This

suggested procedure will take some time to follow at first but subsequent creation of

periodical reports will be shorter and faster.

Page 7: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 7

Create a management storage report Step 1: Decide on a report format There are two generic format types for a storage report:

1. Document format; such as Microsoft Word or PDF

2. Presentation format; such as Microsoft PowerPoint

Consider report format from two aspects:

1. Should this report be presented in a meeting? If so, then a presentation should

be the choice. Otherwise, any format is proper.

2. Organizational culture—what is the conventional way to send such a report in the

organization?

Step 2: Understand who the report potential readers are When deciding what to include in a storage report, first understand who will read this

report.

High level reports are good for people not interested in the technical details and who just

need to see that all is working as planned (or not). For such people, a report with too

much detail will cause them to stop reading the report after a page or two.

On the other hand, technical staff needs much more detail. They might feel that the

report does not give real data if details are not included.

Here is a suggestion to categorize three types of readers:

Top management: People interested only in high level reports. It may be that they are

not technical at all but need to know that everything works as expected and that return

on investment is being realized.

Mid-tier management: People interested in high level reports and some technical

details but not a deep-dive into all the technical details. Usually IT managers who have

some technical knowledge.

Technical staff: Usually IT infrastructure team members as well as other technically

oriented people.

Page 8: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 8

Step 3: Decide what to discuss in the storage report The sections to show in a storage report may differ from organization to organization but

here is a basic list of report sections that might be suitable in many cases:

Overview of the systems: Basic facts regarding the systems discussed in this report,

what is the inventory of those systems.

Technologies and features implemented: This is a list of storage system features and

if they were implemented in the specific system.

Basic capacity utilization: This section discusses utilization of storage capacity.

Detailed capacity utilization: This section discusses current utilization of storage and

detailed trend of capacity utilization. This is out of scope of this article since it would be

of interest only to technical staff, not management.

Basic performance utilization: This section shows performance utilization of the

storage system.

Detailed performance utilization: This section shows utilization parameters such as

network card utilization, HBA (Host Bus Adapters) utilization, NAS (Network Attached

Storage) device utilization, and more. This is out of scope of this article since it would be

of interest only to technical staff, not management.

Availability: This section discusses protection available on the storage system, such as

RAID (Redundant Array of Independent Disks), no Single Point of Failure (SPOF) in the

system, and other mechanisms that help to achieve availability to the systems. This

section also discusses the availability per storage system during the period since last

report.

Backup and replication: This section addresses backup, replication, and restore

mechanisms in the storage system.

Activities related to the storage systems: This section addresses what has been

done regarding the storage system since last report and what is planned.

Open issues: This section discusses open issues that need to be addressed, such as

lack of capacity.

Page 9: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 9

Following the categorization of report reader types assigned previously, let’s see what

might be relevant in the storage report for each category.

Top

man

agem

ent

Mid

-Tie

r

man

agem

ent

Tec

hnic

al st

aff

Overview of systems Technology and features implementation Basic capacity utilization

Detailed capacity utilization

(Not in scope of this article)

Basic performance utilization Detailed performance utilization

(Not in scope of this article)

Availability Backup and replication Activities related to the storage system Open issues

For example: Detailed performance utilization would be of interest to technical staff but

not to top and mid-tier management.

Another example: Technologies and features implemented should be interesting for any

reader.

It’s hard to generalize this and it might be a bit different for specific organizations and

organizational cultures.

Page 10: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 10

Step 4: Determine number of disks of each type in each storage system This activity is useful for calculating RAW capacity that is needed in the Overview of the

systems section.

For periodical reports this has to be done only once. This information needs to be

updated when disks are added into the system.

Getting this information is easy from the Unisphere® GUI of each storage system.

In the VNX system, navigate to System > Hardware > Disks:

Page 11: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 11

In the VNXe system, navigate to System > Storage Pools > Storage Pool Details >Disks

tab:

Step 5: Calculate RAW capacity Multiply the number of disks by their capacity.

Here is an example of four storage systems and their RAW capacity:

Type of disk New York Miami Berlin UK

EFD 100GB 50 20 0 0

SAS 600GB 50 10 30 20

NL-SAS 1TB 30 10 10 10

NL-SAS 2TB 20 10 10 5

RAW capacity 105TB 38TB 48TB 32TB

In this example, the capacity in New York is calculated as:

(50 * 100GB) + (50 * 600GB) + (30 * 1TB) + (20 * 2TB) = 105TB

Step 6: Write the Overview of the systems section This section will discuss the some or all of the following issues:

• Storage environment of the organization

• What systems are reviewed in this report (vendors and models)

• Where those storage systems are located

• What systems and applications those storage systems serve

Page 12: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 12

• Staff handling the storage systems

• Inventory of those systems; number of disks and/or RAW capacity.

• Topology of the storage systems

• Overall status of the storage systems

Keep in mind that the purpose of this overview is to acquaint the report readers with the

systems discussed; not overload them with lots of information.

Usually, if there are no major changes to the environment, this section should be the

same for subsequent periodical reports so it needs to be written only once.

Step 7: Write the Technologies and features implemented section This section will simply show a list of technologies and if those were implemented in the

storage systems.

Occasionally, managers are interested in knowing if a specific technology was

implemented. For example, it could be interesting to know that deduplication technology

is implemented in a specific storage system in order to optimize disk space usage.

Page 13: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 13

This list of technologies and their implementation could be summarized in a table such

as the following:

Technology

London

storage

system

New York

storage

system

Miami

storage

system

Hong

Kong

storage

system

Fast Cache Tiering

FAST VP

Deduplication Capacity

optimization

and ILM

(Information

Lifecycle

Management)

Archiving

Thin

provisioning

Snapshots

Protection

NDMP backups

Replication

SAN File/Block

NAS

FC

Connectivity

iSCSI

FCOE

Page 14: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 14

Step 8: Decide how to represent Basic capacity utilization Capacity model There are usually three parameters in storage systems in order to show system capacity

utilization:

Data size

Allocated capacity

Container capacity

Not allocated capacity

Allocated but not used capacity

Data

Container capacity: Total amount of storage that can be used to store data. Sometimes

called, “Pool”.

Allocated capacity: The allocated capacity is the amount of storage given to a certain

system. In a “Thin Provisioned” system, the allocated capacity is at the size of the data.

In a “Thick Provisioned” system, the allocated capacity differs from the data size.

Data size: This is the amount of actual data stored in the system.

From the three parameters above, capacity utilization is calculated in the following way:

Capacity Allocated utilization = Allocated capacityContainer capacity

Another way to consider capacity utilization is by data size and not by allocated size:

Capacity Data Size utilization = Data sizeContainer capacity

There are positives and negatives for each of those calculations:

Page 15: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 15

The Capacity Allocated utilization method is good in cases where you want to show how

much capacity you still have in the container. It’s less suitable when you need to show

how much actual data there is on the storage system.

The Capacity Data Size utilization method is good in cases where you want to show how

much actual data there is on the storage system. It’s less suitable if you need to know

how much capacity you have on the container for other systems.

Example:

You have storage pool (container) of 10TB. 8TB are allocated for Exchange system. The

actual data of the Exchange system is 1TB.

The first calculation will give:

Capacity Allocated utilization = Allocated capacityContainer capacity

= 810

= 0.8 = 80%

The second calculation will give:

Capacity Data Size utilization = Data sizeContainer capacity

= 110

= 0.1 = 10%

If you need to understand how much capacity the Exchange server takes out of the pool,

then 10% is the correct answer. If you need to understand if you have capacity in the

pool to host additional systems, then 10% utilization implies that the pool is almost

empty (which is not true); actually, it is 80% allocated so there is almost no room for

additional systems.

Page 16: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 16

Capacity in VNX and VNXe implementations

General capacity model

VNX SAN VNX NAS VNXe

Container capacity Storage Pool

capacity

Storage Pool for

File capacity

Pool capacity

Allocated capacity LUN capacity File System

capacity

Storage allocated

for specific system

like Shared Folders,

Generic iSCSI,

VMware , Hyper-V,

MS Exchange

Data size Data size in LUN File size in File

System

Data inside the

specific system

It’s important to remember that, in a “Thin Provisioned” system, it’s easy to see the data

size since it is approximately equal to the allocated capacity and can be viewed from the

storage system.

On the other hand, in a “Thick provisioned” system, the data size can be viewed only

from the host side so it might be hard to collect that information for many hosts if not

using a monitoring or reporting system.

If you have a specific system on a specific pool, it’s easy to understand what information

to collect from the storage systems in order to show capacity utilization.

For example, if you have MS Exchange residing alone on a specific pool, it’s easy to

understand what values to collect and how to show it (choosing one of the two

calculations above).

Up to now it is straightforward. Now suppose you have two different systems on the

same pool. What to do these instances?

In such cases, since the pool is shared, you won’t be able to have the granularity of

capacity utilization per system. Rather, you will have to do it on both systems together.

Page 17: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 17

Example:

You have a pool of 10TB.

There are Exchange and VMware systems residing in that pool.

Exchange has 3TB allocated and VMware has 4TB allocated.

While you cannot divide the capacity utilization of the pool into two systems, you can

have both systems match capacity utilization:

Capacity Allocated utilization = Allocated capacityContainer capacity

= 3+410

= 0.7 = 70%

The capacity utilization of both Exchange and VMware is 70%.

Usually you can calculate capacity utilization per application such as in the previous

example of MS Exchange or VMware. In organizations where Chargeback is

implemented, you might need to show capacity per LOB rather than per

application/system.

Example:

A company is implementing chargeback for its two divisions (LOB).

One LOB has 4TB allocated and the other LOB has 3TB allocated on the storage

system.

You can use those values for the chargeback process.

Capacity model for environments utilizing deduplication and/or compression In systems utilizing deduplication and/or compression technology, showing capacity

utilization should be almost similar.

Here is a drawing showing a capacity model in a deduplication (dedupe) and/or

compression environment:

Page 18: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 18

Size consumed by data

Allocated capacity

Container capacity

Not allocated capacity

Allocated but not used capacity

Data

Size consumed by data

Data size (before de-dupe)

If you decide to show Capacity Allocated utilization, all remains the same as if there is no

deduplication and/or compression.

If you decide to show Capacity Data Size utilization, you will have to use the Size

consumed by data to show utilization.

Example:

You have storage pool (container) of 10TB. 8TB are allocated for Exchange system. The

actual data of the Exchange system is 5TB.

That data consumes 3TB on the container after compression and deduplication.

The first calculation will give you:

Capacity Allocated utilization = Allocated capacityContainer capacity

= 810

= 0.8 = 80%

As mentioned above, that calculation remains exactly the same because the allocation

of storage remains allocated regardless of deduplication and/or compression.

The second calculation will give you:

Capacity utilization = Data sizeContainer capacity

= 310

= 0.3 = 30%

You should use the 3TB and not the 5TB because it shows how much space this system

consumes from the container. Using the 5TB won’t give you anything except theoretical

ratio (since the 5TB is not actually consumed from the pool – only 3TB are consumed).

Page 19: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 19

With that methodology in mind, you need to make a few decisions:

• Capacity utilization calculation per Allocated Capacity or per Data Size?

• What specific Applications and/or LOB capacity and utilization to show in report?

• Whether to demonstrate capacity trend over time (especially if those are

periodical reports and you need to show how capacity changed over time).

Step 9: Collect capacity information from the storage systems After deciding which parameters to collect from the storage systems, you need to

actually collect that information.

Manual collection of capacity information from the storage systems The management GUI is the most trivial way to collect information from a storage

system.

This is a reasonable way to collect information for a small number of storage systems.

Although Unisphere is the management GUI for VNX and VNXe systems, the specific

parameters for each of those systems are located differently in the GUI.

Collect Pool capacity in VNX system Navigate to Storage > Storage Configuration > Raid Pools

Page 20: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 20

Collect LUN capacity in VNX system Navigate to Storage > LUNs

Collect SAN Used capacity in VNX system In the case of a “Thin LUN” this information is available in the LUN properties page in

Unisphere.

In the case of a “Thick LUN” this information is available from host. The host see all the

LUN capacity and use some (or all) of it.

For example, in Microsoft Windows 2003 system Disk Management:

Page 21: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 21

Collect Storage Pool for File capacity in VNX system Storage > Storage Configurations > Storage Pools for File

Collect File System capacity and File System Used capacity in VNX system Navigate to Storage > Storage Configurations > File Systems

Page 22: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 22

Collect Pool capacity in VNXe system Navigate to System > Storage Pools > Storage Pools Details

Collect Shared Folders capacity and used capacity Navigate to Storage > Shared Folders > Share Folder Details

Page 23: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 23

Collect Generic iSCSI storage resource capacity Storage > Generic iSCSI storage > Generic storage details

Collecting Hyper-V, VMware, and Exchange storage resource capacity should be similar

to that shown above.

Automatically collect storage system capacity information Command Line Interface (CLI) tools can be used to automatically collect capacity

information.

First, I will show the specific commands and then how to automate the process.

VNX automatic collection VNX system can use SSH commands.

To run such commands as CLI you will need a utility, for example, plink which can be

downloaded from the web.

After downloading the utility, it’s easy to run commands to obtain capacity information.

While other methods are available that do the same (for example: using an EMC utility

called naviseccli), for simplicity, those methods are not shown here.

Page 24: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 24

Collect Pool capacity in VNX system plink -pw <Password> <Username>@<IP Address> "/nas/sbin/navicli -h SPA

storagepool -list -availableCap -consumedCap"

Collect LUN capacity in VNX system plink -pw <Password> <Username>@<IP Address> "/nas/sbin/navicli -h SPA getlun -

name -capacity"

Collect Storage Pool for File capacity in VNX system plink -pw <Password> <Username>@<IP Address> “export

NAS_DB=/nas";"/nas/bin/nas_pool -size -all"

Collect File System capacity and used capacity in VNX system plink -pw <Password> <Username>@<IP Address> “export

NAS_DB=/nas";"/nas/bin/server_df ALL"

Page 25: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 25

VNXe automatic collection VNXe has a proprietary command line utility called UEMCLI. Download this utility from

the EMC support site and install it on a Linux or Windows workstation. After installing the

utility, it’s easy to run commands to get information.

Collect Pool capacity in VNXe system uemcli.exe -d <IP Address> -u <Username> -p <Password> /stor/config/pool show –

output nvp

Collect storage resource capacity in VNXe system Shared Folders uemcli.exe -d <IP Address> -u <Username> -p <Password> /stor/prov/sf/res show

Page 26: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 26

iSCSI storage resource uemcli.exe -d <IP Address> -u <Username> -p <Password> /stor/prov/iscsi/res show

VMware NFS Data Stores uemcli.exe -d <IP Address> -u <Username> -p <Password> /stor/prov/vmware/nfs show

VMware VMFS Data Stores uemcli.exe -d <IP Address> -u <Username> -p <Password> /stor/prov/vmware/vmfs

show

Exchange 2007/2010 resource uemcli.exe -d <IP Address> -u <Username> -p <Password>

/stor/prov/exchange/2007/res show

Hyper-V resource uemcli.exe -d <IP Address> -u <Username> -p <Password> /stor/prov/hyperv/res show

Automating the process After understanding what command lines are needed for each data collection, a script

can be run to collect all the information into a single file (or multiple files).

For this, simply use the above commands and redirect output to a file.

An example of such a script (in this example Windows batch file) that will collect

information about pools from 3 VNXe storage systems:

uemcli.exe -d <IP Address of system1> -u <Username> -p <Password> /stor/config/pool

show –output csv >C:\Pools.csv

uemcli.exe -d <IP Address of system2> -u <Username> -p <Password> /stor/config/pool

show –output csv >>C:\Pools.csv

Page 27: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 27

uemcli.exe -d <IP Address of system3> -u <Username> -p <Password> /stor/config/pool

show –output csv >>C:\Pools.csv

The script above will create a CSV file that can be opened directly from Microsoft Excel,

for example.

Step 10: Collect performance utilization of the storage system There are many parameters that might imply performance utilization for a storage

system. For a management report, you need to collect only the most basic parameters,

i.e. Storage Processor (SP) utilization.

Collect SP utilization for VNX systems To obtain current SP utilization from VNX Unisphere:

Navigate to System > Monitoring and Alerts > Statistics for block > Performance

Summary > SP tab

Tick SP A and SP B:

Keeping this window open for a period of time will give you average performance during

that time.

Page 28: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 28

To view past performance collections you need to open an archive file (nar). See

reference at the end of this article on how to do it. It should give the following type of

chart:

Collecting performance for VNXe systems To obtain current SP utilization from VNXe Unisphere:

Navigate to System > System Performance

Page 29: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 29

Step 11: Place and arrange information collected above into a spreadsheet

You need to know if each system is implemented as SAN or NAS and the type of RAID.

This is useful for creating appropriate charts later and for the spreadsheet, which might

look like this:

Formulas view:

Values view:

Page 30: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 30

Step 12: Write the Basic capacity utilization section of the report Use the previously collected information that is stored on a spreadsheet and create

charts according to what you want to show.

Example of interesting charts:

• File system capacity per site bar chart

• File system capacity per LOB (use case: for chargeback) bar chart

• File system capacity utilization per storage system bar chart

• VMware capacity utilization per storage system bar chart

• SAN vs. NAS capacity per storage system bar chart

• SAN vs. NAS total capacity in organization pie chart

• RAID 5 vs. RAID 10 per storage system bar chart

Those are only examples. You may be surprised how many charts you can create out of

the spreadsheet you created.

See sample charts in the example report at the end of this article.

Creating the charts is a one-time process. New data added to same spreadsheet will

automatically refresh in subsequent charts.

Step 13: Write the Basic performance utilization section of the report Place a chart of performance utilization according to the data collected.

See chart in the example report at the end of this article.

Step 14: Write the Availability section of the report Availability is one of the most important aspects of storage systems that hold valuable

data.

First, it’s good to make a list of mechanisms that keeps the availability as close to 100%

as possible:

Page 31: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 31

Mechanism Explanation

Dual SP (Storage Processors) Both SPs can process same requests in

case of a problem with one of them

Hot Spare In case of a failing disk, there is automatic

mechanism that replace it with another

spare disk without any human intervention

RAID (Redundant Array of Independent Disks)

Data is protected by parity or mirroring of

disks (depends on RAID type). Up to x

disks failure won’t affect data availability

FC (Fiber Channel) connections are redundant

There are no single connections between

storage and FC switches – all connections

have redundancy

IP networking connections are redundant

There are no single connections between

storage and IP network – all connections

have redundancy

Dual power supply for SP and disk enclosures

All storage components have dual power

supply to protect from Power Supply

malfunction and from power outage

Standby Power Supply (SPS) Standby Power Supply protects against

loss of data in case of power outage

Next, show the Scheduled Availability percentage per system.

The Scheduled Availability of a system is defined as:

Scheduled Availability = Scheduled Uptime – Unscheduled DowntimeScheduled Uptime

• Scheduled Uptime - The time that the system should be up and running minus

Scheduled Downtime (time planned for maintenance or any other activity

requiring downtime)

• Unscheduled Downtime – Unplanned downtime (for example, failures)

Page 32: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 32

Example:

Storage system should work 24 X 7 (24 hours a day 7 days a week).

During the last quarter, the system was down for 10 hours due to a failure.

Scheduled Uptime for a quarter (90 days in that example) is 90 * 24 = 2160 hours

Unscheduled Downtime is 10 hours

Scheduled Availability = 2160−102160

= 0.9953 = 99.5%

In order to show that Scheduled Availability value for each storage system in the

organization, you need to know the following:

• Time that the storage system should be up (for example 24 X 7)

• Scheduled Downtime – time planned for maintenance activities

• Unscheduled Downtime – unplanned downtime due to failures

Knowing those three parameters for each storage system will enable you to easily

calculate the Scheduled Availability and present it in a bar graph, for example (the

Scheduled Availability per storage system).

Step 15: Write the Backup and Replication section of the report This section needs to describe:

• Where and when snapshots are used

• What data is being backed up in the storage system

• Backup media type (to disk or to tape, for example)

• Retention of backups

• Where backups are kept (onsite, offsite)

• Replication (if exists)

• Restore process

Page 33: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 33

Step 16: Write the Activities related to the storage systems section of the report In this section you need to describe what major activities related to the storage systems

have been done since the last report (if publishing this report periodically) or in the last

month / quarter / year.

You also need to describe the major activities planned for the near future.

Example of such activities:

• Upgrade of specific storage system components

• Update the firmware or the storage operating system

• Adding capacity

• Replacing FC switches

• Improving backup process

Step 17: Write the Open Issues section of the report This section needs to describe open issues related to the storage system.

Example of such issues:

• Need to add capacity due to a certain pool – high capacity utilization

• Need to update storage operating system due to issues with current version

• Need to address specific LOB request for storage

Step 18: Add explanations where needed Adding explanations and key points to charts rather than leaving them as-is will

contribute to the clarity of what those charts are showing.

Step 19: Recheck the report information before sending it

Step 20: Send the report

Page 34: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 34

Appendix 1: References VNXe Unisphere CLI User Guide – EMC

VNXe Service Commands Technical Notes – EMC

VNX Command Line Interface Reference for File – EMC

VNX Command Line Interface Reference for Block – EMC

EMC 161922 – How to gather the necessary information for a CLARiiON or VNX

performance analysis – EMC

Page 35: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 35

Appendix 2: Example of creating a report using the suggested procedure Systems discussed in this example There are 4 storage systems:

• VNX 5700 in New York

• VNX 5500 in Miami

• VNXe 3300 in Berlin

• VNXe 3100 in UK

Step 1 I recommend choosing Microsoft Power Point format for presenting to management.

Step 2 Top and mid-tier management will read the report. Not intended for technical staff.

Step 3 According to readers, the following sections will be included in the report:

• Overview of systems • Technology and features implementation • Basic capacity utilization • Basic performance utilization • Availability • Backup and replication • Activities related to the storage systems • Open issues

Step 4 Number of disks in each storage system and RAW capacity:

Type of disk New York Miami Berlin UK

EFD 100GB 50 20 0 0

SAS 600GB 50 10 30 20

NL-SAS 1TB 30 10 10 10

NL-SAS 2TB 20 10 10 5

RAW capacity 105TB 38TB 48TB 32TB

Page 36: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 36

Step 5 See previous table.

Step 6 See in actual report example below.

Step 7 See in actual report example below.

Step 8 Decision about parameters to show capacity utilization

For file systems, will show used capacity (capacity occupied by files and folders) and not

capacity allocated to the file systems.

For file systems, will show Storage Pool for File capacity as the maximum allocated

storage for file systems (100%).

For MS Exchange, will use LUN capacity.

For MS Exchange, will use Pool capacity as the maximum allocated space for MS

Exchange (100%).

For VMware, will use LUN capacity

For VMware, will use Pool capacity as the maximum allocated space for VMware

(100%).

Step 9 Data was collected manually since there are only 4 storage systems. Results are:

Parameter New York Miami Berlin UK

File system usage

25TB 4TB 5TB 3TB

File system pool size

35TB 5TB 6TB 6TB

MS Exchange allocated

7TB 2TB 1TB -

Page 37: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 37

MS Exchange pool size

10TB 5TB 3TB -

VMware allocated

8TB 5TB 2TB 4TB

VMware pool size

10TB 10TB 7TB 8TB

Step 10 Results from the data collected:

Parameter New York Miami Berlin UK

SPA utilization 40% 30% 20% 20%

SPB utilization 45% 30% 25% 30%

Step 11 The following Excel spreadsheet was created from the data collected above. It will help

in creating the charts for the report:

Page 38: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 38

Step 12 – Step 20 See in actual report example below.

Page 39: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 39

Appendix 3: Example of management storage report

Page 40: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 40

Page 41: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 41

Page 42: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 42

Page 43: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 43

Page 44: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 44

Page 45: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 45

Page 46: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 46

Page 47: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 47

Page 48: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 48

Page 49: BUILDING BETTER MANAGEMENT STORAGE REPORTS FOR UNIFIED ... · reports. Small to medium size storage environments easilycan creat e reports manually following the steps demonstrated

2013 EMC Proven Professional Knowledge Sharing 49

EMC believes the information in this publication is accurate as of its publication date.

The information is subject to change without notice.

THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS IS.” EMC

CORPORATION MAKES NO RESPRESENTATIONS OR WARRANTIES OF ANY KIND

WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND

SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR

FITNESS FOR A PARTICULAR PURPOSE.

Use, copying, and distribution of any EMC software described in this publication requires

an applicable software license.