common practice md3000i rhel ver1.2
DESCRIPTION
dell Strorage configuration in red hat 6TRANSCRIPT
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 1 of 39
GSD MVFS
Common Practice: RHEL iSCSI Host Attach to Dell PV MD3000i
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 2 of 39
Disclaimer:
This document is the property of Dell Global Services Delivery Multi Vendor Field Services (GSD MVFS) Global Business Unit team. This document is aimed at SAN engineers, integrators and support staff who have a good understanding of SAN principles. This topic is not static. Specific items must be taken into consideration i.e. the customer’s specific environment, the design of the fiber channel solution, the applications on the SAN and the tape software. This document may be changed and/or updated without notice as technology changes and further practical experience is gained. The information in this document has been reviewed and is believed to be accurate; however, Dell makes no express or implied warranties, including but not limited to any warranty with respect to the performance of any hardware or software, or any express or implied warranties concerning the results to be obtained from the services or the results of any recommendation Dell may make, including without limitation any implied warranties concerning the performance, merchantability, suitability, non-‐infringement or fitness for a particular purpose of any of the deliverables or of any system that may result from the implementation of any recommendation Dell may provide.
Typography:
Font/ Color Usage for text Use Calibri black color for body text and subtext Use Cambria blue color for headings Select a word or entire text box, click on Format, Change Case, and then choose desired
effect
Recommended font sizes Headings points: 14 pt Body points: 11 pt
Windows snapshots
Not more than 2-‐3 pictures on 1 page
Author(s) and contributor(s): Neetin Mayekar,Gagandeep Gill, Santosh Murarka
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 3 of 39
Topic: MD3000i RHEL Host attach usinfg iscsi intitor and Modular Disk Storage Manager Software (MDSM)
Overview:
• Assign IP Addresses to Host iSCSI NICs
• Install and Configure iSCSI Initiator
• Establishing iSCSI connections
• Installing MDSM Software
• Initiate Access to the Storage
• Install Multipathig Drivers Using MDSM Software .
• Assigning Virtual disk to Host
• Un Assigning Virtual disk to Host
• Verifying Virtual disk connectivity
• Installing MDSM host agent .
Requirements and Assumptions: • Basic knowledge on SAN, iSCSI Technologies. • Ability to Setup and Configure Dell PV storage. • Ability to understand IP network and Configure Etherenet Switches. • Host NICs are connected to SAN iSCSI ports either directly or via Ethernet switches. • Ethernet switch and iSCSI ports are configured as per Vendor specifi Common Practise( for
parmaters linke Spanning tree , Jumbo Frames , Flow Control ,Storm Control ) • Recommended Two iSCSI Nic connected to MD3000i Array . • Disk groups and Virtual disk are created as required on MD3000i Array for host Mapping. • Recommended to have a Dedicated iSCSI network , with separate Vlan , if Common Public
network is used recommended to enable chap . • Recomemded Using of sperate network for iSCSI and Management interface. • RHEL Linux Host is up to date with recent patch level. • RHEL Linux is updated/installed with kernel-‐source , kernel-‐devel and gcc . (Multpathing drivers
are dependent on this packages ). • This document does not include instructions to configure Hardware based iSCSI initiator. • If configuring Host Via X Windows , Either use Host Console , or Xwindows client like vnc etc is
configured . • Backup any configuration file Before editing with ( cp –p sourcefilename backupfilename)
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 4 of 39
Table of Contents
Disclaimer: ................................................................................................................................................... 2 Typography: ................................................................................................................................................. 2 Author(s) and contributor(s): ........................................................................................................................ 2 Topic: MD3000i RHEL Host attach usinfg iscsi intitor and Modular Disk Storage Manager Software (MDSM) ........................................................................................................................................................ 3 Overview: ..................................................................................................................................................... 3 Requirements and Assumptions: ................................................................................................................. 3 Table of Contents ........................................................................................................................................ 4 Revision History ........................................................................................................................................... 4 Assign IP Addresses to Host iSCSI NICs .................................................................................................... 5 Method 1 : Assign IP Addresses to Host iSCSI NICs Via X Windows. ........................................................ 5 Method 2 : Assign IP Addresses to Host iSCSI NICs Via CLI interface ...................................................... 8 Install and Configure iSCSI Initiator ............................................................................................................. 9 Installing MDSM Software ......................................................................................................................... 13 Discovering the Array and Managing using MDSM client. ......................................................................... 20 Configuring Host Access ........................................................................................................................... 23 CHAP and Mutual CHAP Authentication ................................................................................................... 24
Configuring CHAP ................................................................................................................................... 24
Part 1 : Configuring MD3000i array for CHAP authentication .......................................................... 25
Part 2 : Configuring Host for CHAP Authentication ........................................................................... 27
Configuring Mutual CHAP ...................................................................................................................... 28
Part 1 : Configuring MD3000i array for Mutual CHAP authentication ............................................... 29
Part 2 -‐ Configuring Host for Mutual CHAP ........................................................................................ 31
Mapping a Virtual Disk to Host .................................................................................................................. 33 Unassigning Virtual Disk Access ............................................................................................................... 35 Verifying Device Connectivity .................................................................................................................... 38 Installing Host agent only using MDSM software. ..................................................................................... 39
Revision History
Date Author Items Revised Pg # Rev # Initial Release All 1
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 5 of 39
Assign IP Addresses to Host iSCSI NICs
Assign IP addresses on each iSCSI I/O Network Cards.Follow DWB guidelines. May require to configure iSCSI NICs in two different subnets
The following section provides a framework for preparing your network for iSCSI.
To set up a host network, you must configure the IP address and netmask of each iSCSI NIC port connected to the storage array. Configuring TCP/IP using a Static IP address (root or root equivalent users only) There are two methods to achieve this:
Method 1 : Assign IP Addresses to Host iSCSI NICs Via X Windows. If you are using Host console or any Xwindows client , at the command prompt or Terminal type command
1. #System-‐config-‐network-‐gui
2. Next Screen in the Popup windows select the iSCSI Network adapter and click edit .
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 6 of 39
3. Next Screen , check Activate device .. , to make sure NIC is enabled when computer start’s up . 4. Select Static IP Address and Insert the IP address and Subnetmass as defined in DWB. 5. Default Gateway is not required for Dedicated iSCSI network . 6. Select MTU check Box and Input size as 9000 . (Note:-‐ MTU size needs to be set universal across
the entire environment , not following across all equipment may result in degraded performfance ).
7. Click ok
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 7 of 39
8. Select Activate . ( Maksure the Right NIC is selected )
9. Repeat Steps 1 to 3 for 2nd NIC ( example eth2 ) 10. Select file Save (To save existing changes)
11. Select ok , to restart the network services . and then select file Quit (to exit)
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 8 of 39
Method 2 : Assign IP Addresses to Host iSCSI NICs Via CLI interface 1. Change directory to “cd /etc/sysconfig/network-‐scripts/” 2. Edit the iscsi nic adapter to be configured ( example using vi editor )
3. Edit the following entries as Higlighted with red arrow . • Device name ( sets interface name) • ONBOOT yes ( brings up interface at boot ) • BOOTPRO static ( set static ip address) • MTU 9000 ( this value should be universal across the environment )
4. Save the file 5. Follow steps 1 -‐4 for 2nd iSCSI nic 6. Restart the network “service service network restart”
Make sure all the nic come up .
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 9 of 39
7. Verify the NIC interfaces “ifconfig –a “
Install and Configure iSCSI Initiator
Install iscsi rpm package from the Redhat installation Media or the package can be downloaded from opensource http://www.rpmfind.net/linux/rpm2html/search.php?query=iscsi-‐initiator-‐utils
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 10 of 39
1. To verify iscsi initiator service is installed run the following command rpm –qa iscsi*
2. If there is no output , install the iscsi initiator . rpm –ivh iscsi-‐initiator-‐utils-‐XXXXXXXX.rpm
3. Mount the MD3000i MDSM software CD mount /dev/cdrom /mnt
4. Backup the existing iscsi configuration files ; cp -‐p /etc/iscsi/iscsid.conf /etc/iscsi/iscsid.conf.org
5. Browse to the MDSM software dir to path linux/etc/ and copy the iscsi.conf_RHELversion file to /etc/iscsi/ directory . (Note for RHEL4 use iscsi.XXX.RHEL4u4 file and for RHEL5 use iscsi.XX.RHEL5
6. Say yes to overwrite the existing iscsi config file
7. Edit the /etc/iscsi/iscsid.conf file Change node.startup = manual to automatic.
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 11 of 39
8. Start the iscsi damemon /etc/init.d/iscsid start
9. Enable the iscsi service at boot of run level 3 ; “chkconfig –level 3 iscsid on “
10. Establishing connection to MD3000i Target port , run the following command . iscsiadm –m discovery –t st –p <MD3000i Traget ip> repeat above command for each MD3000i Storage target IP address .
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 12 of 39
11. Login into the Targets
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 13 of 39
Installing MDSM Software MDSM Manager is used to Manager the MD3000i Array , and needs to be installed on only one Host. MDSM host agent Should be installed on all host requiring access to MD3000i Virtual disk.
Installing MDSM Software requires xwindows configured and running .
1. Browse to MDSM sotware media
“Cd /mnt/cdrom/linux “
2. Run command ; “sh install.sh “
3. Select Option 2 to install MD3000i Storage manger ( use option this option to manage array )
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 14 of 39
4. Enter to continue
5. Select the Language and Click ok
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 15 of 39
6. Click next to proceed
7. Select to accept the License agreement and click next .
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 16 of 39
8. Select the default path to install the software , ( if required this path can be changed )
9. Select Typical and click next .
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 17 of 39
10. Select ok
11. Click Install .
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 18 of 39
12. Click done to complete the software installation
13. To install the Mutipathig drivers , select yes on next screen
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 19 of 39
14. In mutipathing drivers are dpendent on kernel-‐source , kernel-‐devel and gcc package . make sure this is installed on the host .
15. Select n for Oracle RAC node and Hit enter at next step to return to main menu ( this CP assumes this is not a Oracle RAC node )
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 20 of 39
16. Press q to exit the software menu
17. Type reboot , to restart the System after software installation has completed.
Discovering the Array and Managing using MDSM client.
18. cd /opt/dell/mdstoragemanger (change directory to MDSM install path ) 19. Run the “SMclient” command to open the MDSM interface .
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 21 of 39
20. Select Manual and click ok .
21. Enter Raid Controller IP address of MD3000i Array
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 22 of 39
22. Once The array is Discovered , Click iSCSI TAB , drop down each iSCSI Host ports and verify its network IP address , Click Advance Host ports Setting’s on each nic , and verify MTU size set to 9000.
(MTU size should be universall across the environment , default setting is 1500)
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 23 of 39
Configuring Host Access • Click Configure Host Access (Automatically ) select the Host to be granted access to
Stoarge Select Add ( Host should move to right side windows in selected host
• Select ok
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 24 of 39
• Verify the Host was added successfully, Click ok to Acknowledge the message .
CHAP and Mutual CHAP Authentication
NOTE: CHAP is an optional security feature that is not required for iSCSI communications.
Only follow this section if using CHAP or Mutual CHAP authentication is required .
Skip to Section Mapping a Virtual Disk to Host if not using Chap/Mutual Chap authentication.
Configuring CHAP • Part 1 -‐ Configuring MD3000i array for CHAP authentication • Part 2 – Configuring Host
Target CHAP (Initiator Authentication) is the basic CHAP configuration. A password is created on the SAN
target. Each node logs into the target with its' own initiator iqn as the CHAP user id, and uses the
password created on the target as the CHAP secret.
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 25 of 39
Part 1 : Configuring MD3000i array for CHAP authentication
1. Click iSCSI Tab -‐ Change Target Authentication.
2. Select Chap check box and unselect none
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 26 of 39
3. Click CHAP Secret
4. Enter Target Password ( custom password for used for target Authentication).
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 27 of 39
5. Click ok and then Click ok 2nd time in next screen
Part 2 : Configuring Host for CHAP Authentication
Edit /etc/iscsi/iscsid.conf file and set following parameters:
1. Enable CHAP for iSCSI sessions:
node.session.auth.authmethod = CHAP
2. Enable the CHAP username and password for iSCSI sessions that the initiator will use for authentication by the target .Initiator iqn can be found by running command
#more /etc/iscsi/initiatorname.iscsi
node.session.auth.username = iqn.2010-‐06.lab.efrc:01:47ffa662af1{iqn of initiator}
node.session.auth.password = targetpassword{target Password for initiator authentication}
3. Enable CHAP for iSCSI discovery:
discovery.sendtargets.auth.authmethod = CHAP
4. Enable the CHAP username and password for iSCSI discovery that the initiator will use for authentiation by the target:
discovery.sendtargets.auth.username = iqn.2010-‐06.lab.efrc:01:47ffa662af1{iqn of initiator}
discovery.sendtargets.auth.password = targetpassword{target Password for initiator authentication
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 28 of 39
Configuring Mutual CHAP (Target Authentication) on the Nodes
• Part 1 -‐ Configuring MD3000i array for Mutual CHAP authentication • Part 2 – Configuring Host
• Mutual CHAP (Target Authentication) is an authentication method in addition to Target CHAP
(Initiator Authentication). A unique password is created for each node(each initiator) on SAN.
The target logs into each node with its' own target iqn as the CHAP user id, and uses the
password associated with each node as the CHAP secret. Target CHAP (Initiator Authentication)
must also be configured in this scenario. Remark :-‐ Before Configuring Mutual CHAP complete the Configuring CHAP steps in above section.
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 29 of 39
Part 1 : Configuring MD3000i array for Mutual CHAP authentication
1. Select iSCSI Tab Click Enter Mutaul Authentication Permission .
2. Select the host to set Mutual Host auth , and click CHAP secret Tab .
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 30 of 39
3. Type the password as required for Mutual CHAP on Host . ( example used initiator password)
4. Click ok
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 31 of 39
5. Click close
Part 2 -‐ Configuring Host for Mutual CHAP
Edit /etc/iscsi/iscsid.conf file and set following parameters:
1. Enable the CHAP username and password for iSCSI sessions that the target will use for authentication by the initiator:
node.session.auth.username_in = iqn.1984-‐05.com.dell:powervault.6001e4f000437c5d00000000481902fb {iqn of SAN target}
node.session.auth.password_in = initiatorpassword {initiator secret-‐Password for Target authentication}
2. Enable the CHAP username and password for iSCSI discovery that the target will use for authentication by the initiator:
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 32 of 39
discovery.sendtargets.auth.username_in = iqn.1984-‐05.com.dell:powervault.6001e4f000437c5d00000000481902fb{iqn of SAN target}
discovery.sendtargets.auth.password_in = initiatorpassword {initiator secret-‐Password for Target authentication}
Settings Highlighted in Red are extra settings required for Mutual CHAP
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 33 of 39
Mapping a Virtual Disk to Host 1. Click Configure Create Host-‐toVirtual Disk Mapping .
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 34 of 39
2. Select the Host to be map to Virtual LUN and click Next.
3. Select the Virtual Disk to be presented , verify the Logical Unit Number , Click Finish
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 35 of 39
4. Click No , ( If needs to assign more Virtual disk , select yes , and repeat the Virtual Disk Mapping steps).
Unassigning Virtual Disk Access 1. Click Modify Edit Host to Virtual Disk Mappings
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 36 of 39
2. Select the Virtual disk to be unmapped from Host and click remove .
3. Click yes , in the Pop-‐up Menu
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 37 of 39
4. Click Close
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 38 of 39
Verifying Device Connectivity
1. Run SMDevices
Depending on the Number of iSCSI nic’s used you should the Ouptut of LUN31 which is the defines the controller and port connectivity established.
For 1 Nic , Two LUN31 connection should be seen .
For 2 Nic , 4 LUN31 Connections should be seen .
The same follow for the number of Virtual disk assigned.
2. Run “fdisk –l “ to verify block size , device information and Partition information .
GSD MVFS – Common Practices DELL CONFIDENTIAL – Do not distribute outside Dell Services
Please send feedback to regional TL or author Page 39 of 39
Installing Host agent only using MDSM software.
1. Refer to Install and Configure iSCSI Initiator section for installting the iSCSI initiator . 2. Repeat steps 1 to 8 for Installing MDSM Software . 3. Select Host option and click Next. ( used to install only host agent )
4. Repeat steps 10 to 17 from Installing MDSM Software