OFA-IWG Interop EventMarch 2008

Rupert Dance, Arkady Kanevsky, Tuan Phamdo, Mikkel Hagen

Sonoma Workshop Presentation

2

OFA-IWG Charter and Mission

The OpenFabrics Alliance Interoperability Working Group (OFA-IWG) is responsible for defining and developing a comprehensive suite of tests for evaluating product interoperability within the OpenFabrics environment. Each year, the OFA-IWG hosts interoperability test events in conjunction with the University of New Hampshire’s InterOperability Lab (UNH IOL). At these events, Alliance members have an opportunity to validate the interoperability of their products using the OpenFabrics software stack.

The OFA-IWG is responsible for defining and maintaining the OFA Logo Program.

At the end of each event, the OFA Interoperability Logo is granted to those companies who pass all of the mandatory tests.

3

Event Overview

OFA IWG Interop Event 3/17 3/21/0810 vendors and 23 devicesThis is the 3rd official OFA-IWG Interop event

Preceded by IBTA and iWARP compliance testing events

Hosted by University of NH Interoperability Lab (UNH-IOL)

Overall results very successfulNext event scheduled for September 2008

4

Program Details

OFA Interoperability Logo ProgramEnable vendors to claim and market interoperability

by using the Logo on their products or in their product marketing collateral.

Details available at http://www.iol.unh.edu/services/testing/ofa/logo.pdf

Current List of Logo Grants available at: http://www.iol.unh.edu/services/testing/ofa/interoplist/interoplist.php

Updated List of Logo Grants will be available end of April 2008

5

Vendor Participation - IB

InfiniBand VendorsCisco, Data Direct Networks, Flextronics, LSI Logic,

Mellanox, QLogic, Voltaire InfiniBand Devices – using OFED 1.3 GA

14 HCAs5 Switches1 iSER Target3 SRP Targets5 SMs

Host Based SMs: OpenSM, CiscoSwitch Based SMs: Cisco, QLogic, Voltaire

6

Vendor Participation - iWARP

iWARP VendorsCisco, Chelsio, Fujitsu and NetEffect

iWARP Devices - using OFED 1.3 GACisco

10 GbE SwitchesChelsio

3 RNICs – 2 CX4 and one SRNetEffect

2 RNICsFujitsu

10 GbE Switches

7

Test Setup & Environment

Host Systems 17 servers provided by Intel

Cables Donations Amphenol C&M Intel Meritec Panduit W.L. Gore Zarlink

RHEL 5 OFED 1.3 GA

8

Test Category for March 2008 Interop Event

9

New Tests for March 2008

IB IPoIB Connected Mode Ethernet Link Initialize Ethernet Fabric Initialize Ethernet Fabric Reconvergence Ethernet Fabric Failover TI Reliable Datagram Sockets (RDS) TI MPI – HP TI Basic RDMA Interop TI RDMA Operations over Interconnect

Components

10

Testing Covered

InfiniBand Link Init Fabric Init IPoIB SRP SDP iSER HP MPI RDMA interop

iWARP: iWARP Interop testing uDAPL HP MPI RDMA interop Ethernet switch testing (limited participation limited execution ability)

11

IB Cluster Topology

12

Problems Noted

No issues with OFED 1.3 GA seen. Vendor specific SM stops when attempting to discover improperly

identified device in the fabric. Vendor device had duplicate GUIDs. Vendors had a link problem because physical link was not achieved

(this was remedied later). Vendors continue to have uDAPL problems (especially in iWARP). HP MPI didn't work (in iWARP) due to uDAPL problems. Insufficient time to run all of the Interop Test Suite:

This was partly because vendors were debugging Interop problems. Suggestion: The week prior to the OFA Interop event should be reserved

for debugging and resolving interop problems. OFA Interop week should be for Logo Validation only.

This would require vendors to bring some additional equipment for the IBTA and iWARP compliance Plugfest.

13

Notes & Suggestions

A new Logo Name has been adopted OFA Interoperability Logo

When a new feature is added to OFED or there is a major upgrade to a feature, a test should be created for OFA Interop Plan.

Cluster Availability VPN access is granted to all OFILG Members. Week long testing slots are available.

Next Event Dates September 22nd – 26th - IBTA Plugfest September 22nd – 26th - iWARP Test Period September 29th - October 3rd - OFA Interop Event

Consider an End User event at UNH IOL

14

Open Invitation for Interop #4

DistrosNovell and Red Hat

Ethernet Switch VendorsArastra, Force 10, Fujitsu, Fulcrum, Woven

IB VendorsHP, IBM, Obsidian, SGI, Sun, Xsigo

iWARP VendorsNetXen

System VendorsAppro, Dell, SuperMicro

15

Summary

Best OFA Interoperability Event to dateMany new tests added to the Interop PlanTest Scripts improvedTest execution went smoothlyUNH-IOL staff performed very well

Mandatory testing was very successful Beta testing

Need device participation in some categories such as FC and Ethernet Gateway devices

Need more participation from Ethernet Switch Vendors

Need more time to complete all of the testing

16

Backup

17

IBTA Event Overview

IBTA IL Compliance Testing 3/10 3/14/08 17 vendors versus 11 at the last event 18 devices versus 16 at last event 83 cables tested – versus 27 at the last event This was the 13th IBTA Plugfest

IBTA integrators List This list includes all products that have successfully completed

the rigorous testing procedures at IBTA sponsored Plugfests. Current List of devices is available at http://

www.infinibandta.org/itinfo/IL Updated List will be available end of April 2008

Hosted by Lamprey Networks and University of NH Interoperability Lab (UNH-IOL)

Next event scheduled for September 2008

18

IBTA Vendor Participation

InfiniBand DevicesCisco, Flextronics, Mellanox, QLogic, Voltaire

Cable VendorsAmphenol, C&M, Cinch, Fujikura, Intel,

Luxtera, Mellanox, Meritec, Molex, Panduit, Tyco, W.L. Gore, Zarlink