Myrinet logotype
Product Announcement
2 December 2008

New Myri-10G High Speed Expansion Cards (HSECs)
for the IBM BladeCenter H

Highest performance, lowest cost, lowest power, 10-Gigabit Ethernet expansion cards
available for the IBM BladeCenter H

Two ports for failover Four ports, two for performance,
two additional ports for failover
Single PCI Express x8 Device
10Gb/s throughput
3 Watts typical
Product code 10G-PCIE-8B-2I
List price $595
Two PCI Express x8 Devices
20Gb/s throughput
6 Watts typical
Product code 10G-PCIE-8B2-4I
List price $895

Myricom is pleased to introduce two new Myri-10G High Speed Expansion Cards (HSECs) for the IBM BladeCenter H. These HSECs are based on the Myricom Lanai-Z8ES chip, a low-power, programmable, dual-port, 10Gb / PCI Express x8 controller. These HSECs, which are in the versatile CFFh form factor, have been tested in operation in HS21, HS21 XM, LS21, LS42, and QS22 blades, and in other IBM blades that are not yet announced.

All of the same software support is available for these HSECs as for other Myri-10G interface products, and the network ports support either 10-Gigabit Ethernet or 10-Gigabit Myrinet depending on the software distribution used. With the Myri10GE software distribution for conventional Ethernet operation, firmware executing in the Lanai-Z8ES chips implements all of the important stateless TCP/IP and UDP/IP offloads to allow wire-speed 10-Gigabit Ethernet throughput at low host-CPU load. With the MX-10G software distribution for low-latency, low-host-CPU-load operation over either Ethernet or Myrinet networks, the firmware implements the kernel-bypass functions of the MX message-passing system. Other optional software distributions are available for specialized demanding applications including UDP streaming of IPTV video and 10Gb Ethernet packet capture. All of these software distributions are mature, and cover the host operating systems of primary interest for BladeCenter H users: Linux, Windows, and VMware ESX.

Two-port HSEC. The two-port 10G-PCIE-8B-2I HSEC replaces the original 10G-PCIE-8A-I HSEC on the Myri-10G product list at the same $595 list price with the Ethernet (+E) software bundle, but with two ports for failover rather than one port, 21.5% higher internal clock rate, and 60% lower power. With the Myri10GE Ethernet software distribution, the netperf TCP_STREAM test shows a bandwidth of 9.91 Gb/s with a 9KB MTU, and 9.48 Gb/s with a 1500B MTU. With the MX-10G software distribution, the MX or MPI latency is ~2µs, the unidirectional data rate is ~1.2 GByte/s, and the bidirectional data rate is ~2.35 GByte/s. This two-port HSEC appears to the host operating system as a single PCI Express device with very fast (~10µs) failover between the network ports handled by the firmware.

Four-port HSEC. The four-port 10G-PCIE-8B2-4I HSEC contains two independent PCI Express x8 devices that connect to Link A and Link B of the PCI Express connector in IBM BladeCenter H blades. Each of the two interfaces (Lanai-Z8ES chips) has two ports. Either port of an interface can carry traffic at up to 10Gb/s, but not at the same time. Together, the two interfaces can carry network traffic at rates approaching 20Gb/s. This high performance HSEC is being introduced at a list price of $895.

If both interfaces are using the bundled Myri10GE Ethernet software distribution, traffic can be combined using Ethernet link aggregation (IEEE 802.3ad, also called port aggregation, trunking, teaming, NIC bonding, etc.). Between blades with sufficient memory bandwidth, the netperf TCP_STREAM test shows a bandwidth with link aggregation of 19.82 Gb/s with a 9KB MTU, and 18.95 Gb/s with a 1500B MTU. If both interfaces are using the optional MX-10G message-passing system, traffic can be combined using MX NIC bonding, resulting in a unidirectional data rate of ~2.4 GByte/s and a bidirectional data rate of ~4.7 GByte/s. It is also possible for the two interfaces to use different firmware and drivers.

Myricom banner
Updated: 2 December 2008