InfiniBand Performance Measurement

1
InfiniBand Performance Measurement

• Objectives
• Testing Environment
• What to test
• How to test

2
Objectives

• Get some hands-on experience on an InfiniBand
  (IB) real system
• Write codes to access IB directly
• Collect the performance data and compare the
  performance of IB with PCI
• Collect the performance data of different
  application to see what is the improvement on the
  IB system

3
Testing Environment
4
What to test?

• Criteria
• Latency the time for sending a packet
• Throughput Max. bytes can be send per sencond
• Utilization the link utilization
• Reliability packet order, Lost packet, errors

5
How to test? (1)

• Factors (parameters)
• Internal factors
• Message size 0231B
• Packet size 04096B
• Port buffer size
• Memory pool size
• Service type Reliable, Unreliable
• External factors
• Work load of customers -- threads

6
How to test? (2)

• Focus on
• Transport layer
• Data-link layer
• Tools
• Common Services API provides libraries for IB
  and generic operating systems Send, RDMA
• Channel Adapter layer API provides a
  chipset-neutral interface for management
• Performance Management

7
How to test? (3)

• Procedure
• Write a program to access IB directly using API
• Collect all the performance data by varying all
  kinds of parameters
• Find the relationship between the parameters and
  performance
• Interpret the results