MB-NG Meeting Dec 2001

1
MB NG SuperJANET4 Development Network
2
Some Edge (Bbone) Router requirements

• Connect to the test systems in the IP domain.
• Accept marked packets and be able to re-mark them
• Mark the packets on input according to at least
• Source dest IP address IP port
• Layer3 and Layer4 headers TCP/UDP
• Support Diffserve code points
• Perform policing and admission control
• Provide a range of Queue type options
• Several queues with different priorities
• Real-time queue
• Provide flexible Queue Scheduling
• Weighted round robin
• Weighted fair queuing
• Provide Congestion control such as
• RED
• ECN
• Be able to assign MPLS labels to the packets in a
  flexible manner.

3
Equipment for the External / Edge
DomainsFunctionality
4
Equipment for the External / Edge
DomainsConnectivity
Gigabit Ethernet 2.5 Gbit POS 2.5 GbitPOS core
Spy
Load PC
Test PC
Test PC
4 1 Gigabit Ethernet blade MPLS
4 1 Gigabit Ethernet blade QoS Marking
Test PC
Test PC
Load PC
MPLS to core
2.5 Gbit POS MPLS
Load PC
Supervisor
Supervisor
Load PC
Difserve router OR MPLS Edge Router
MPLS Backbone Router OSR
5
IP Access to MB-NG SystemsA suggestion only we
all must decide !

• End/Test systems routing
• The default route from the PC is set to the
  Gigabit link i.e. into the development network.
• Static routes for researchers only are set for
  the 100 Mbit interface, e.g. to Manchester HEP,
  MCC, RAL, UCL, ULCC, UKERNA.
• The link between the Cisco 3512 and the Campus is
  set to 10 Mbit this would minimise any
  unintentional traffic.
• IP access to core routers for researchers only
• Similar approach? via the test PCs at the CPoP

6
Some Questions ???

• Can one Gigabit Ethernet blade perform the IP and
  MPLS functions we need or do we require two cards
  one for IP input functions, the other for MPLS
  output?
•  What is the performance of the 4-port Gigabit
  Ethernet interfaces?
• Confirm that an interface can support both IP and
  MPLS frames at same time.
• Can the GSRs use MPLS to loop the frames round n
  times?
• Can all our requirements be met?

7
Focus on the routers - Hardware

• Cisco OSR based on 6500 Are the details correct ?

More memory
8
Focus on the routers - Summary
 
 
9
Hardware Software Tools

• Optical splitter or opto-electrical tap
• opto-electrical tap constructed for logic
  analyser
• Software use of
• tcpdump tcptrace
• Web100

10
Latency Tests with 64-bit PCI

• Alteon Gigabit NIC RAW
• SuperMicro 370DLE
• ServerWorks III LE Chipset
• 64 bit PCI _at_ 33 MHz
• Request Response
• Transfer rates
• observe expect us/B
• 3232 bit 0.0265 0.0232
• -gt 108Mbyte/s
• 3264 bit 0.0209 0.0211
• 6464 bit 0.0149 0.0156

64 byte Request
1400 byte Response
11
Throughput Tests with 64-bit PCI

• RAW Stream
• Not using IP stack
• Vary time between packets
• 1.6 factor improvement over 32-32 bit transfers

12
Throughput Tests UDP SysKonnect

• UDP Stream
• Vary time between packets
• 660-690 Mbit/s _at_ 17us
• No interrupt coalescing
• 15 µs between packets

1400 byte sent
1400 byte received
Pci-pci latency 28.3 µs
13
Latency Tests UDP SysKonnect

• UDP request - response
• Latency and transfer rates very similar to raw
  frames
• observe us/B offset us
• 6464 bit 0.0225 46.88
• 6464 bit 0.0149 54.
• (raw)

1400 byte sent 10.66 µs pci time
1400 byte received 10.96 µs pci time
Pci-pci latency 28.3 µs
14
Throughput Tests UDP Alteon

• UDP Stream
• Vary time between packets
• 880-930 Mbit/s _at_ 11us
• interrupt coalescing
• 15 µs between packets

15
Latency Tests UDP Alteon

• UDP request response
• Due to interrupt coalescing