Abilene and U.S. advanced regional networking update

1
Abilene and U.S. advanced regional networking
update

• Steve Corbató
• Director, Backbone Network Infrastructure
• Pacific Rim Networking
• Honolulu
• 21 February 2002

2
Abilene focus

• Goals
• Enable innovative applications and advanced
  services not possible over the commercial
  Internet through a high-performance IP common
  bearer service
• Advanced national regional infrastructure
  provides a vital substrate for the continuing
  culture of Internet advancement in the
  university/non-profit/corporate research sectors
• Advanced service efforts
• Multicast
• IPv6
• QoS
• Measurement
• Security

3
Abilene background milestones

• Abilene is a UCAID project in partnership with
• Qwest Communications (SONET soon DWDM service)
• Nortel Networks (SONET kit provider to Qwest)
• Cisco Systems (routers)
• Indiana University (network operations)
• ITECs in North Carolina and Ohio (test and
  evaluation)
• Timeline
• Apr 1998 Project announced at White House
• Jan 1999 Production status for network
• Oct 1999 IP version of HDTV (215 Mbps) over
  Abilene
• Apr 2001 First state education network added
• Jun 2001 Participation reaches all 50 states
  D.C.
• Nov 2001 Raw HDTV/IP (1.5 Gbps) over Abilene

4
Abilene February, 2002

• IP-over-SONET (OC-48c) backbone
• 53 direct connections
• 3 OC-48c connections - NCNI will be the 4th
• 1 Gigabit Ethernet trial - MREN
• 23 will connect via at least OC-12c (622 Mbps) by
  1Q02
• Number of ATM connections decreasing
• 207 participants research universities labs
• All 50 states, District of Columbia, Puerto
  Rico
• 15 regional GigaPoPs support 70 of participants
• Expanded access
• 37 sponsored participants
• 19 state education networks (SEGPs)
• including Hawaii, California, Oregon,
  Washington

5
(No Transcript)
6
09 January 2002
Abilene International Peering
STAR TAP/Star Light APAN/TransPAC, Canet3, CERN,
CERnet, FASTnet, GEMnet, IUCC, KOREN/KREONET2,
NORDUnet, RNP2, SURFnet, SingAREN, TAnet2
Pacific Wave AARNET, APAN/TransPAC, CAnet3,
TANET2
NYCM BELNET, CAnet3, GEANT, HEANET, JANET,
NORDUnet
SNVA GEMNET, SINET, SingAREN, WIDE
LOSA UNINET
OC3-OC12
AMPATH REUNA, RNP2 RETINA (ANSP)
San Diego (CALREN2) CUDI
El Paso (UACJ-UT El Paso) CUDI
ARNES, CARNET, CESnet, DFN, GRNET, RENATER,
RESTENA, SWITCH, HUNGARNET, GARR-B, POL-34, RCCN,
RedIRIS
7
Abilene High Performance Computing

• Backbone MTU raised to 9K bytes
• Connector peer MTUs changed on per request
  basis
• SCxy effort part of ongoing HPC support
• Annually escalating bandwidth
• SC99 Portland OC-12c SONET (622 Mbps)
• SC2000 Dallas OC-48c SONET (2.5 Gbps)
• SC2001 Denver 2xOC-48c SONET (5 Gbps)
• Significant traffic engineering
• SC2002 Baltimore 10-Gbps ? (planned)
• transit for domestic international RE peer
  networks
• End-to-End Performance GigaTCP testing

8
Raw HDTV/IP testing

• Packetized raw HDTV (1.5 Gbps)
• ISIe, Tektronix, UW project/DARPA support
• Connectivity and testing support
• P/NW MAX Gigapops, Abilene and DARPA Supernet,
  Level(3)
• SC2001 public demo
• November, 2001
• SEA -gt DEN via L(3)
• OC-48c SONET

9
Implications for support of high performance
flows over Abilene

• DARPA PIs Meeting SEA-gtDC area 1/6/02
• P/NW, Abilene, MAX in Internet2 path
• 18 hrs of continuous, single-stream raw HD/IP
• UDP jumbo frames 4444 B packet size
• Application level measurement
• 3 billion packets transmitted
• 0 packets lost, 15 resequencing episodes
• e2e network performance
• Loss lt8x10 -10 (90 confidence level)
• Reordering 5x10 9
• Transcontinental 1-Gbps TCP (std 1.5 kB MTU)
  requires loss at the level of 3x10 8 or lower

10
Future of Abilene

• Original UCAID/Qwest MoU amended on October 1,
  2001
• Extension of Qwests original commitment to
  Abilene for another 5 years 10/01/2006
• Originally expired March, 2003
• Upgrade of Abilene backbone to optical transport
  capability - ?s (unprotected)
• x4 increase in the core backbone bandwidth
• OC-48c SONET (2.5 Gbps) to 10-Gbps DWDM
• Capability for flexible provisioning of ?s to
  support future point-to-point experimentation
  other projects

11
(No Transcript)
12
Key aspects of next generation Abilene backbone -
I

• Native IPv6
• Motivations
• Resolving IPv4 address exhaustion issues
• Preservation of the original End-to-End
  Architecture model
• p2p collaboration tools, reverse trend to
  CO-centrism
• International collaboration
• Router and host OS capabilities
• Run natively - concurrent with IPv4
• Replicate multicast deployment strategy
• Close collaboration with Internet2 IPv6 Working
  Group on regional and campus v6 rollout
• Addressing architecture

13
Key aspects of next generation Abilene backbone -
II

• Network resiliency
• Abilene ?s will not be protected like SONET
• Increasing use of videoconferencing/VoIP impose
  tighter restoration requirements (lt100 ms)
• Options
• Currently MPLS/TE fast reroute
• IP-based IGP fast convergence (preferable)
• Addition of new measurement capabilities
• Enhance active probing (Surveyor)
• Latency jitter, loss, TCP throughput
• Add passive measurement taps
• Support for computer science research Abilene
  Observatories
• Support of Internet2 End-to-End Performance
  Initiative
• Intermediate performance beacons

14
Manhattan Landing an emerging New York City
exchange point

• MAN LAN is a project initiated to meet the needs
  of our international peers in NYC
• Abilene ITN does not provide transit to the U.S.
  fed nets
• MAN LAN is an I2 effort - not part of the Abilene
  Network
• NYC analog to Pacific Wave and STAR LIGHT EPs
• designed to integrate closely with the GTRN
  effort
• Gigabit/10-Gigabit Ethernet switch for bilateral
  peerings between U.S. and intl research nets
• Cisco 6509 NEBS-compliant switch at 60 Hudson St,
  23rd fl
• NG Abilene will connect at 10-Gbps summer, 2002
• Partnership
• IEEAF, Indiana University, NYSERNET, CANARIE
• Project point Paul Love ltepl_at_internet2.edugt

15
Regional optical fanout

• Next generation architecture Regional state
  based optical networking projects are critical
• three-level hierarchy Backbone, GigaPoPs/ARNs,
  campuses
• Leading examples
• CENIC ONI (California), I-WIRE (Illinois),
• SURA Crossroads (Southeastern U.S), I-LIGHT
  (Indiana)
• Collaboration with the Quilt
• Regional Optical Networking project
• U.S. carrier DWDM access is now not nearly as
  widespread as with SONET circa 1998

16
Optical network project differentiation
17
The Big Hybrid Build A national fiber optical
networking facility

• Objective
• To create an extensible, multi-? national
  facility O(100) Gbps - to support the diverse
  and evolving advanced networking requirements of
  the U.S. scientific communities, research
  universities, and advanced regional networks

18
Building a national fiber optical networking
facility

• Purchase IRUs for 1-2 pairs of fiber on national
  footprint (12-20 access points)
• Leverage current fiber glut and turbulent
  corporate climate
• 2nd pair would enable optical experimentation and
  eventual upgrade transition
• Pursue condominium approach to OM (corporate
  partner)
• Multiple ?s for multiple uses IP bearer
  service, p2p ?s
• N-body academic/corporate partnership
• National fiber builder and OM provider
• Optical transport kit producer
• Need next generation ULH gear?
• Optical switching partner (when ready)
• Optically enabled advanced regional networks
  for fanout and vital optical technology
  collaboration

19
Conclusions

• Abilene future
• UCAIDs partnership with Qwest extended through
  2006
• Backbone to be upgraded to 10-Gbps in three
  phases
• Native v6, enhanced measurement, and increased
  resiliency are new thrusts
• Overall approach to the new technical design and
  business model is for an incremental,
  non-disruptive transition
• Nicely positioned and collaborative with NSFs
  TeraGrid distributed computational backplane
  effort
• Pacific ? National Light Rail
• Emerging expanding collaboration to develop a
  persistent advanced optical network
  infrastructure capability to serve the diverse
  needs of the U.S. higher ed research
  communities
• Initial partners CENIC P/NW, Argonne/TeraGrid,
  UCAID