CANARIE CAnet 3 The Customer Empowered Networking Revolution

1
CANARIE CAnet 3The Customer Empowered
Networking Revolution

• http//www.canarie.ca
• http//www.canet3.net

Background Papers on Gigabit toThe Home and
Optical InternetArchitecture Design
AvailableOptical Internet News listSend e-mail
to Bill_at_Canarie.ca
Bill.St.Arnaud_at_canarie.ca http//www.canarie.ca/b
starn Tel [phone]
2
The Networked NationA proposed strategy on how
research and education networks in partnership
with government can enable Gigabit Internet
infrastructure available for homes, schools,
businesses in all communities by 2005, for less
than the cost of Internet services today
3
The Message

• In mid 1990s the prevailing wisdom was that
  commercial sector would drive design of Internet
  infrastructure
• RE networks would focus on applications or
  specialized services
• As a result in North America RE networks were
  commercialized or discontinued
• e.g NSFnet CAnet
• However new network technologies and most
  importantly dark fiber is allowing RE networks
  to once again redefine telecommunications not
  only for themselves but also for businesses and
  most importantly the last mile to the home
• RE networks may become the cornerstone of
  municipal fiber to the home networks
• LAN architectures, technologies and most
  importantly LAN economics are invading the WAN
• Control and management of the optics and
  wavelengths will increasingly be under the domain
  of the LAN customer at the edge, as opposed to
  the traditional carrier in the center
• Over time the current hierarchical connection
  oriented telecom environment will look more like
  the Internet which is made up of autonomous
  peering networks.
• These new concepts in customer empowered
  networking are starting in the same place as the
  Internet started the university and research
  community.

4
CANARIE Inc

• Mission To facilitate the development of
  Canadas communications infrastructure and
  stimulate next generation products, applications
  and services
• Canadian equivalent to Internet 2 and NGI
• private-sector led, not-for-profit consortium
• consortium formed 1993
• federal funding of 300m (1993-99)
• total project costs estimated over 600 M
• currently over 140 members 21 Board members

5
CANARIES Programs

• Advanced networks
• CAnet - Original Internet Backbone 1990-96
• NTN - worlds largest ATM test network 1996-97
• CAnet 2 - Canadas Next Generation Internet
  1997-2000
• CAnet 3 - worlds first optical Internet
  1998-2002
• Outreach
• Trade shows, Iway awards, etc
• Technology and Applications Development
• Funding for companies to develop products and
  applications

6
CAnet 3 National Optical Internet
Consortium Partners Bell Nexxia Nortel Cisco JDS
Uniphase Newbridge
CAnet 3 Primary Route
CAnet 3 Diverse Route
GigaPOP
ORAN
Deploying a 4 channel CWDM Gigabit Ethernet
network 700 km
Deploying a 4 channel Gigabit Ethernet
transparent optical DWDM 1500 km
Condo Dark Fiber Networks connecting universities
and schools
Condo Fiber Network linking all universities and
hospital
Multiple Customer Owned Dark Fiber Networks
connecting universities and schools
Netera
MRnet
SRnet
ACORN
St. Johns
BCnet
Calgary
Regina
Winnipeg
Charlottetown
RISQ
ONet
Fredericton
Montreal
Vancouver
16 channel DWDM -8 wavelengths _at_OC-192 reserved
for CANARIE -8 wavelengths for carrier and other
customers
Halifax
Ottawa
Seattle
STAR TAP
Toronto
Los Angeles
Chicago
New York
7
O-BGP (Optical BGP)

• Control of optical routing and switches across an
  optical cloud is by the customer not the
  carrier
• A radical new approach to the challenge of
  scaling of large networks
• Use establishment of BGP neighbors or peers at
  network configuration stage for process to
  establish light path cross connects
• Edge routers have large number of direct
  adjacencies to other routers
• Customers control of portions of OXC which
  becomes part of their AS
• Optical cross connects look like BGP speaking
  peers
• BGP peering sessions are setup with separate TCP
  channel outside of optical path or with a
  Lightpath Route Arbiter
• All customer requires from carrier is dark fiber,
  dim wavelengths, dark spaces and dumb switches
• Traditional BGP gives no indication of route
  congestion or QoS, but with DWDM wave lengths
  edge router will have a simple QoS path of
  guaranteed bandwidth
• Wavelengths will become new instrument for
  settlement and exchange eventually leading to
  futures market in wavelengths
• May allow smaller ISPs and RE networks to route
  around large ISPs that dominate the Internet by
  massive direct peerings with like minded networks

8
Customer Empowered Networks

• Universities in Quebec are building their own
  2000km fiber network
• Universities in Alberta are deploying their own
  400 km 4xGbe dark fiber network
• School boards and municipalities throughout North
  America are deploying their own open access, dark
  fiber networks
• Carrier are selling dim wavelengths managed by
  customer to interconnect dark fiber networks
• Williams, Level 3, Hermes
• Typical cost is one time 20K US per school for a
  20 year IRU
• In Ottawa we are deploying a 60km- 144 strand
  network connecting 26 institutions cost 1m US

9
Réseau du RISQ
Val dOr/Rouyn
Observatoire Mont-Mégantic
10
Lanaudière
Sorel-Tracy
Lionel-Groulx
Marie-Victorin
Rosemont
Montmorency
Maisonneuve
Ahuntsic
Édouard-Montpetit
Bois-de-Boulogne
Vers Québec
St-Laurent/Vanier
Champlain
Vieux-Montréal
Gérald-Godin
Dawson
John-Abbott
André-Laurendeau
11
Dark Fiber Builds in Quebec
12
Typical Capital Costs

• Fixed One Time Capital Costs Include
• Management, engineering and construction costs
• Negotiating support structure agreements
• Fiber optic cables
• Fusing of fibers
• OTDR sweeps, Premise termination, etc.
• Average total cost between 7 and 15 per meter
  as follows
• Engineering and Design
• 1 - 3 per meter for engineering, design,
  supervision, splicing
• Plus Installation
• 7 to 10 per meter for install in existing
  conduit or
• 3 to 6 per meter for install on existing poles
• Plus Premise termination
• 5k each
• Plus cost of fiber
• 15 per strand per meter for 36 strands or less
• 12 per strand per meter for 96 strands or less
• 10 per strand per meter 192 strands or less
• 5 per strand per meter over 192 strands

13
Examples of Public Sector Fiber Build Costs

• Des affluents Total cost 1,500,00 (750,00 for
  schools)
• 70 schools
• 12 municipal buildings
• 204 km fiber
• 1,500,000 total cost
• average cost per building - 18,000 per building
• Mille-Isles Total cost 2,100,000 (1,500,000
  for schools)
• 80 schools
• 18 municipal buildings
• 223km
• 21,428 per building
• Laval Total cost 1,800,000 (1,000,000 for
  schools)
• 111 schools
• 45 municipal buildings
• 165 km
• 11,500 per building

14
Ottawa Fiber Build

• Consortium consists of 16 members from various
  sectors including businesses, hospitals, schools,
  universities, research institutes
• 26 sites
• Point-to-point topology
• 144 fibre pairs
• Route diversity requirement for one member
• 85 km run
• 11k - 50K per site
• Total project cost CDN 1.25 million
• Cost per strand less than .50 per strand per
  meter
• 80 aerial
• Due to overwhelming response to first build
  planning for second build under way

15
(No Transcript)
16
Why Customer Owned Dark Fiber

• First - low cost
• Up to 1000 reduction over current telecom
  prices. 6-12 month payback
• Second - LAN invades the WAN no complex SONET
  or ATM required in network
• Network Restoral Protection can be done by
  customer using a variety of techniques such as
  wireless backup, or relocating servers to a
  multi-homed site, etc
• Third - Enables new applications and services not
  possible with traditional telecom service
  providers
• Relocation of servers and extending LAN to
  central site
• Out sourcing LAN and web servers to a 3rd party
  because no performance impact
• IP telephony in the wide area (Spokane)
• HDTV video
• Fourth Allows access to new competitive low
  cost telecom and IT companies at carrier neutral
  meet me points
• Much easier to out source servers, e-commerce etc
  to a 3rd party at a carrier neutral collocation
  facility
• Customers will start with dark fiber but will
  eventually extend further outwards with customer
  owned wavelengths
• Extending the Internet model of autonomous
  peering networks to the telecom world

17
What is condominium fiber?

• A number of organizations such as schools,
  hospitals and universities get together to fund
  and build a fiber network
• Fiber is installed, owned and maintained by 3rd
  party professional fiber contractors usually
  the same contractors used by the carriers for
  their fiber builds
• Each institution gets its own set of fibers, at
  cost, on a 20 year IRU (Irrevocable Right of Use)
• One time up front cost, plus annual maintenance
  and right of way cost approx 5 of the capital
  cost
• Institution lights up their own strands with
  whatever technology they want Gigabit Ethernet,
  ATM, PBX, etc
• New long range laser will reach 120 km
• Ideal solution for point to point links for large
  fixed institutions
• Payback is usually less than 18 months

18
Typical Capital Costs

• Fixed One Time Costs Include
• Management, engineering and construction costs
• Negotiating support structure agreements
• Fiber optic cables
• Fusing of fibers
• OTDR sweeps, Premise termination, etc.
• Average cost between 7 and 15 per meter
• 7 to 10 per meter for install in existing
  conduit
• 3 to 6 per meter for install on existing poles
• 1 - 3 per meter for engineering, design,
  supervision, splicing
• Premise termination - 5k each
• Fiber
• 15 per strand per meter for 36 strands or less
• 12 per strand per meter for 96 strands or less
• 10 per strand per meter 192 strands or less
• 5 per strand per meter over 192 strands

19
Typical Payback for school(Real example des
affluents north of Montreal)

• DSL to 100 schools - 400 per month per school
• Over 3 years total expenditure of 1,440,000 for
  DSL service
• Total cost of dark fiber network for 100 schools
  1,350,000
• Additional condo participants were brought in to
  lower cost to school board to 750,000
• School board can now centralize routers and
  network servers at each school
• Estimated savings in travel and software upgrades
  800,000
• Payback typically 8 16 months

20
Simplification de la structure
21
CAnet 4 Distributed OIX
AS 549 ONet
AS 271 BCnet
AS 376 RISQ
OBGP
OBGP
OBGP
New York
Seattle
Chicago
Figure 12.0
22
Networked Nation
CAnet 4
Usually one GigaPOP per province
Provincial research and education network
Usually one access facility in every major town
and city
Splice Box
SuperNodes
Colo
School board office
Colo
City Hall
Colo
University
Nodes
Colo
Hospital
Library
School
School
School
Connection to homes in future
Home owners have fused connections all the way to
service provider at supernode
100 Funded by Industry Canada
Home owners are aggregated at node by service
provider of their choice
Mostly Funded by Province
Mostly Funded by Industry Canada as Loans for
public institutions
Mostly Funded by Industry Canada as Loans until
purchased by competitive service proviuder
Funded by private sector
23
Examples

• Sierra Nevada Power to offer 10 Mbps Internet
  over FTTH for 19.95
• Canberra Tansact was to be city wide VDSL now
  looking at GbE with fiber
• 500 to go by each home
• Telia in Sweden plans to have 1.5m GbE
  connections by end of next year
• Will abandon DSL sometime next year
• Sweden has announce 20 billion program fiber to
  home
• Norway, Holland and other countries investigating
• New housing developments are going with fiber and
  FastE or GigE
• Brossard, FutureWay, Houston, Palo Alto etc
• Moses Lake County in WA - 30,000 homes fiber
  Wash State law
• Most school boards are abandoning DSL in favor of
  dark fiber
• 1000 Quebec schools, Las Vegas, Spokane, etc
• Average one time cost per school - 25k
• Many new startups in the GITH and GITB market
• Worldwidepackets www.worldwidepackets.com -
  50/mo for Gbe
• Onfiber www.onfiber.com
• Yipes www.yipes.com
• VCs next hottest play after wireless and optical

24
Carriers are not the only decision maker in the
last mile

• Governments and consumers are becoming more
  active voice in determining the future of
  broadband to home
• Do not assume that carrier requirement is the
  only solution
• Open access is becoming a critical political
  issue
• Consumers want more than duopoly of cable and
  telco
• Facilities based competition the best
• Municipalities object to their streets being torn
  up
• Dig once bury lots of fiber
• Residents object to street furniture
• VDSL and HFC nodes
• MMDS and LMDS antennae

25
An important Role for Government

• Governments promote the framework for GITH
  networks by funding schools, universities,
  libraries, hospitals and municipal buildings as
  first customers and early adopters of dark fiber
  and optical networks
• Private sector leverages that investment by
  government to promote high speed Internet access
  to schools and universities to extend the fiber
  to the home
• Electric utility companies, municipal
  governments, CLECs, SMEs, entrepreneurs, as well
  as traditional telcos and cablecos can
  participate as providers, provided they subscribe
  to the architecture of open access, facilities
  based competition through dark fiber (or
  wavelengths)
• Emphasize the development and use of technology
  that specifically addresses the new architecture
  and the last mile, which must therefore be open,
  cheap and Internet-only (with the right jump
  start, there appears to be an opportunity for
  companies to excel in this marketplace, which is
  likely to turn out to be quite different from
  that for carrier-class and backbone- or legacy
  service-focussed equipment)

26
Application Grids

• Seamless integration of dark fiber networks and
  wavelengths to support high bandwidth
  applications
• Originally started with SETI_at_home
• Neptune 6000 km undersea grid
• NEON- National Environment Grid
• NEES National Seismology Grid
• Gryphen High Energy Physics Grid
• Commercial grids such as www.entropia.com to
  interconnect thousands of computers for
  applications in bio-chemistry, genome research,
  etc
• Canadian Forestry Grid
• Canadian NRC e-commerce grid centered in NB?

27
CANARIE's 6th Advanced Networks Workshop"The
Networked Nation" November 28 and 29,
2000Palais des CongrèsMontreal, Quebec - Canada

• "The Networked Nation", will focus on application
  architectures ("grids") made up of customer owned
  dark fiber and next generation Internet networks
  like CAnet 3 that will ultimately lead to the
  development of the networked nation where
  eventually every school, home and business will
  have high bandwidth connection to the Internet.
• Three tracks
• Customer owned dark fiber for schools, hospitals,
  businesses and homes.
• Next generation optical Internet architectures
  that will be a natural and seamless extension of
  the customer owned dark fiber networks being
  built for schools, homes and businesses.
• "application grids", which are a seamless
  integration of dark fiber and optical networks to
  support specific collaborative research and
  education applications.