UKLight Status of Exploitation Projects

1
UKLight Status of Exploitation Projects

• UKLight Site Connection Status Timeline
• SC2004 interlude
• Exploitation Projects Status
• ESLEA
• Particle Physics
• Reality Grid
• E-Diamond/Integrative Biology
• 46PaQ
• MASTS
• LoIs for Phase 3 UKLight

2
GLIF Global Lambda Integrated Facility
GLIF is a collaborative initiative among
worldwide NRENs and institutions to enable RD
for new ways of networking
3
UKLight Phases 1 2Showing Network capacity
available to projects
CNLMANLancaster
CLRC-DL
Leeds C-PoP
YHMANLeeds
10G
WarringtonC-PoP
5G
NNWManchester
7.5G
10G
10G
EastNet Cambridge
ReadingC-PoP
CLRC-RAL
7.5G
10G
10G
St Pancras
10G
10G
10G
10G
10G
ULCC
Amsterdam
10G
Chicago
UCL (Dark Fibre)
4
UKLight Site Connection Status
5
UKLight Timeline
Infrastructure
UCL connected
International link To ULCC
04
06
05
ESLEA Start
46PaQ MASTS Start
Projects
6
Collaboration at SC2004

• Working with S2io, Sun, Chelsio

• Setting up the BW Bunker

• SCINet

• The BW Challenge at the SLAC Booth

7
SC2004 UKLIGHT Focused on Disk-to-Disk
Manchester
SC2004
SLAC Booth
Cisco 6509
MB-NG 7600 OSR
Caltech Booth UltraLight IP
UCL network
UCL HEP
NLR Lambda NLR-PITT-STAR-10GE-16
ULCC UKlight
K2
K2
Ci
UKlight 10G Four 1GE channels
Ci
CERN 7600
UKlight 10G
Surfnet/ EuroLink 10G Two 1GE channels
Chicago Starlight
K2
8
The Bandwidth Challenge SC2004

• The peak aggregate bandwidth from the booths was
  101.13Gbits/s
• Or 3 full length DVD per second
• Saturated TEN 10GE waves

9
Awaiting UKlight Conection
UKlight connected
UKLight connected but not locally
connected Within site
Fully connected to end site equipment
10
ESLEAHigh Energy Physics CCLRCLHC Service
Challenges
UHI Network
AbMAN
Clydenet
FaTMAN
EaStMAN
T
T
CNL MAN
Lancaster
NNW
C
Manchester
T
Glasgow
Edinburgh
NorMAN
S
YHMAN
T
Warrington
Leeds
T
EMMAN
MidMAN
T
EastNet
Reading
T
CCLRC-RAL
London
Kentish MAN
TVN
UCL
Portsmouth
T
Bristol
LMN
Northern Ireland
S
South Wales MAN
S
T
S
LeNSE
SWERN
CHCERN
USAFNAL
11
CDF experiment at Fermilab (Chicago) is presently
producing 1000 Tb of data per year. Subsets of
this data are analysed by 200 physicists in
UK/Europe.
UKLight will be used to - transfer data from
Fermilab for analysis in UK - transfer data from
Fermilab which is then re-processed on Grid
resources in UK and then sent back to
Fermilab - send simulated data (generated in the
UK) back to Fermilab for use by 800 other
physicists - distribute data to CDF colleagues
in Italy/Germany/Spain via CERN
12
(No Transcript)
13
CERN ? CCLRC Service Challenges Sustained Data
flows to reach 5 Gbit/s into CERN
CERN
Fermilab-Tier1
Lyon-Tier1
Needs 2 Gbit/s now
CCLRC-Tier1
Karlesruhe-Tier1
14
High Energy Physics Roadmap for 6 months

• CDF ? Fermilab
• - transfer data sets from Fermilab to UCL
  required for analysis
• by UK physicists frequent copies of (100 Gb)
  datasets)
• Distribute to Oxford etc from UCL using UKLight
• - open up facility to other UK HEP groups with
  data at Fermilab
• i.e. D0 and MINOS.
• - generate simulated data using Grid at UCL and
  send back
• to Fermilab constant low level traffic
• CCLRC ? CERN
• Mid March 2 Gbit/s tests to CERN for 1 day
• SC2 Service Challenge at end March 100 Mbytes/s
  for 2 weeks
• May/June Peak Load test at 2 Gigbit/s for
  sustained period

15
ESLEARadio Astronomy
Thanks to UKERNA for Helping in Manchester for
production network use to bypass bottleneck for
early work
UHI Network
AbMAN
Clydenet
FaTMAN
EaStMAN
T
T
CNL MAN
Jodrell Bank
NNW
C
T
Glasgow
Edinburgh
NorMAN
S
YHMAN
T
Warrington
Leeds
T
EMMAN
MidMAN
T
EastNet
Reading
T
London
Kentish MAN
TVN
Portsmouth
T
Bristol
LMN
Northern Ireland
S
South Wales MAN
S
T
S
LeNSE
SWERN
NLDwingeloo
16
WesterborkNetherlands
EffelsbergGermany
JIVE
17
Transmission of Free Messages on Astronomical
Subjects over the Transatlantic
Cables A very important concession has been
made to the Smithsonian Institution by the
Directors of the Associated Transatlantic Cable
Companies, who have agreed to transmit
gratuitously between Europe and the United
States, a limited number of short messages on
astronomical subjects. Under this arrangement
two telegrams have already been received from
the United States by the Astronomer Royal, who
on his part has undertaken, at the request of Dr.
Henry, Secretary of the Smithsonian
Institution, to forward from Europe any message
announcing an important astronomical discovery.
The Directors of the Associated Companies have
consented that ten messages, of ten words each,
may be sent free over the cables annually. This
liberal concession on the part of the Directors
cannot be too highly appreciated by astronomers
generally, and especially by the Fellows of
this Society. In conformity with this
agreement the Astronomer Royal will be prepared
to forward any important astronomical message,
limited to _ten_ words, which may be sent to
him for this purpose from the principal
European astronomers.
Royal Observatory, Greenwich,

April 8, 1873.
18
Radio Astronomy UKLight use so far

• - Waiting for connection
• - Achieving 100 200 Mbit/s on production link

19
Radio Astronomy Roadmap for 6 months

• - March 11 Science tess to Dwingeloo at 300
  Mbit/s
• will try to use production link
• - Ramp up to 1 Gbit/s flows to correlator as soon
  as link established

20
Reality Grid
Thanks to UKERNA for MB-NG link from Manchester
to ULCC
UHI Network
AbMAN
Clydenet
FaTMAN
CCLRC-DL
EaStMAN
T
T
CNL MAN
Manchester
NNW
C
T
Glasgow
Edinburgh
NorMAN
S
YHMAN
T
Warrington
Leeds
T
EMMAN
MidMAN
T
EastNet
Reading
T
London
Kentish MAN
TVN
Portsmouth
T
Bristol
LMN
UCL
Northern Ireland
S
South Wales MAN
S
T
S
LeNSE
SWERN
USATeragrid
21
ReG Applications on UKLight
HPC engine
HPC engine
checkpoint files
steering control and status
visualization data
compressed video
visualization engine
long term storage
22
Scientific Application Pipeline

• A variety of simulation codes (NAMD, LB3D,..,),
  enabled by computational steering and on-line
  visualization, to study (inter alia)
• Defect dynamics in cubic mesophases
• Binding affinities for peptide protein systems
  (SH2 domains)
• Viscoelastic properties of amphiphilic fluids
  Binding affinities for peptide protein systems
  (immunological applications, TCR-p-MHC)
• Vortex knot dynamics and turbulence studies (with
  Prof B Boghosian, Tufts University)

23
Use of UKLight and NGS at AHM04
UK NGS
Leeds
Manchester
Starlight (Chicago)
US TeraGrid
Netherlight (Amsterdam)
Oxford
RAL
SDSC
NCSA
PSC
UCL
UKLight
AHM 2004
Local laptops and Manchester vncserver
Both the US TeraGrid and UK NGS use GT2 middleware
All sites connected by production network (not
all shown)
Computation
Steering clients
Service Registry
Network PoP
24
ReG Applications Roadmap for next 6 months

• Now-April connection of high end computational
  facilities to UKLight
• UCL short-term workarounds at CSAR NGS
  (Manchester) HPCx
• March-May 3rd party file transfers using GridFTP
  between dual-homed systems
• for checkpoint transfer/job migration and result
  harvesting
• June-August streaming data between simulation
  and visualization via UKLight
• Sep-Nov use of UKLight to enable distributed
  simulation and visualization across UK NGS and US
  TeraGrid
• linked to demonstrations at AHM 2005, iGrid,
  Supercomputing
• 2006
• quantitative studies on overhead of computational
  steering
• effect of quality of service on applications,
• incorporation of new protocols

25
46PaQ
UHI Network
AbMAN
Clydenet
FaTMAN
EaStMAN
T
T
CNL MAN
NNW
C
T
Glasgow
Edinburgh
NorMAN
S
YHMAN
T
Warrington
Leeds
T
EMMAN
MidMAN
T
EastNet
Cambridge
Reading
T
London
Kentish MAN
TVN
Portsmouth
T
Bristol
LMN
UCL
Northern Ireland
S
South Wales MAN
S
T
S
LeNSE
SWERN
26
46PaQ

• IPv4 IPv6 Performance and QoS
• http//www.cs.ucl.ac.uk/research/46paq/
• 01 Dec 2004 - 30 Nov 2006
• Sites
• Computer Science, UCL (CS-UCL)
• Computer Laboratory, Cambridge (CL-CAM)

27
46PaQ overview

• Multi-Gb/s protocol operation
• New protocols (e.g. DCCP, TCP extensions)
• Engineering of the protocols and end-systems
• Network feedback to applications for adaptation
• Real-time traffic monitoring at multi-Gb/s
• Multi-protocol analysis
• Traffic modelling

28
46PaQ - UKLight use so far

• Awaiting Connectivity

29
46PaQ - Roadmap for next 6 months

• Performance tests in the lab during 2005
• CS-UCL 1Gb/s tests on UKLIGHT Q1/2005
• Loopback and site-to-site (sites to be chosen)
• High-speed real-time traffic monitoring
• Performance analysis and comparison for different
  protocols
• Move to 10Gb/s by Dec 2005
• (UKERNA 10Gb/s connectivity solution?)
• 10Gb/s lab tests Q2/2005
• CS-UCL move to UKLIGHT 10Gb/s Q4/2005
• Full experiments on UKLIGHT during 2006

30
46PaQ
UHI Network
AbMAN
Clydenet
FaTMAN
EaStMAN
T
T
CNL MAN
NNW
C
T
Glasgow
Edinburgh
NorMAN
S
YHMAN
T
Loughborough
Warrington
Leeds
T
EMMAN
MidMAN
T
EastNet
Cambridge
Reading
T
London
Kentish MAN
TVN
Portsmouth
T
Bristol
LMN
UCL
Northern Ireland
S
South Wales MAN
S
T
S
LeNSE
SWERN
31
MASTS

• Measurement at all Scales in Time and Space
• http//www.ee.ucl.ac.uk/lsacks/acse/masts/
• Sites
• Computer Science, UCL (EE and CS)
• Computer Laboratory, Cambridge (CL-CAM)
• Loughborough University (EE and CS)
• UKLIGHT connectivity summary
• Connection to ULCC - as virtual PoP
• Access to Fibre for pasive monitoring (under
  negotiation)
• Access to UKLight management station for
• Configuration logging
• Electronic measurements

32
MASTS Overview

• Long-term, high-rate measurement of network
• Development of 10G/s passive probes
• Cam
• Real time data analysis and compression
• Cam / UCL / Loughborough
• Grid based data archive
• UCL
• Web/Grid services for data analysis and
  visualisation.
• Loughborough / UCL
• A scientific view of traffic and topology
  evolution

33
MASTS roadmap for UKLIGHT

• MASTS does not generate traffic as such
• Key milestones
• Instillation of passive probes in ULCC
• Installation of passive probes in UK network
• 46PaQ joint
• Archiving of management information from ULCC

34
Letters of Intent for UKLight connection

• Edinburgh
• ScotGrid
• UKQCD
• Bioinformatics Research Network
• HPC machines at advance computing facility
• Glasgow
• Computer Science Netowkr Research
• ScotGrid
• Bioinformatics projects
• Electronics engineering ? NASA
• York
• Collaborative Musical Performances
• Real time Grid computing for music
• White Rose Grid

35

• Brunel
• Command and control centres
• Digital video broadcasting
• Grid scheduling
• Cranfield
• Birmingham
• Seismic reconstruction
• Collaborative music
• Complex system simulation
• Particle Physics visualisation
• Belfast
• Grid broadcast
• legal data mining
• Gene Grid
• Financial risk
• Military media

36
Summary

• Existing connection to USAStarlight has been in
  use since commissioned
• Only UCL ? FNAL Teragrid, being used by early
  adopters
• Won big splash prizes at AHM and SC2004
• Some reliability problems with link being
  addressed
• Connections to UK sites not in place yet
• Recently UKERNA agreed to allow use of MB-NG
  connection on pseudo-persistent basis. This
  should allow main HPC interest to start work
• Expect other sites to be commissioned by end Feb
• RC funded projects are only just starting
• Funded post in place from 2005 onward
• Many Applications areas signalled interest in
  Letters of Intent
• Three year project ending in Dec 2005 is
  misleading
• Earliest possible start of regular use has not
  yet occurred
• Assuming this to be in few weeks then earnest
  use begins March 2004 which is 10 months before
  the end