Traffic Measurements

1
Traffic Measurements

• Subprogram 1, Workpackage 1b (ETOMIC)

2
Participating partners

• Collegium Budapest
• Public University of Navarra
• Ericsson AB
• Tel Aviv University

3
Infrastructure stations 2006
4

• Each measurement station consists of
• Server PC architecture
• DAG 3.6 GE card with packet sending capability
  (Endace)
• own GPS antenna for time synchronization
• Repository and data processing
• Everlab IBM blade center
• Central management system
• Access via www.etomic.org

5
Deliverables and Milestones

• 36 Months
• D.1b.3 Spatio-temporal periodic mapping of the
  European Internet traffic.
• M.1b-3.1 Implementation of BART tool in ETOMIC
  M32.
• M.1b-3.2 ETOMIC-DIMES permanent interoperability
  M32.
• M.1b- 3.3 Final ETOMIC visualization tools M36.
  
• M.1b-3.4 European periodic traffic tomography map
  M36.
• 48 Months
• D.1b.4 Complex Model of Internet traffic for
  extended simulations.
• M.1b-3.5 Final form and documentation of BART
  M48.
• M.1b-3.6 Advanced final ETOMIC measurement
  archives M48.

6
Meetings in 2006

• February ETOMIC workshop in Budapest
• Participants Colbud, TAU, Pamplona,
  Lousanne, Ericsson, HUJI
• -- Agreement on the joint implementation
  steps of the ETOMIC-DIMES measurements
• -- Agreement on the joint implementation steps
  of BART in ETOMIC
• -- Agreement on the steps of the WP1c whitepaper
• May Meeting with the MoMe (IST Cluster Project)
  
• May Ohad Serfaty (TAU) and Jozsef Steger
  (Colbud) work in Budapest and integrate the
  pattern generator into DIMES
• September Meeting in Budapest with Darlagiannis
  Vasilios
• (Lausanne) to finalize the white paper
• December Rome

7
Main technical accomplishments in the etomic
system

• New scriptable interface
• New periodic measurements
• Open repository with public results.
• Final ETOMIC visualization tools
• Scriptable interface using URL coding
• SCRIPTInfo Get info about finished experiments.
• SCRIPTDownload Download an experiment.
• SCRIPTRemove Remove an experiment

8
Periodic measurements
Before
Now
Periodic measurement
Experiment
Experiments
9
Implementation of BART tool in ETOMIC
10
BART Bandwidth Available in Real-Timedeveloped
by Ericsson Research

• Active probing
• Alternate the probe traffic intensity u
• Use timestamps to compute the strain between
  probe packet pair
• ?i relative time dispersion of probe pair i
• The average strain ? of N probe packet pairs
  serves as an input parameter to the Kalman filter

11
Available bandwidth distribution
12
European periodic tomography map final
visualization tools
13
Network Tomography
Goal to resolve delay statistics on internal
network segments too, where we do not have
monitoring stations
Method we send back-to-back packet pairs and
measure their end-to-end delay at arrival with
very high precision
Key idea delay correlation on the common segment
for the packets in a pair
SP4 message passing algorythm is used now
14
New periodic tomography measurementand its
Google Map visualization tool
15
Tree visualization tool for tomographyend-to-end
delay
16
Tree visualization of tomographyinternal delay
distribution
17
One way delay (OWD)

• From all nodes to all nodes in ETOMIC system
• Twice a day (12 hours minimum interval)
• 300 packets for each source/destination
• Packet size 46 bytes
• Data available since december 2005
• Results available on the web ?

18
Quick visualization
OWD Pamplona - Jerusalem
src dst timestamp delay hops ipid packet_size
packets_sent 130.206.163.166 132.65.240.106
1165012406853288055 47716141 15 1 46
300 130.206.163.166 132.65.240.106
1165012407853289247 47131300 15 2 46
300 130.206.163.166 132.65.240.106
1165012408853288711 47589957 15 3 46
300 130.206.163.166 132.65.240.106
1165012409853288591 47452569 15 4 46
300 130.206.163.166 132.65.240.106
1165012410853288949 47161877 15 5 46
300 130.206.163.166 132.65.240.106
1165012411853289187 47433138 15 6 46
300 130.206.163.166 132.65.240.106
1165012412853288293 47639072 15 7 46
300 130.206.163.166 132.65.240.106
1165012413853289307 47383010 15 8 46
300 130.206.163.166 132.65.240.106
1165012414853288353 47460735 15 9 46
300 130.206.163.166 132.65.240.106
1165012415853288949 47564626 15 10 46
300 130.206.163.166 132.65.240.106
1165012416853290082 47257125 15 11 46
300 130.206.163.166 132.65.240.106
1165012417853289068 47008753 15 12 46
300 130.206.163.166 132.65.240.106
1165012418853289545 47578037 15 13 46
300 130.206.163.166 132.65.240.106
1165012419853289009 47124266 15 14 46 300
19
Periodic traceroute measurements

• From all nodes to all nodes in ETOMIC system
• Twice a day (12 hours minimum interval)
• 3 packets per hop (TTL) per destination
• Data available since march 2005
• Results available on the web ?

20
Traceroute topology
21
Clock synchronization (GPS)

• Parameters
• dag-offsetoffset in microsecond betwen system
  clock (PC) and dag card.
• pps-offsetoffset in microsecond betwen PPS
  signal from GPS and NTP clock.
• satellite-count number of satellites in view.
• From all nodes in ETOMIC system
• 5 minutes minimum interval
• Data available since april 2005
• Results available on the web ?

22
Plans and progress for 2007
23
Virtual observatory
24
Database interface and schema
Uploaded 2.5 billion measurements
25
Complex traffic model
26
Working hypothesis Medusa

• The hypothesis is that the Internet consist of a
  highly conducting nucleus limbs
• Compare Planet-Lab tomography topology with
  ETOMIC tomography topology to see if ETOMIC is a
  good sample of the global Internet near the
  Nucleus

27
Analysis of queuing delay statistics
28
Analysis of link delay statistics
29
Log-normal link delay statistics
30
Publications and patents in WP1b
31

• Infocom 2006 1 paper 3 presentations
• Global Internet Symposium 2006 1 paper
• Papers/conferences 15 papers
• Patents 1

32
Thank you !