Download Slide 1

Monitoring JANET: from photons to flows
Demands - Architectures - Regulation
Steve Williams
JANET
• Demands:
•From researchers
•From NOCs/institutions/’power’ users
Monitoring JANET
from photons to flows
Requirements
•Layer 1, 2, 3 … metrics
•Routing (BGP/ISIS) – updates/full feed
•Packet capture data (up to 40Gbps)
•Flow data
•Legal requirements
•RIPA, DPA, private data, ethical behaviour
The SuperJANET5
5th Objective
Network Visibility
•Indivudual vs institutional data & summary vs detail data
•Research topics in the UK
•Visualization
•Signature analysis / DPI
•Anomaly processing
•Optical networks/switching
•Issues:
•Standards in measurements
•Standard approach across measurement types
Steve Williams
[email protected]
•Interchange of data between systems
•Hard to compare measures directly
•What is a ‘good’ link?
2
Monitoring JANET
from photons to flows
JANET and Research
• Aim to support and encourage research and
assist where possible by providing
bandwidth and services that help researchers
• Assist network research by providing access
to the network
• Need to balance:
– operational vs research requirements…
– legal vs research requirements
Monitoring is research driven
3
Technology
Innovation
Network
Science
Applications
UKLIGHT ‘network’ projects
ESLEA
Applications and the Network
MASTS
Analysis at All Scales
in Time & Space
Real-time Monitoring
Towards
Next
Generation
Networks
46PaQ
Protocol Innovation
Behaviour And Performance
For QoS and Control
Data Acquisition,
Storage & Archiving
Compression (Model Free & Model Dependant)
Data Analysis
and
Traffic Modelling
Front End Enhancements: Advanced Protocols
SuperJANET and UKLIGHT
Research
Activities and Projects
Example: Research at ESSEX
University
TRIUMPH
Develop switching node for:
- Bit-rate adaptation
- Multiwavelength regen
LUCIFER
Control plane and network
resource provisioning for
Grid and eScience
Label
Switching Routers
Modelling end to end
QoS across
heterogeneous nets
SONET/SDH
Collector ring
Edge
OPS
HIPNET
UPC
Optical Transport Network
Networking with
ultra-short pulses:
-OTDM transmission
-OTDM switching
-Time-Slot Interchange
OXC
Core
OPS
OB
S
OPORON
ephoton/ephoton+
OPSnet
UFORIC
PROTAGON
40G all-optical
burst Rx
MUFINS
Hardware based CBR with optical impairments
Monitoring JANET
from photons to flows
- LHC
- JIVE
- DEISA
-Layer 0 network
-UKLight STM/GE circuits
6
FaTMAN
UHI
Monitoring JANET
Glasgow
NIRAN
from photons to flows
Clydenet
C&NLMAN
EaStMAN
AbMAN
NorMAN
Overall Network:
- 5,815km New Dark Fibre
- 112 optical nodes/sites
-746Gbps operationa capacity
-60 x 10G plus 2.5, 1
Core Network:
- 8 nodes
- 2,290Km fibre
- 20 Terminal systems, 23
Amp/OADM
- Longest un-regen – 554km
- Longest span – 243.6km (51.2db)
Regional Network access:
- 3,561km Fibre
- 24 optical networks
- 73 sites
- 36x10G, 26xSTM16,16GE and an
STM1
Dublin
(HEANET)
YHMAN
NNW
Leeds
Warrington
EastNe
MidMAN
EMMAN
T-City
T-House
London
Reading
TVN
LMN
WREN
Kentish
MAN
SWERN
LeNSE
7
Bristol
Monitoring JANET
from photons to flows
Graphic removed
8
Private network
Probe/Measure traffic
Inst-meas-1
RN
Measurement probes
Inst-meas-1
Core MP-1
SuperJANET4/5
RN
Monitoring JANET
from photons to flows
Inst-meas-1
Firewall
Extreme 450
1000Mbps/TX
-
IP-SLA
Ping
SNMP
Perl
3TB
V480
•Performance
•RTT
•OWD
•Loss SD/DS
•HTTP
•DNS
•TCP Connect
•HTTP transfer
•Total time
•DNS
•Response time
•VoIP
•MOS
•Connect
•NTP
•Time
V240
V240
Cisco 35xx
9
The JANET Measurement System
Monitoring JANET
from photons to flows
10
Monitoring JANET
from photons to flows
11
Monitoring JANET
from photons to flows
-
Traffic types
Top talkers
Incident tracking
Anomaly detection
Signature analysis
etc
-
Challenges:
- >70k flows/sec
at 10:1 sample
rate
- T640’s not good
at sampling
12
Monitoring JANET
from photons to flows
Multicast
13
Monitoring JANET
from photons to flows
Multicast
AG conference@5mbps
Add soton screen shots
14
Monitoring JANET
from photons to flows
Beyond IP
JANET IP
JANET
Lightpath
Optical Transmission
(DWDM)
15
Optical NE data:
Alerts - Light on/off
Ciena/VzB - SNMP traps
Nortel via SNMP
Monitoring JANET
from photons to flows
JANET Optical
Core
DWDM
Juniper
T640
Flow data:
SuperJANET5 – Optical monitoring:
Feed to Optical Switch and Optical
monitoring equipment
Packet data to content level:
Incident/Anomaly detection, Signature
analysis
Traffic types
Incident detection
Packet headers only
Sampled
16
Monitoring JANET
from photons to flows
Optical layer packet capture
Production
SJ5 fibres
1 – 40Gbps
Anomaly detectiion
Incident tracking
Packet signature analysis
Encrypted signatures
17
Monitoring JANET
from photons to flows
What was that about sniffing packets
Isn’t that interception?
18
Monitoring JANET
from photons to flows
• JANET is a private network
– No public/walk in access
– Only access to staff/students/bona fide
visitors
– Breach of RIP by network operations
staff is civil case not criminal
– Breach by non-operations staff is still
criminal (student hackers etc…)
– http://www.ja.net/development/legisl
ation/laws.html
19
• Principle of ‘least disclosure’
Monitoring JANET
from photons to flows
Research access to
data
– No access to data not required
– Use anonymisation where possible
– Access to full data only in cases where
proven case presented
– No access to header and payload data
– Payload summary data/signatures
• Researchers agree to and sign policy
– Non-disclosure of data
– Maintain privacy
– Scope of research work
• This policy works only because JANET
is a private network.
20
Tape
Backup
JANET
Measurement
Systems
Data Throughput
Manager
Data Gatherers
Measurement Database
and Central Controller
Standby
Database
External
Databases
Delivery
Sub-systems
Users
Web
Alerts
NRG
...
Gridmon
Flow monitoring
CDF
...
Measurement
System
Measurement system
application
NTP
Ping
...
...
Data timeslices
Data timeslices
Data
timeslices
Web service
API
Measurement controller
Data Gatherers
Meas’ment
job configuration
file
Monitoring JANET
from photons to flows
Key issues
• Architecture of monitoring is key
• Interchange of data between sytems
• Stability and comparability of data
between locations and across time
• The legal framework cannot be ignored
– Some researchers try…
– Some countries have less stringent laws
23
Monitoring JANET
from photons to flows
24