Download ITRC2008-nakao

PlanetLab Research Activities
Aki Nakao
Univ. of Tokyo / NICT
PlanetLab
The largest and most popular overlay network testbed
Currently consists of 863 nodes at 447 sites
800+ Projects/ 1000+ Researchers
JGN2/NICT collocate overlay nodes in Japan
Several Universities in Japan have joined
863 nodes
447 sites
40+ countries
1000+ researchers
800+ Projects
2
Brief History of PlanetLab
PlanetLab 1.0 (2002-3)
UNIX account slivers
PlanetLab 2.0 (2003-4)
Vserver slivers
PlanetLab 3.0 (2004-2006)
PLCAPI 1.0
PlanetLab 4.0 (2007-)
MyPLC1.0
Federation Idea
PlanetLab 4.2 (2008)
We are here
Federation (PLE, PLJ, (PLK, PLC,=>PLA?))
New Development (RSpec/GENI-wrapper, New Node Type,
Monitoring, QA,VINI)
PlanetLab Consortium
Missions
Support and enhance the PlanetLab
Overseeing the long-term growth
Designing and evolving its software architecture
Providing day-to-day operational support
Defining policies that govern appropriate use
Users are required to join the consortium
Free for academic/non-profit organization
Annual due for corporate members ($300k-$25k)
Two Aspects
Substrate/test-bed for testing distributed
applications
Evaluate the new applications on the real networks
Bridge the deployment gap
Prototyping of new generation network
architectures
PlanetLab itself is the running code of slice-based
network architecture
5
Deployment Gap
PlanetWorks
Coblitz
Commercial Adoption
Maturity
Target
Pilot Demonstration (PL Gold)
Deployment Study (PlanetLab)
Controlled Experiment (EmuLab)
Economic Reality
User & Network Reality
Implementation Reality
Analysis (MatLab)
Time
[http://www.cs.princeton.edu/~llp/planetlab_oct07.ppt]
New Generation Network and Overlay Network Test-bed
What is Overlay
Network Testbed for ?
Innovation
Creation of Ideas Feedback Cycle
Limitations in Prior Models
Evaluation at Labs
Publish
Evaluation at Planetary Scale
Acquire Users (Pilot Services)
Overlay Test-beds
Enables These
Our Goals
Establish Innovative Business
Contributions to Society
New Generation Network
7
CoDeeN: Partial Replication CDN
CCC.COM
B
→ PlanetWorks (2007-)
→ Coblitz(2007-)
A
BBB.COM
A
A
C
C
B
C
B
B
A
C
AAA.COM
client
server surrogate
redirector
Large File Transfer! Faster than BitTorrent!
8
Large File Transfer via Coblitz
Coblitz [Park 06]
Bittorrent [Cohen 03]
Info
Server
HTTP
Proxy
Server
Multi Path + Cache
Tracker
Client
Peer
Peer
Client
Peer
9
What made PlanetLab successful?
Centralized trust
Centralized resource control
Decentralized management (unbundled management)
The bandwidth as free
Provide only best-effort service
Make Linux the execution environment
Do not provide distributed OS services (up to users)
Evolve the API
[Tom Anderson, Timothy Roscoe, “Learning from PlanetLab”, WORLDS’06]
Self-Scaling Architecture
[Aki Nakao]
Self-Scaling Architecture (as in P2P)
Consortium
Loosely bound
Membership Agreement
Donate a few resources
• At least two machines (minimum H/W requirement)
• Bandwidth
“Tit-for-Tat”
• Resource reciprocity
The more join, the more useful the system gets
Primary incentives in P2P applications
PlanetLab Architecture
Stanford
Cambridge
PlanetLab
Node
PLC
(PlanetLab Central)
Resources
U.Tokyo
The Internet
Princeton
resource
management
U.C.Berkeley
CMU
MIT
PlanetLab Architecture
12
Future Directions
(1) Accelerate the deployment of emerging overlay
applications (traditional mission)
CDN, routing, measurement, P2P, DHT, streaming,
distributed storage,…
(2) Extend PlanetLab architecture itself
(towards new generation network architecture)
Federation
Private PlanetLab
Wireless technologies integration
Hardware support (C/D separation)
GENI, VINI
13
PlanetLab New Generation
PlanetLabNG = GENI Prototype
PlanetLab 4.2 + geniwrapper
PLC wrapper: prototype done, integration underway
NM wrapper: prototype in progress
Wrapper includes…
interfaces
namespaces
security mechanisms
Migration plan
seed registries from PLC’s DB
Current and new interfaces coexist
unbundle PLC over time
experiment with peering
[PlanetLab Developer's Meeting
May 13-14, 2008 (Princeton University)
Overview, Deconstructing PLC and Meeting
Notes (Larry Peterson)]
PlanetLab Research Activities on JGN2
JGN2/NICT PlanetLab Collocation
PlanetLab Japan (PLJ) Federation (>PLAsia?)
Private PlanetLab : CORE
Public PlanetLab and Private PlanetLab
Birth of Private PlanetLab (enabled by MyPLC)
PlanetLab → Public PlanetLab
Private PlanetLab
Smaller-scale, experimental PlanetLab-like environment
From JGN2/NICT stand point
Public PlanetLab Activity
JGN/NICT Collocation
PLJ Federation
Prvate PlanetLab Activity
CORE (Utokyo/NICT)
16
JGN2/NICT PlanetLab Collocation
JGN2/NICT Collocation
Princeton has donated machines
PIs: NICT/UTokyo Researchers
17
Research Activity Matrix
Public PlanetLab
Private PlanetLab (CORE)
Overlay
Research
Wide-Area Distributed
Network Services
SORA (Overlay Routing)
Disruptive Network Services
CDN+DHT
Overlay
Education
Class Projects
Route Visualization
Disruptive Class Projects
OpenProxy
Test-bed
Enhancement
Federation
PlanetLab/OneLab/PLJ
Federation
CORE Federation
Ambitious Enhancement
Xen-Enabled PlanetLab
18
SORA Overview
SORA makes Routing-Overlay scalable…
19
SORA: One-Hop Striping Routing
SORA: One-Hop Striping Routing
Enabling Single-Home Multipath
[SORA++, J. R. Lane and A.Nakao, under submission]
21
Research Activity Matrix
Public PlanetLab
Private PlanetLab (CORE)
Overlay
Research
Wide-Area Distributed
Network Services
SORA (Overlay Routing)
Disruptive Network Services
CDN+DHT
Overlay
Education
Class Projects
Route Visualization
Disruptive Class Projects
OpenProxy
Test-bed
Enhancement
Federation
PlanetLab/OneLab/PLJ
Federation
CORE Federation
Ambitious Enhancement
Xen-Enabled PlanetLab
22
Xen-Enabled Private PlanetLab
Database
Control
VServer
Wrapper
Xen VM
PLC API
VServer VM
Control
Boot Server
Xen
Wrapper
Control
Control
Web Server
VMM Framework API Server
Communicate
Control
Xen Kernel
MyPLC
VMM Framework API Server
Communicate
Control
VServer Kernel
New Node
As Xen Node
New Node
As VServer Node
23
Research Activity Matrix
Public PlanetLab
Private PlanetLab (CORE)
Overlay
Research
Wide-Area Distributed
Network Services
SORA (Overlay Routing)
Disruptive Network Services
CDN+DHT
Overlay
Education
Class Projects
Route Visualization
Disruptive Class Projects
OpenProxy
Test-bed
Enhancement
Federation
PlanetLab/OneLab/PLJ
Federation
CORE Federation
Ambitious Enhancement
Xen-Enabled PlanetLab
24
CORE: Private PlanetLab
Current:
CORE
Sapporo
• 10 sites, 52 servers
• Multi-Homed
Collaborative Overlay Research Environment
Overlay test-bed based on “Private PlanetLab”
Provision resources for mission critical services
Sapporo
Medical U.
Features we would like to have…
Custom hardware to optimize overlay forwarding
PoP/Core collocation (nodes “inside” network)
Custom hardware to optimize overlay forwarding
Tohoku U.
Federation (e.g. PlanetLab, OneLab)
Target overlay research
Sendai
Hiroshima U.
NII
Kanazawa
Kyutech
Not just on distributed system apps
More on network core architectures
Utilize both private & public environments
Nagano
Local v.s. Global / Provisioned v.s. Best-Effort
Tsukuba
Nagoya
Okayama
Kitakyushu
Tokyo
U. Tokyo
New Generation Perspectives to Overlay Network
OsakaKeihanna
Fukuoka
Kochi
- Testbed for prototype and evaluate
a new generation network design
- Evolutional nature of overlay network
to incorporate into the design
NICT Otemachi
Osaka U.
Kochi-tech
NICT
Koganei
25
Federation
PlanetLab One
PlanetLab Two
PLCAPI
calls
nodes
slices
nodes
Sliver
Sliver
Sliver
Sliver
Sliver
Non-authoritative
caches
Sliver
Sliver
Sliver
Sliver
Sliver
Sliver
Sliver
Sliver
Sliver
slices
26
PlanetLab Future Activities in Japan
Public, Two kinds of Privates
Private PlanetLab
to develop Services
PLC
•Local
•Richer Resources
•Less Restricted Policy
•Small Business
PLC
Private PlanetLab
to develop Infrastructure
Federation
PLC
PLC
Public PlanetLab (Federated)
Members
NAKAO Akihiro (Project Leader)
YAMAMOTO Shu (KDDI)
NAKAUCHI Kiyohide
OZAKI Ryota
NISHIDA Yuji
Joined from abroad…
Kurt TUTSCHK (Germany)
Aun HAIDER (New Zealand)
Yufeng WANG (China)
Richard Potter (U.S.)
Du Ping (China)
…inviting more researchers
3 more candidates (foreign)
MURATA Masayuki (Advisory)
ATA Shingo
OHZAHATA Satoshi
KAMEI Satoshi (NTT Lab)
KAWAHARA Ryoichi (NTT Lab)
Eng LUA (NTT Lab)
ENOMOTO Nobuyuki (NEC)
FUJINAMI Makoto (NEC)
NISHIKI Ken’ya (Hitachi)
SATOH Hiroki (Hitachi)
MATSUI Susumu (Hitachi)
SHUDO Kazuyuki (Utagoe/NICT)
KDDI Lab people
Research Lab Location
Hakusan, Tokyo (near Utokyo)
3-Floors (3F, 4F, 6F)
Conclusion
Need to fill these cells with more research items!!
Public PlanetLab
Private PlanetLab (CORE)
Overlay
Research
Wide-Area Distributed
Network Services
SORA (Overlay Routing)
Disruptive Network Services
CDN+DHT
Overlay
Education
Class Projects
Route Visualization
Disruptive Class Projects
OpenProxy
Test-bed
Enhancement
Federation
OneLab Federation
Federation
PLJ(PLA) Federation
Ambitious Enhancement
Xen-Enabled PlanetLab
30