Download RSpecs Engineering Meeting

CC-NIE workshop :
Campus Infrastructure
GENI racks
Heidi Picher Dempsey
January 7, 2013
www.geni.net
Sponsored by the National Science Foundation
January 7, 2013
1
Outline
• GENI Racks and Connections
• Campus Requirements
• GENI Rack Installation and Support
Sponsored by the National Science Foundation
January 7, 2013
2
GENI Racks and Connections
• Racks provide reservable,
sliceable compute and
network resources using
Aggregate Managers (AM).
• Comply with GENI AM API
• Support GENI RSpec v3
• Support federation with
existing Slice Authorities
(GENI Project Office (GPO),
ProtoGENI (University of
Utah), and PlanetLab
Central (Princeton
University) for access now
Sponsored by the National Science Foundation
January 7, 2013
3
Racks and Connections (cont.)
• Racks are GENI Aggregates
• GENI MetaOperations (Indiana
University) provides support,
monitoring and escalation
• Internet2 and NLR provide core
data plane resources that
experimenters can control
• Regionals provide more network
resources that experimenters can
control (CENIC, GpENI, KanREN,
MOXI, MAX, NYSERNET, SOX,
UEN)
• GENI network resources
interconnect and coexist with with
other research networks (e.g.
StarLight)
Sponsored by the National Science Foundation
GMOC
Identity
Provider
GENI Clearinghouse
Experimenter
Tools
January 7, 2013
Aggregates*
* Includes GENI racks
and (if desired)
designated campus
resources
4
Core Connections: Layer 2 Now
GENI
AL2S
GENI PG
GENI PG
GENI PG
GENI
AL2S
GENI PG
GENI PG
GENI
AL2S
Peering
NLR
(5-8 nodes)
GENI PG
GENI
AL2S
•
•
•
Multiple 1G and 10G connections with VLANs connecting experimenter nodes
Campus access to Internet2 via ION/DYNES or direct connection (existing or AL2S)
Campus access to NLR via FrameNet or direct connection
I2 map with GPO edits
Sponsored by the National Science Foundation
January 7, 2013
5
Core Connections: Internet 2 AL2S
Sponsored by the National Science Foundation
January 7, 2013
6
Core Connections Coming Soon
(starting 2013)
• Full GENI implementation on AL2S
• Peering with multiple SDN networks possible (e.g. NLR, Southeast
Network Access Point)
• Campus access via stitching or direct connection to AL2S (see CCNIE architecture slides)
• Support experimenter control of nodes or access to AL2S production
services
Sponsored by the National Science Foundation
January 7, 2013
7
GENI Rack Campus Requirements
• Provide space, power, security (as with other campus IT
resources)
• Provide at least 1Gbps OpenFlow/SDN path from rack to
campus boundary
• Connect campus resources to GENI rack for
faculty/experimenter use
• Operate with up-to-date GENI-specified software (e.g. AM
API, OpenStack)
• Provide no-cost access to rack resources for GENI
authorized users at other campuses
• Provide points of contact for GENI response team (see
http://groups.geni.net/geni/attachment/wiki/Comprehensiv
eSecurityPgm/Aggregate Provider Agreement v3.pdf )
Sponsored by the National Science Foundation
January 7, 2013
8
Installation and Support:
GENI Rack Teams
•
•
•
•
InstaGENI: University of Utah (software and engineering), partnered with HP Labs
(commercial hardware/firmware), Northwestern University (deployment coordination
and engineering) and Princeton (PlanetLab integration).
ExoGENI: RENCI and Duke (software and engineering), IBM (commercial
hardware/firmware and on-site installation)
GENI also provides OpenFlow developer support for both teams via Open Network
Labs
All teams support open source development and share via their project and GENI
wikis and repositories
Sponsored by the National Science Foundation
January 7, 2013
9
GENI Rack Installation and Support Flow
Sponsored by the National Science Foundation
January 7, 2013
10
Support: GPO Testing
• Acceptance Tests for experimenter, administrator, and monitoring
functions still underway
– ExoGENI experimenter functions good, shared monitoring and administration in
progress
– InstaGENI network and administration tests delayed by delivery logistics,
monitoring just added
• Confirmation Tests for each installation
• Interoperability testing for GENI AM API and RSPECs with Omni
command-line tool releases
• Latest Status
http://groups.geni.net/geni/wiki/GENIRacksHome/ExogeniRacks/Accept
anceTestStatus
http://groups.geni.net/geni/wiki/GENIRacksHome/InstageniRacks/Acce
ptanceTestStatus
http://groups.geni.net/geni/wiki/GENIRacksHome/ExogeniRacks/Confir
mationTestStatus
http://groups.geni.net/geni/wiki/GENIRacksHome/InstageniRacks/Confi
Sponsored by the National Science Foundation
January 7, 2013
11
Support: Access and Usage Policies
• GENI Slice Authorities currently used for control plane
access to GENI rack, clearinghouse in progress -- more on
this in Marshall’s talk
• Campus sets policies for GENI rack connections to
campus data plane before installation
• Rack teams, GPO and campus staff configure security
policy control points for data plane during installation and
test (e.g. in campus, GENI rack and Science DMZ
switches/routers)
• Campus staff uses FOAM (with or without automated
approval) for per-service operations control of GENI rack
OpenFlow connections to campus data plane (no admin
needed for others).
Sponsored by the National Science Foundation
January 7, 2013
12
GENI Rack Campuses
Funds
in hand
Needs
funding
Oct. 24, 2012
• 43 racks planned this year
• Track on GENI wiki
Sponsored by the National Science Foundation
January 7, 2013
13
GENI Rack Spiral 5 Installations
• 43 GENI-sponsored racks with integrated
OpenFlow, compute nodes, and some support for
dynamic VLANS deploying this year
• More campuses adding racks independently (e.g.
CC-NIE, commercial projects)
• Software updates expected for each rack, will
retest to verify
• Schedules subject to change based on campus
readiness – looking for early adopter interest
from this workshop
Sponsored by the National Science Foundation
January 7, 2013
14
ExoGENI Draft Deployments
DRAFT ONLY
Subject to Change
Location
Florida
International
University
University of
Houston
University of
California, Davis
Columbia
University
StarLight/
Northwestern
University
Open Science
Facility
University of
Massachusetts,
Amherst
University of
Florida
Wayne State
University
Texas A&M
University
University of
Alaska, Fairbanks
Sponsored by the National Science Foundation
City
Arrival
State Month
Miami
FL
Jan-13 FLR/SOX
Houston
TX
Jan-13 LEARN
Davis
CA
Feb-13 COTN (CENIC)
New York
NY
Feb-13 NYSERNet
Chicago
IL
May-13 MREN
Berkley
CA
May-13 COTN (CENIC)
Amherst
MA
NOX and Amherst area
Aug-13 network
Gainsville
New
Brunswick
College
Station
FL
Aug-13 SOX
NJ
Nov-13 MREN
TX
Nov-13 LEARN
Fairbanks
AK
Feb-14 Pacific Northwest Gigapop
January 7, 2013
Regional Net
15
InstaGENI Draft Deployments
Location
City
State Arrival Month Regional Net
Northwestern
University
Chicago
IL
Jan-13 MREN
Clemson University Clemson
SC
Feb-13 SOX
Georgia Institute of
Technology
Atlanta
GA
Feb-13 SOX
Princeton
University
(temporary)
Princeton
NJ
Feb-13 MAGPI
New York
University
New York
NY
Mar-13 NYSERNET
Lawrence
KS
Mar-13 KanREN
Carnegie Mellon
University
Pittsburgh
PA
Apr-13 3ROX
Rutgers
New
Brunswick
NJ
Apr-13 MAGPI
Southern
Crossroads (SOX)
Atlanta
GA
Apr-13 SOX
Stanford University Stanford
CA
May-13 CENIC
University of
California, Berkley Berkley
CA
May-13 CENIC
University of
Maryland College
Park
College Park
Corporation for
Education Network
Initiatives in
California (CENIC) La Mirada
MD
CA
May-13 MAX
City
State
New York State
Education and
Research Network
(NYSERNet)
Syracuse
NY
Jul-13 NYSERNet
University of IllinoisUrbana
Champaign
IL
Jul-13 MREN
University of Southern
California
Los Angeles
CA
Jul-13 CENIC
Cornell University
NY
Aug-13 NYSERNET
University of Missouri Kansas City
MO
Aug-13 GPN
University of
Wisconsin
WI
Aug-13 WiscNet
Case Western Reserve
University
Cleveland
OH
Sep-13 OARnet
Indiana University
IN
Sep-13 I2
University of Chicago Chicago
IL
Sep-13 MREN
Midwest OpenFlow
Crossroads Initiative
(MOXI)
Bloomington
IN
Oct-13 MOXI
Naval Postgraduate
School
Monterey
CA
Oct-13 DREN
University of Michigan Ann Arbor
MI
Oct-13 MOXI
Ohio State University Columbus
OH
Nov-13 OARnet
University of Colorado
at Boulder
Boulder
CO
Front Range
Nov-13 GigaPoP
University of Hawaii
Honolulu
HI
Nov-13 PNWGigaPOP
University of Kentucky Lexington
KY
Nov-13
University of
Missouri-Columbia
MO
Nov-13 GPN
Ithaca
Madison
Bloomington
Arrival Month
Regional Net
Jun-13 CENIC
University of
California, San
Diego
San Diego
CA
Jun-13 CENIC
University of
Washington
Seattle
WA
Jun-13 PNWGigaPOP
Sponsored by the National Science Foundation
January 7, 2013
Columbia
DRAFT ONLY
Subject to Change
University of
Kansas
Location
16
Current Support
•
Help for campuses and experimenters
– GMOC helpdesk (call, ticket, or email 24x7x365)
http://gmoc.grnoc.iu.edu/gmoc/index/support.html
– [email protected] mailing list
– IRC/chat (informal)
http://groups.geni.net/geni/wiki/HowTo/ConnectToGENIChatRoom
•
GMOC support for racks and OpenFlow campus infrastructure
– Monitoring and status for GENI sites and racks
http://gmoc-db.grnoc.iu.edu
https://gmoc-db.grnoc.iu.edu/protected/
–
–
–
–
requires admin password
Scheduled/unscheduled outage reporting and calendars
Emergency Stop
Escalation, tracking, some troubleshooting for reported problems
Draft workflows
• Security related support (Legal, Law Enforcement and Regulatory Reps)
http://groups.geni.net/geni/attachment/wiki/ComprehensiveSecurityPgm/LLR
Responsibilities of GENI.pdf
Sponsored by the National Science Foundation
January 7, 2013
17
Current GENI Monitoring Examples
Virtual Machines on Racks
FOAM aggregates
Sponsored by the National Science Foundation
Slivers on Racks
January 7, 2013
* Open Source monitoring client available in
Python
* Updated monitoring software running on
all racks, backbones, and most OpenFlow
aggregates
* Monitoring uses URNs for resource names
for better interoperabilty
* Format for InstaGENI and ExoGENI
reported data is similar
18
Current Vendor Experience Examples
Features
HP 5406 (v2)
NEC PF5820
IBM G8264
IP src/dst
match in
hardware for
IP ethertype
VLAN ID
matching in
hardware
Yes (MAC
address must
not be
specified) [1]
Hybrid: N/A,
Aggregation:
Yes (if no
other L2-L4
match fields
set) [1]
Yes (if no L3L4 matches
set) [1]
Yes (in
software) [1]
Yes (in
software) [1]
Yes (VLANbased) [1]
Yes
Yes [3]
Yes
Yes [3]
Yes
Matching all
non-IP
ethertypes
MAC address
rewrite
IP address
rewrite
Hybrid mode
support
Per-packet
and per-byte
Flow stats
All Port stats
Only perpacket for
hardware
flows
At least some
supported
Slice ARP by
IP
Yes (in
software) [1]
Wildcarded
match fields
in hardware
Set VLAN ID
Yes (see [1]
for details)
Strip VLAN
Rewrite
TCP/UDP
port
Respects
flow
Sponsored
priorities
Hybrid: No,
Aggregation:
Yes (in
software) [1]
No [1]
Yes (in
software) [1]
No
by the
Brocade
MLXe
Yes (in layer3
mode), No (in
layer2 mode)
[2]
Yes [2]
Brocade CES
2024
No [2]
Yes [3]
Yes (in layer2
mode) [2]
Yes [2]
Yes
Yes
Yes [2]
No [2]
No
No
No (portbased may be
planned)
Yes
No (portbased
planned)
Yes
No listed
support [3]
No (portbased
planned) [2]
Yes (specific
linecards) [2]
No listed
support [3]
No (portbased
planned) [2]
No (perpacket only)
[2]
At least some
supported
At least some
supported
Yes [2]
No (can
match nw src,
not nw dst)
Yes
No (can
match nw src,
not nw dst)
Yes
No
No (some
supported,
see [2])
No
Yes
Yes
Yes [2]
Yes
Yes
Yes [2]
Yes [2]
Yes
No
yes
No
Yes [2]
No listed
support [2]
Yes [2]
No listed
support [2]
Vendor says
yes, currently
untested
Vendor says
yes, currently
January
untested
Vendor says
Vendor says
yes, some
yes, some
Nationalcorner
Science
cases Foundation
corner cases
• Vendors often
don’t implement
full OpenFlow
spec
• Hybrid mode
support varies
significantly
• The Quilt RFP for
SDN vendors
http://www.thequilt.net/index.p
hp/quilt-news/231-quiltannounces-openflow-switchauthorized-quilt-providers
7, 2013
19