Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
GigaPoP Transport Options: I-WIRE Positioning for the Bandwidth Tsunami Virtual Internet2 Member Meeting Oct 4, 2001 Linda Winkler Argonne National Laboratory [email protected] I-WIRE Background • State Funded Dark Fiber Optical Infrastructure to support Networking and Applications Research UIC NU / Starlight Star Tap ANL IIT UC • $7.5M Total Funding • $4M FY00-01 (in hand) • $2.5M FY02 (approved 1-June-01) • Additional $0.5M in FY03, FY04 • Application Driven NCSA/UIUC • Access Grid: Telepresence & Media • Computational Grids: Internet Computing • Data Grids: Information Analysis • New Technologies Proving Ground • Optical Switching • Dense Wave Division Multiplexing • Advanced middleware infrastructure For more information see www.iwire.org Dark Fiber • Location, location, location • Metro • Roughly $2 per meter per strand • Lateral challenges • Regional • May require regeneration; regen, reshape, retime (3R) is expensive! • Wide area • Expensive due to 3R requirements • Key is location of carrier runs • $100K-$1M/month for 2200 mile OC-192 link Dark Fiber (cont.) • Key is the one time up front cost for the purchase of an IRU • Maintenance and management are the buyers problem • Obtain fiber characteristics as soon as possible (SMF vs. NZDSF, OTDR shots) • Rapid provisioning possible allowing more adaptive networks • The fiber industry is immature and underdeveloped, allowing sophisticated customers to negotiate much more attractive deals than would result from a standard RFP pricing exercise. Indefeasible Right to Use (IRU) Services • Terms 10, 15, 20 yrs • Alternatives • Long term capital lease • Short term lease • Managed service • Considered as a physical asset which can be re-sold, traded or used a collateral. • Cost can be amortized over lifetime which results in a monthly cost substantially below traditional telecommunication services. • Be sure of contract conditions due to shaky nature of some vendors financial situation. Dense Wavelength Division Multiplexing • To ring or not to ring (ring vs. mesh) • Redundancy (at what cost?) • Survivability • Protection • Mesh topology benefits • • • • • Migration, scaling Deployment speed Capacity Utilization Network Restoration Operating Costs • Laser reach-3R issues and OEO • Large portion of the cost • No standards • Number and spacing of lambdas are design variables • One transponder per wavelength • Beware OC-192/10GbE WAN PHY/10GbE LAN PHY are not all equal TeraGrid Backplane StarLight International Optical Peering Point (see www.startap.net) Abilene Chicago St. Louis Indianapolis Urbana Los Angeles San Diego OC-48 (2.5 Gb/s, Abilene) Multiple 10 GbE (Qwest) Multiple 10 GbE (I-WIRE Dark Fiber) • Solid lines in place and/or available by October 2001 • Dashed I-WIRE lines planned for Summer 2002 UIC I-WIRE Starlight / NW Univ Multiple Carrier Hubs ANL Ill Inst of Tech St Louis GigaPoP Univ of Chicago Indianapolis (Abilene NOC) NCSA/UIUC Charlie Catlett – Argonne National Laboratory ([email protected]) TeraGrid Proposed Backplane Architecture One Wilshire (Carrier Fiber Collocation Facility) 455 N. Cityfront Plaza (Qwest Fiber Collocation Facility) 4 x 10 GbE Los Angeles Vendor TBD Long-Haul DWDM (Operated by site) Chicago 2200mi DTF Backbone Core Switch Vendor TBD Metro DWDM (operated by site) 15mi 115mi Vendor POP at JPL Qwest San Diego POP 2mi 140mi 25mi Vendor TBD Metro DWDM 20mi Caltech SDSC Ciena CoreStream™ Long-Haul DWDM (Operated by Qwest) ANL NCSA Vendor TBD Switch/Router* (256 Gb/s crossbar) Site Border Switch Cluster Aggregation Switch Caltech Cluster (64p) SDSC Cluster (250p) NCSA Cluster (2000p) Charlie Catlett – Argonne National Laboratory ([email protected]) ANL Cluster (128p) DTF Local Site Resources and External Network Connections *Initial Phase using IP Switch/Routers. This design will be evaluated beginning October 2001. Phase 2 (optical mesh) will also be evaluated prior to full DTF cluster deployment in early 2002.. Wavelength Services • OC48, OC192 vs. 10GbE • Be sure of handoff specifications • Management- determine level required • Qwest/Teleglobe/(3)Link Global/Global Crossing service offerings • Benefits • • • • • • • Lower cost Customer responsible for protection Share cost of electronics-save capital investment Customer empowerment Potential for higher utilization of network Transparency of signal Flexibility IP Routers and Switches • Interoperability • Which PHY (LAN vs. WAN) interface between DWDM and CPE? • $$$ • WAN PHYs tend to be pricey • Is 10GbE really 10,000 Mb/s, or 9.3 Gb/s, or maybe 8 Gb/s? • What is the largest individual stream you must support? • Aggregates vs. large streams • Currently no visibility into the optical layer Next Steps: Optical Mux / Wavelength Router / Optical Wavelength Cross-connect System 2.5 / 10 / 40 Gb/s GigE / 2.5 Gb/s 10 Gb/s OTU l1 DWDM Optical Mux/ l-Router/ Cross-Connect Customer Interface ln OTU FDP lx Optical Switches • Current tech is O-E-O • • • • • Incoming signals are converted from Optical to Electrical Signal is switched electrically Outgoing signals are converted back to optical Up to 64x64 at 2.5 Gb/s Smart but slow • Future tech will be O-O-O • • • • • • Operate in the all optical domain Bit rate independent A win at 40 Gb/s Below 10 Gb/s electronic switching will be hard to beat Challenge will be in management Fast but dumb Optical Internetworking Progress • Optical Internetworking Forum (OIF) • UNI 1.0 specification in progress • Based on domain services model • Internet Engineering Task Force (IETF) • Generalized Multiprotocol Label Switching (GMPLS) • Incorporates Domain and Peer Models • OIF and IETF are in sync • OIF UNI 1.0 based on GMPLS • Start with Domain Model and evolve • Stay tuned. The ending of this story has not yet been written. Wavelengths and the Future • Wavelength services are causing a network revolution: • Core long distance SONET Rings will be replaced by meshed networks using wavelength cross-connects • Re-invention of pre-SONET network architecture • Improved transport infrastructure will exist for IP/packet services • Electrical/Optical grooming switches will emerge at edges • Automated Restoration (algorithm/GMPLS driven) becomes technically feasible. • Operational implementation will take beyond 2003 StarLight Optical Peering Point & Co-lo Facility • 710 N. Lake Shore Dr. Chicago, IL • Northwestern Campus • Central downtown location • Near carrier services serving Chicago loop • Telephone switch room • Colo space available • Multiple carriers access • Ameritech, AT&T, Qwest, Global Crossing, Global Crossing, MCI Worldcom • Other builds possible