Download Lambdas - Calit2

Bringing Mexico
Into the Global LambdaGrid
Calit2 Workshop
February 2, 2006
Dr. Larry Smarr
Director, California Institute for Telecommunications and
Information Technology
Harry E. Gruber Professor,
Dept. of Computer Science and Engineering
Jacobs School of Engineering, UCSD
Developing International Research Collaborations:
Mexico
•
•
•
•
•
•
UCSD Meeting on Joint CICESE/Calit2 Proposal Sept 2002
SDSU’s Eric Frost Talk at CUDI Meeting at CICESE April 2003
Arzberger PRAGMA talk-CUDI in Puebla, Mexico October 2003
Visit by CICESE and CONACYT to Calit2 Jan 2004
Visit by Calit2 and OptIPuter to CICESE March 2004
Visit by CICESE and CONACYT to Calit2 AHM April 2004
Jaime Parada, Felipe Rubio, & Carlos Duarte
at the Calit2 All Hands Meeting
Two New Calit2 Buildings Will Provide
Major New Laboratories to Their Campuses
•
New Laboratory Facilities
– Nanotech, BioMEMS, Chips, Radio, Photonics,
Grid, Data, Applications
– Virtual Reality, Digital Cinema, HDTV, Synthesis
•
Over 1000 Researchers in Two Buildings
– Linked via Dedicated Optical Networks
– International Conferences and Testbeds
UCOct.
San
Richard C. Atkinson Hall Dedication
28,Diego
2005
UC Irvine
www.calit2.net
Preparing for an World in Which
Distance Has Been Eliminated…
The Calit2@UCSD Building is Designed for Prototyping
Extremely High Bandwidth Applications
1.8 Million Feet of Cat6 Ethernet Cabling
24 Fiber
Pairs
to Each
Lab
UCSD is Only
UC Campus with
10G
CENIC
Connection for
~30,000 Users
Photo: Tim Beach,
Calit2
Over 10,000
Individual
1 Gbps
Drops in the
Building
~10G per Person
150 Fiber Strands to Building;
Experimental Roof Radio Antenna Farm
Ubiquitous WiFi
Challenge: Average Throughput of NASA Data Products
to End User is < 50 Mbps
Tested
October 2005
Internet2 Backbone is 10,000 Mbps!
Throughput is < 0.5% to End User
http://ensight.eos.nasa.gov/Missions/icesat/index.shtml
Dedicated Optical Channels Makes
High Performance Cyberinfrastructure Possible
(WDM)
10 Gbps per User ~ 200x
Shared Internet Throughput
c* f
Source: Steve Wallach, Chiaro Networks
“Lambdas”
Parallel Lambdas are Driving Optical Networking
The Way Parallel Processors Drove 1990s Computing
National Lambda Rail (NLR) and TeraGrid Provides
Cyberinfrastructure Backbone for U.S. Researchers
NSF’s TeraGrid Has 4 x 10Gb
Lambda Backbone
Seattle
International
Collaborators
Portland
Boise
Ogden/
Salt Lake City
UC-TeraGrid
UIC/NW-Starlight
Cleveland
Chicago
New York City
Denver
San Francisco
Pittsburgh
Washington, DC
Kansas City
Los Angeles
Albuquerque
Raleigh
Tulsa
Atlanta
San Diego
Phoenix
Dallas
Links Two Dozen
State and
Regional Optical
Networks
Baton Rouge
Las Cruces /
El Paso
Jacksonville
Pensacola
San Antonio
Houston
NLR 4 x 10Gb Lambdas Initially
Capable of 40 x 10Gb wavelengths at Buildout
DOE, NSF,
& NASA
Using NLR
CUDI-CENIC Fiber Dedication at
Border Governor’s Conference, July 14, 2005
US
Mexico
Torreon Conference---Fiber Dedication Linking
Mexico and US, crossing at San Diego-Tijuana
• Shared Security
Prof. Smarr
• Energy
Osaka
Arnold
Prof. Aoyama
• Trans-National Crime
• Education and Research
• Business Development
http://www.cudi.edu.mx/
Culmination of Three Years
of Work Between Calit2,
CICESE, CENIC, and CUDI
CICESE, CONACYT, CUDI, and Telmex
at iGrid2005
September 26-29, 2005
Expanding the OptIPuter LambdaGrid
AIST (Japan)
KISTI (Korea
StarLight
Chicago
UIC EVL
PNWGP
Seattle
U Amsterdam
SARA
NU
NetherLight
Amsterdam
CAVEwave/NLR
1 GE Lambda
10 GE Lambda
NASA
Ames
NASA Goddard
NASA
JPL
ISI
UCI
2
NLR
NLR
2
2
CENIC
Los Angeles
GigaPOP
UCSD
SDSU
CalREN-XD
8
CICESE
CENIC/Abilene
Shared Network
8
CENIC
San Diego
GigaPOP
via CUDI
The Global Lambda Integrated Facility-Countries are Aggressively Creating Gigabit Services
www.glif.is
Created in Reykjavik,
Iceland 2003
www.glif.is
Visualization courtesy of
Bob Patterson, NCSA.
We are Very Close to Setting Up
a Gigabit Lambda Between Calit2 and CICESE
Source: Raúl Hazas, CICESE
Goal—Upgrade Access Grid
to HD Streams Over IP on Dedicated Lambdas
Access Grid Talk
with 35 Locations
on 5 Continents—
SC Global Keynote
Supercomputing 04
OptIPuter Scalable Adaptive Graphics Environment
(SAGE) Allows Integration of HD Streams
SAGE Developed
Under
Jason Leigh, EVL
• Live Streaming
Video of the RTS2000 Microscope
•HD Video from
Remote BIRN Site
• Macro View of
Montage Data
• Micro View of
Montage Data
•HD Video from
the RTS
Microscope Room
Source: David Lee,
NCMIR, UCSD
The OptIPuter Enabled Collaboratory:
Remote Researchers Jointly Exploring Complex Data
UCI
OptIPuter will Connect
The Calit2@UCI
200M-Pixel Wall to
the 100M-Pixel Display
at Calit2@UCSD
With Shared Fast Deep Storage
“SunScreen” Run by Sun Opteron Cluster
UCSD
Combining Telepresence with Remote Interactive
Analysis of Earth Sciences Data Over NLR
Live Demonstration
of 21st Century
National-Scale
Team Science
August 8, 2005
OptIPuter
Visualized Data
HDTV Over
Lambda
Scripps Institution of Oceanography,
UCSD, La Jolla, CA
Goddard Space Flight Center,
Maryland
First Trans-Pacific Super High Definition Telepresence
Meeting in New Calit2 Digital Cinema Auditorium
Lays
Technical
Basis for
Global
Digital
Keio University
President Anzai Cinema
UCSD
Chancellor Fox
Sony
NTT
SGI
The Sargasso Sea Experiment
The Power of Environmental Metagenomics
•
•
•
•
MODIS-Aqua satellite image of
ocean chlorophyll in the Sargasso
Sea grid about the BATS site from
22 February 2003
Yielded a Total of Over 1 billion Base Pairs
of Non-Redundant Sequence
Displayed the Gene Content, Diversity, &
Relative Abundance of the Organisms
Sequences from at Least 1800 Genomic
Species, including 148 Previously Unknown
Identified over 1.2 Million Unknown Genes
J. Craig Venter,
et al.
Science
2 April 2004:
Vol. 304.
pp. 66 - 74
Marine Genome Sequencing Project
Measuring the Genetic Diversity of Ocean Microbes
CAMERA will include
All Sorcerer II Metagenomic Data
Calit2’s Direct Access Core Architecture
Will Create Next Generation Metagenomics Server
Sargasso Sea Data
Moore Marine
Microbial Project
NASA Goddard
Satellite Data
Community Microbial
Metagenomics Data
DataBase
Farm
Flat File
Server
Farm
10 GigE
Fabric
Request
+ Web Services
JGI Community
Sequencing Project
W E B PORTAL
Sorcerer II Expedition
(GOS)
Traditional
User
Dedicated
Compute Farm
(100s of CPUs)
Response
Direct
Access
Lambda
Cnxns
Local
Environment
Web
(other service)
Local
Cluster
TeraGrid: Cyberinfrastructure Backplane
(scheduled activities, e.g. all by all comparison)
(10000s of CPUs)
Source: Phil Papadopoulos, SDSC, Calit2