Download This is a Grid

MCNC Grid Computing and
Networking Services (GCNS)
StateNets 2005
North Carolina Statewide Grid
John Killebrew
Director - NCREN
Our Foundation for Grid: NCREN
Internet
Internet 4-7 MCNC-owned Clusters
2
distributed throughout the state
NLR Locations still under evaluation
Cisco
Interne
t
Existing: Blend of owned and leased fiber and circuits moving
toward resilient rings powered by Cisco routers
Planned: Strong focus on owned and leased fiber, Lambda, and
few circuits, in resilient rings powered by Cisco routers and Wave
Division Multiplexers
EPA
The Grid
The next IT Infrastructure of North Carolina
• Proving ground for Grid
• Successful prototype apps
• Catalyst for collaboration
• International recognition
NC BioGrid
2002
2003
2004
2005
The Grid
The next IT Infrastructure of North Carolina
• Cluster and SMP resources
• Research platform for GTEC
• Core component in NCGrid
• Revenue generation
MCNC Enterprise Grid
NC BioGrid
2002
2003
2004
2005
The Grid
The next IT Infrastructure of North Carolina
• State-wide partnership
• Leverage lessons learned
• Grid education & training resource
• Enable first mover applications
NC Grid Initiative
MCNC Enterprise Grid
NC BioGrid
2002
2003
2004
2005
MCNC &
The Grid Infrastructure
for North Carolina
NC Statewide Grid Initiative
MCNC Enterprise Grid
MCNC
NC BioGrid
NCREN
North Carolina Research & Education Network
Microelectronics Center of North Carolina
- Founded in 1980
- Independent, private, non-profit organization
- Operates NCREN since 1984
- Past: Supercomputer Center for universities
- Now: Grid Service Provider, offering Video,
Network, Grid, and Datacenter Services
- 50+ employees
MCNC-GCNS Roadmap
Grid Service Provider
Easy Access
Awareness Creation
Our Vision :
The Three Waves of Grid Computing
The Research Wave
Technology, Prototypes
Virtual Organizations
Standards
GGF, IETF, OASIS
GCNS: “Awareness Creation”
The Industry Wave
Grid-Enabled Products
Enterprise Solutions
Interoperability
GGF, EGA, IETF, OASIS
GCNS: “Easy Access”
Commodity
IT Utility
Integration
Legal, Ethical, Political Orgs
GCNS: “Grid Service Provider”
The Consumer Wave
GCNS UNIVERSE
Universities UNC-OP
RENCI
Internet2
DukeNet
SURA
Services and Relationships
NLR
General
Assembly
MCNC
GCNS
ERCWC
SERNet
e-NC
RTI RDI
ITS
WinstonNet
Industry
Time Machines
The Innovation Engine
Thank You !
[email protected]
http://www.mcnc.org
Duke (GbE)
NCREN
NCSU (GbE)
NCCU
RTP
Raleigh
7609
7609
Level3 (GbE)
Qwest Internet (Oc12 PoS)
Abilene (Internet2 OC48 PoS)
Greenville
Greensboro
UNC-CH (GbE)
ECU
ECSU
CMST
UNC-G
NCAT
ASU
Winston-Salem
OC48 SRP Ring
counter-rotating ring
<=50ms reroute
Fully active redundancy
WFU
WSSU
NCSA
Fayetteville
FSU
UNCP
OC12 SRP Ring
Hickory
counter-rotating ring
<=50ms reroute
Fully active redundancy
UNC-C
Charlotte
Wilmington
UNCW
Asheville
UNCA
WCU
ERC
OC12 SRP Ring
counter-rotating ring
<=50ms reroute
Fully active redundancy
Qwest (OC12 PoS)
Level3 (GbE)
Greenville
This is a Grid !
An IT Utility
A Grid Middleware (the glue)
And Networked Distributed
Resources
Grid Technology Evaluation Center
The Epicenter for Accelerating Grid Adoption
Influential Network
of Key-Players
From Innovation
to Deployment
Socio-Economical
Mission
Joint BizDev, PR
& Marketing
Independent Lab:
Eval & Testing
Grid Training
& Education
Customer Briefing
Center
So, are there really any working Grids out there?
• Yes!….
In North Carolina even…
+ Wachovia
+ NC BioGrid
+ SCOOP
+ EPA
NC BioGrid
One of the nation’s first grid test beds for computing, data
storage and networking resources for life sciences research
Established to research and implement new grid computing technologies
that will enable researchers and educators throughout North Carolina
to take full advantage of the genomic revolution
•
Installed
in Summer 2002, heterogeneous
.
hardware and OS platforms
•
More than 80 organizations
•
Dedicated systems for testing grid
middleware and developing grid
applications for bioinformatics
•
Spans multiple administrative domains
with systems located at MCNC, NC State,
UNC-CH & Duke
•
Established a Certificate Authority
SURA SCOOP South-eastern
Coastal Ocean Observing Program
The Challenge:
- More than half of the nation's tidal shores home to 80 million people
- coastal zone is undergoing environmental and ecological changes
- threaten the sustainability of the region's economies and marine resources
The Solution:
- develop a Grid of sensors and linked computers
- fully integrating several observing systems in the southern region
- provide data, in real-time and at high speed, for more reliable, accurate and timely information
To help guide effective coastal stewardship, plan for extreme events,
facilitate safe maritime operations, and support coastal military security.
•
And, how about other states?
•
Grid Development efforts announced in
• Colorado
• West Virginia
• Louisiana
• Texas
• Virginia
Plus….the following are also working….
Access Grid
for Education and Training
•
Builds on our proven and advanced video
infrastructure
•
Utilizes Multicast Backbone
•
Real time, continuous presence audio, video,
data
•
Purpose-built sites encourage natural, seamless
interaction
–
•
Desktop implementation available
H.323
Multi-Platform: including Win X, Linux/Unix
–
Mac OS X support coming soon
H.320
Voice & Video Over IP (V2oIP), Ubiquitous
352 x 288 @ 128 kbps - 2 Mbps, Multipoint
capable
Multipoint via third-party
MPEG-2
720 x 480 @ 5.5 Mbps NCREN Video Network
supports multipoint
Earth System Grid
Goal: address
technical
obstacles to the
sharing &
analysis of
high-volume
data from
advanced earth
system models
Network for Earthquake Eng. Simulation
Remote Users
(Faculty,
Students,
Practitioners)
Instrumented
Structures
and Sites
Simulation
Tools
Repository
Laboratory
Equipment
Field Equipment
Curated Data
Repository
Leading Edge
Computation
Global
Connections
Remote Users:
www.neesgrid.org
Laboratory Equipment
(K-12 Faculty and
Students)
Butterfly.net:
Enterprise Optimization
•
•
•
•
•
•
A scalable, resilient infrastructure for
creating & running massive
multiplayer games
Developers avoid upfront costs
Improved end-user experience
Demonstrated 8x increase in
profitability over centralized model
Dynamic provisioning & on demand
capacity
Uses Globus Toolkit & runs on IBM
Global Services hosting environment
•
Metropolitan Grid across the Universities
•
Stable, well-managed HPC resources
•
Supporting multi-disiplinary research
• And
local industries (e.g. Rolls Royce)
Slides: Courtesy James Coomer
Grid Collaboration MCNC - Universities
1+1=3
Common
Interests
Grid Computing
Higher Education
Economic Development
Thought Leadership
Universities
Top Research
Education
Vertical Applications
Middleware
MCNC
Deployment
Infrastructure
Horizontal
Complementary Focus
GCNS Enterprise Grid
Avaki
Data
Grid
Global Grid
Resource DB
(GIIS)
Users
Campus Grids
Data Grid Access Servers
(8 total, i.e. 1 per 8 nodes)
Grid Gatekeeper / Interactive Nodes
LSF Master Job Scheduler
32-CPU SGI Altix
Linux SMP Server
128-CPU IBM Linux
Cluster (64 nodes)
8-TB Storage
Network, Grid and Data Center Services
GTEC, NLR, ANR and other Innovation Initiatives
DEPLOYMENT
Self-serve
Data Center
Services
Value-add
Information
Systems
Services
Hosting & Infrastructure
Enterprise
Grid
Services
State-wide
Grid
Services
Grid Computing
DATA CENTER
NCREN
Data
Archival
Services
Information
Security
Services
Information Assurance
Co-location Services
•
GCNS supplies server cabinets
–
–
–
–
–
•
19” EIA, 42-RU, 4-post APC-brand enclosures
Perforated, lockable doors
84” high x 24” wide x 40” deep
Additional APC cabinet accessories available
$1,200 per cabinet one-time setup fee
Base monthly rate of $500* per cabinet
–
–
–
–
–
Includes two 20-Amp, 110-VAC power circuits
One 100-Mbps network uplink
Four public IP addresses
30-day average network utilization of up to 0.5-Mbps
• Additional network utilization options are available
*20% discount available for educational customers
Data Mirroring and Archival
Virtual Filers
Customer 1
Grid
Users
Data
Grid
Interface
Customer 2
Linux
Servers
NetApp
SnapVault
NCREN
Customer 3
NetApp
Servers
NetApp
SnapMirror
Customer 4
NetApp
Servers
NetApp
SnapMirror
Network Appliance
R200 Nearstore Filer
8-TB initially
(scales up to 96-TB)
GTEC Projects Driving Grid Adoption
MCNC Grid SP
Grid ColLab
Kids Grids
Gaming Grid
School Grids
Grid-Info Grid
Download-The-Grid
AAAA Project
Grid Training Courses
Startup Grid
Grid Appliance
Grid Portal
GGF & EGA
NC Statewide Grid
MCNC Enterprise Grid
NC BioGrid
MCNC Supercomputing
2000
20004
2008
What is a Grid ?
I don’t know, but…
“Context, Not Products, Defines Grid
Computing”
Gartner, 2004
“Resource sharing & coordinated problem solving in
dynamic, multi-institutional virtual organizations”
Ian Foster & Carl Kesselman, 2002