Download Mr. Cathcart`s Presentation - Silicon Valley World Internet Center

Grid Computing:
IBM's Vision for the
Next Generation Data Center
Technology Team UpdateEnabled by Commercial Grids
May 2003
Mark Cathcart, IBM Distinguished Engineer
On Demand Architecture and Design
http://ibm.com/servers/corner
© 2002 IBM Corporation
What Do You Need To Become an On Demand Business?
 Responsive
 Variable
 Focused
 Resilient
 Flexible
 Variable
 Managed
 Optimized
Computing
Environment
 Open
 Integrated
 Virtualized
 Autonomic
On Demand Business
Requires an On Demand Operating Environment
Business Transformation
Reduce costs and increase
business responsiveness
through IT and business linkage
Create business flexibility
by integrating disparate,
unconnected business
and IT processes
Improve working capital
and asset utilization
On Demand Operating Environment
IBM On Demand Operating Environment Delivers
Unique Value
Flexible, dynamic
business processes
Assets used
efficiently based
on business
requirements
Business policies drive
IT resource allocation
Resources allocated
and managed
dynamically without
intervention
On Demand Operating Environment
Open Standards-based
Integration of People – Business Process – Information
Anywhere, any time, from any device
Collaboration
Transactional
Processes
Information
Management
Application Development, Deployment & Maintenance
Business
Objectives
and
Policies
Systems and Policy Management
Security
Availability
Provisioning
Optimization
Pools of Virtual Resources
Servers
Storage
Distributed Systems
On Demand Operating Environment
Integration of People – Process – Information
Anywhere, any time, from any device
Collaboration
Transactional
Processes
Information
Management
Application Development, Deployment & Maintenance
On Demand Operating Environment
Integration of People – Process – Information
Anywhere, any time, from any device
Collaboration
Transactional
Processes
Information
Management
Application Development, Deployment & Maintenance
Policy-based Orchestration
Availability
Security
Optimization
Provisioning
On Demand Operating Environment
Integration of People – Process – Information
Anywhere, any time, from any device
Collaboration
Transactional
Processes
Information
Management
Application Development, Deployment & Maintenance
Policy-based Orchestration
Availability
Security
Optimization
Provisioning
Virtualization Engine
Servers
Storage
Distributed
Systems
Network
Delivering
Operating
Environment
Based
on an the
evolving
set of components
that simplify
development, deployment and maintenance
Based on open
standards




XML
Web services
J2EE
Open Grid Services
Architecture
 Common Information
Model
Shared components
 Integrated system
console
 Security and identity
 Choreography
 Transaction coordination
 Data persistence
 Workload management
 Collaboration
 Application connectivity
 Configuration tool
e-business on demand Offerings
Simple and easy approach to acquiring capabilities
 Based on experience from customer
engagements
 Built around simple, incremental, modular
roadmaps
 Exploits capabilities from across IBM
 Enables the IBM and Business Partner channels
to capitalize on opportunities
Incorporating key technology initiatives…
Virtualization based on Grid Computing capabilities incorporating
Policy-Based Dynamic Provisioning
Open Standards
Linux
XML
OGSA
Autonomic Capabilities
Self-protecting
Self-optimizing
Self-healing
Self-configuring
WSDL
SOAP
e-business on demand Operating Environment
Application Environment
An integrated platform, based on open standards, to enable rapid
deployment and integration of business applications and
processes
Systems Environment
An environment that allows true virtualization and automation of
the infrastructure and enables delivery of IT capability and service
level on demand
“…with a sophisticated on demand Operating
Environment that is…”
Open
Integrated
…approachable, adaptive, integrated
and reliable infrastructure
delivering on demand services for
on demand business operations …
Virtualized
Autonomic
The Problem: IT in Vertical Fragments
Software:
Monolithic
ERP
Finance
CRM
SAP
PeopleSoft
Siebel
Processors:
Single purpose
IBM
HP
Dell
Sun
Storage:
Isolated
Hitachi
EMC
NetApp
Network:
Fragmented
LAN
WAN
Internet
Virtualized
I/O
Storage
Operating System
Data
Processing
Applications
Middleware
“Distributed Computing Over a Network,
Using Heterogeneous Resources and
Enabled by Open Standards”
A full range of delivery models to bring e-business on
demand utility offerings to clients…
‘Internal’ Utility
A client operated IT
utility using dedicated,
client owned assets
Client Benefits
• Control
• Dedicated resources
Private Utility
A client specific utility
using dedicated
assets, but
construction and
management of these
services is provided
by an external
provider
Client Benefits
• Control
• Dedicated resources
• Assisted management
Hybrid Utility
A mixture of client
specific utility services
using dedicated
resources, and shared
use of some public
utility services with
other subscribers
Client Benefits
• Control for key functions
• Dedicated resources for some
assets
• Progressively enter public
arena as services mature
Public Utility
A set of IT utility
services shared across
multiple subscribers
Client Benefits
• Full provisioning of IT in a
utility mode, giving a
comprehensive usage and
cost profile
• Cost efficiencies
• Shared risk
Operating Environment Pain Points
 Insufficient Performance
Hardware and systems are quickly outdated
Difficult to manage systems to an end-to-end QOS
 Unable to adapt to change in demand
Not able to dynamically adjust to fluctuations in load
Can’t share capacity across applications
 Unable to adapt to changes in applications and
infrastructure
Each new component causes significant integration
challenges
Interfaces are not based on open standards
 Fragile
Single points of failure are prevalent
Failover and business continuity requires expensive,
custom solutions
Open Services Architecture
Applications
Middleware
Systems Management and Automation
Workload / Performance Management
Security
Availability / Service Management
Logical Resource Management
Clustering Services
Connectivity Management
Physical Resource Management
OS
OS
+ + +
OS
Exploiting Grid standards in Enterprise Computing
 Virtualise Data Center
Consolidate logically
Business Rules managed provisioning,
performance, workloads
 Heterogeneous Clustering
X-Platform Automation, backup,
disaster recovery, workload management
 Integrated Infrastructure
Autonomic discovery and provisioning
Common Services Bus Interface
 Coherent, consistent infrastructure
Based on open standards (OGSA, OGSI, Web Services, XML, SOAP, HTTP etc.)
Accessed via Web Services interface
Grid Services Structure
System Management
Sevices
Grid Services
Open Grid Services Architecture (OGSA)
OGSI – Open Grid Services Infrastructure
Web Services
OGSA Enabled
OGSA Enabled
OGSA Enabled
OGSA Enabled
OGSA Enabled
OGSA Enabled
Security
Workflow
Database
File Systems
Directory
Messaging
OGSA Enabled
OGSA Enabled
OGSA Enabled
Servers
Storage
Network
Professional Services
Autonomic Capabilities
Applications
Grid Computing Architecture
Utility
Enablement
Billing, Metering, Subscription,
Identification, Disaster Recovery
Management
Functions
Workload Management, Clustering, Job &
Service Scheduling, Automated Server
Recovery, Distributed e-business
Workflow, Provisioning, Data Federation,
File System Federation
Meta-OS
Services
OGSA: policy repository, data
replication, security, problem
determination, resources
instrumentation, logging, basic
provisioning
Grid Service
Infrastructure
OGSI: discovery, lifecycle, registry,
manageability factory,
handlemapper, notification, install
Autonomic I/T Resources
Architecture Framework
S&TC
xSP
eCommerce
etc...
New classes of applications enabled
Common GUI
Autonomic Functions & Management Middleware
Open Grid Services Architecture
WebServices Run-time
IBM Platforms QoS Enablers/Optimizers
z/OS
AIX
OS/400
Linux
Windows
zSeries
pSeries
iSeries
z,p,i,xSeries
xSeries
eLiza eServer Foundation
Solaris &
HP/UX
Linux
Windows
Dell
Compaq
...
Dell
Compaq
...
Storage
Sun
& HP
Grid Services
System Management
software Sevices
he globus project
OGSI – Open GridtOGSA
Services
Infrastructure
www.globus.org
tm
w w w .globus.org
OGSA Enabled
OGSA Enabled
OGSA Enabled
OGSA Enabled
OGSA Enabled
OGSA Enabled
Security
Workflow
Database
File Systems
Directory
Messaging
OGSA Enabled
OGSA Enabled
IBM TotalStorage
OGSA Enabled
IBM Global Services
Autonomic Capabilities
Architecture Framework
Infrastructure Critical
Elements
Attribute
Goal
Schematic for On Demand
On Demand Business
On Demand Operating Environment
Traditional Data Centers
and Managed,
Distributed Systems
Lightly Managed
Distributed
Systems
PC’s & Mobile
Foundation
Technologies
eUtility, Provisioning, Utility Management Infrastructure
Autonomic
Grid
Web Services
OGSA Service Model









Provides capabilities essential to distributed / Grid computing
Builds on Web Services technology...current and planned
A component model extension for Web Services
All OGSA services adhere to specified service interfaces and
behaviours (some required and some optional)
Factory, registry, discovery, lifecycle, query service data, notification,
reliable invocation
Provides reliable / secure preservation of distributed state
Supports dynamic late-binding and creation of distributed resource
groups
Supports the creation of virtual resources as stateful OGSA service
instances
Location transparent deployment
OGSA Mapping
Grid service lifecycle mgt:
Instance Creation
Addressing
Component Model:
Grid Service
Notification
Service Data
Registration
Resource Instrumentation
WSDL
Unit of Work Coordination
Business Process Flow
Security
Context Propagation
Quality of service management
Plug-in architecture
Message delivery across multiple
messaging models
Endpoint abstraction
Quality of service management
Message Broking
Transformation and Routing
Clustering
Policy Management
Registry
Automation
Provisioning
Problem Determination
VO Definition and Registration
Service Desk
etc
OGSA Services
OGSI
Web Services
JetStream Messaging
Resources expressed as OGSA Services:
The next level of virtualization
OGSA Common Resource Model Architecture
Abstract representation of “logical” IT
resource (node, process, disk, file system,
IP address, XML database, Security service,
Commerce Server) described as a web
services interface (WSDL)
Common operations to configure and
monitor resource details.
Service interface separate
from access and
implementation
Service interaction with
underlying resource can
be local or remote
Provide common behavior for lifecycle,
discovery, events.
Application
Network
Middleware
OS
such as CIM or SNMP or RMC
Hardware
Adapter/Connector can push down onto
multiple underlying resource instrumentations
How will this get deployed ?
Location
Independent
Could be
•Centralised
Full OGSA
NGCM App
OGSA and nonOGSA Resource
OGSA
and nonManagers
OGSA Resource
OGSA and nonManagers
OGSA Resource
Managers
Full OGSA
NGCM App
•Decentralised
•Both
Applies to both
enabled and existing
applications
Exploits Pegasus
CIM arechitecture
•Exposed via
OGSI web svc
New and existing
Non-Java Apps
OGSA
New and existing
Java/J2EE Apps
OGSA
Utility Services Bus
Separates business logic from infrastructure services
Service
•Infrastructure services run within the
ppService Bus
App
A
Se
Not invoked by business logic
•Services required to do business with web services
ce
Co
ord
Ser
vi
ice
Monitoring
•Metering, billing (related to contracts)
rv
•Monitoring, load balancing (related to QoS mgmt, SLAs)
in'n
•Directory, reputation identification, logging, non-repudiation
Bus provides plug-in points for infrastructure services
g
M
rin
ete
Se
rv
ic
Dirthe services
•Does not expect to provide all
ect
ory
•On-ramp, just after application invokes
serviceSelection
•Off-ramp, just before bus passes control to service
Se
e
r
v
ice
Configurable Infrastructure
App
•Tooling to connect services and applications to bus
Wider than an enterprise
Gateway
Gateway
Gateway
Business Continuity and Automated Operations
IBM Server
Appliances
zSeries
cluster
Linux
cluster
iSeries
cluster
pSeries
cluster
xSeries
cluster
Sun or HP
Cluster
ISV
Cluster
On Demand Systems Environment
Bigger, More Value-rich than just Utility Services
Business Processes & Applications
Workload Mgmt.
Provisioning
Billing/Metering
…
Automate
Systems Integration
Virtualize
Clustering, Policy Repository, Security, Problem Determination, Logging,
Integrated Systems Mgmt, WLM, Provisioning, Scalability, Security, Network
Mgmt, Storage Mgmt, CUOD
Pools of Virtual Resources
Blades
Partitioning
Storage Virtualization
Physical Resources
Islands of Heterogeneous
Resources
HP
Next Steps for Customers
dynamic business process integration
billing
metering
distributed scaling
distributed resource management
Phase 2
(exploit)
Exploit On Demand Technologies
eWLM
eAutomation
eDisaster Recovery
Tivoli
Storage Tank
V
Exploit OGSA via Webservices/Websphere
Phase 1
V
(enable)
 IT Optimization
 Scorpion
 Assess Applications
 Software Enable
 Consolidate & Virtualize
Appropriate OS levels
Storage/Servers/Density
Systems Mgmt (Tivoli)
LPAR/IRD/VMWare
Grid (Globus Toolkit)
IBM Director/Blade Center
V
V
Leverage open standards
Level of integration
Full
Application Environment
Toward an On Demand Operating Environment
Systems Environment
Leverage virtualization
Silos
Labor-intensive
Level of automation
Autonomic
e-business on demand: The New Agenda
Responsive
Variable
Resilient
Focused
Open
on demand business
on demand operating
environment
new financial models
Integrated
Virtual
Autonomic
If you are open, integrated, autonomic and virtualised,
you are On Demand!
e-Business on Demand: Operating Environment
Business
Transformation
Application
Environment
Operating
Environment
Systems
Environment
Utility
Services