Download VMware Presentation - Georgia Institute of Technology

CERCS Distinguished Lecture and Keynote
Georgia Tech, October 17, 2008
Computing on a Distributed,
Virtualized Infrastructure
Beng-Hong Lim
Senior Director of R&D
VMware
Copyright © 2008 VMware, Inc. All rights reserved.
Outline
Why virtualize?
How virtualization helps
Challenges and opportunities
Recap and speculate
Copyright © 2008 VMware, Inc. All rights reserved.
Why virtualize?
Common reason: share limited resources
past: expensive hardware
Today: hardware is cheap, but …
space, power, cooling
Copyright © 2008 VMware, Inc. All rights reserved.
Server consolidation
Customer Example: Leading North American Utility
BEFORE
AFTER
Servers
1,000
80
Storage
270 TB DAS
140 TB SAN & NAS
Network
3,000 cables/ports
300 cables/ports
200 server racks
10 server racks
400 power whips
20 power whips
Facilities
Copyright © 2008 VMware, Inc. All rights reserved.
Server consolidation
Virtual Machines, Real Savings
80% reduction in space, power and cooling
$8 million saved over 2 years
Copyright © 2008 VMware, Inc. All rights reserved.
Server consolidation is now mainstream
“Virtualization makes one computer act like many”
- popular press tagline
Copyright © 2008 VMware, Inc. All rights reserved.
Beyond server consolidation
“Why is your part taking so long?
Management complexity
hardware: distributed, heterogeneous
software: distributed, complex
Distributed infrastructure management:
the next killer app for virtualization
Copyright © 2008 VMware, Inc. All rights reserved.
Beyond server consolidation
Customer Example: Leading North American Utility
BEFORE
AFTER
Servers
1,000
80
Storage
270 TB DAS
140 TB SAN & NAS
Network
3,000 cables/ports
300 cables/ports
200 server racks
10 server racks
400 power whips
20 power whips
Facilities
Copyright © 2008 VMware, Inc. All rights reserved.
Beyond server consolidation
Operational efficiency
server and app load from 40 hrs to 30 mins
10,000 person-hours saved per year
Copyright © 2008 VMware, Inc. All rights reserved.
Workloads per Virtual Infrastructure Admin
A Foreign Investment Bank
A Large Consumer Bank
An Investment Bank
A Medical Center
A Pharmaceutical Company
Copyright © 2008 VMware, Inc. All rights reserved.
50 workloads per
admin for physical
infrastructure admin
90
200
300
350
600
Distributed Infrastructure Management
To better manage modern hardware and software
Virtualization:
liberates software from hardware
encapsulates software within versatile virtual
execution environments
automates management of hardware as a giant
pool of resources
Copyright © 2008 VMware, Inc. All rights reserved.
Liberating software from hardware
App-1
App-2
OS/1
OS/2
HW-1
HW-2
Copyright © 2008 VMware, Inc. All rights reserved.
Liberating software from hardware
App-1
App-2
OS/1
OS/2
Virtual Hardware Abstraction
VMM
VMM
HW-1
HW-2
Copyright © 2008 VMware, Inc. All rights reserved.
Snapshot
Log
Fork
VMM
Disk
Storage
Physical
Virtual
Machines Machines
Software as a highly-manageable object
VMM
Migrate
Record
Replay/Rewind
etc.
Virtualization provides new ways to manipulate software
Copyright © 2008 VMware, Inc. All rights reserved.
Hardware as a distributed pool of resources
Exchange Server
CPU
2 x 1GHz
Memory
4 GB
Disk
500 GB
Network
1 Gbps
Distributed Yes
Virtualization
Fault Tolerant
Disaster Recovery
Enabled
Security
High
Layer
Allocate resources and capabilities on-demand to applications
Utilize redundant hardware for reliability and availability
Virtualization makes many computers act like one
Copyright © 2008 VMware, Inc. All rights reserved.
Distributed Infrastructure Management
To better manage modern hardware and software
How do we achieve this?
Copyright © 2008 VMware, Inc. All rights reserved.
Distributed hardware and software trend
High-speed connectivity
Web-based applications
Copyright © 2008 VMware, Inc. All rights reserved.
Server Management
 Virtual machines are hardware independent
 VMotion (Live Migration)
Pre-copy memory
Virtual disks on networked storage
Preserve VM’s identity: name, MAC address, IP address
Copyright © 2008 VMware, Inc. All rights reserved.
Automatic load balancing across machines
Distributed Resource
Scheduling (DRS)
Copyright © 2008 VMware, Inc. All rights reserved.
Dynamic Balancing
Continuous Optimization
Adding and removing resources
Hot-plug machines
Add/remove capacity on demand
Improve application availability
Distributed power management
VMware
VirtualCenter
X
Copyright © 2008 VMware, Inc. All rights reserved.
Power Savings with DPM
5 hour VMmark run
110 VMs, 4 server cluster
2000
1800
No DPM
1600
Watts
1400
1200
1000
800
600
400
With DPM
200
0
50% Savings During VMmark™
Copyright © 2008 VMware, Inc. All rights reserved.
Storage Management
Optimize disk usage, availability and management
Storage resource pool
Storage VMotion: live storage migration
Thin provisioning
Copyright © 2008 VMware, Inc. All rights reserved.
Storage VMotion
Migrate running VM to new storage
VM stays on same host
Virtual disks may be individually placed
Storage type independent
Migration does not disturb VM
No downtime
Transparent to guest OS and apps
Minimal performance impact
Copyright © 2008 VMware, Inc. All rights reserved.
Storage VMotion Benefits
Retire or migrate between arrays
Arrays coming off maintenance/leasing cycles
Storage tiering
Migrate from FC to iSCSI, NAS or within or between
enclosure(s)
Eliminate performance bottlenecks
Load balance through LUN reconfiguration
Seamlessly add and begin using new LUNs
Non-disruptive VM file system upgrade
Future proofing disk format
Copyright © 2008 VMware, Inc. All rights reserved.
Thin Provisioning: Smart Allocation
App
App
App
OS
OS
OS
VMware ESX
20GB
5GB
40GB
Virtual
Disks
20GB
Physical
Storage
Copyright © 2008 VMware, Inc. All rights reserved.
5GB
40GB
100GB
20 GB
40GB
Software Management
Copyright © 2008 VMware, Inc. All rights reserved.
Traditional Software Lifecycle
Different environments at each stage, hard to bridge
1
Developers and QA
develop
Dev
test
QA
2
3
integrate
stage
CCR
(Change, Configuration and Release Management)
Copyright © 2008 VMware, Inc. All rights reserved.
Operators
Release Management
deploy
manage
Ops
(Operations, Optimization and Support)
Virtualization eases software development
VMware Workstation
Indispensible software development tool
Developer-oriented features
.5
VM teams to model distributed hardware
Multiple snapshots
.5
Scripted control of VM operations
Record/Replay
VAssert
VProbes (DTrace for VMs)
A rich set of tools not available in physical environments
Copyright © 2008 VMware, Inc. All rights reserved.
Software Deployment and Management
Process
Process
Process
App Stack A
App Stack B
App Stack C
DB2 9
Different application stacks have different configurations and requirements
Copyright © 2008 VMware, Inc. All rights reserved.
Virtual appliance as unit of deployment
Pre-built, pre-configured and
ready-to-run software application
packaged with the OS inside a
Virtual Machine
Or packaged inside multiple
Virtual Machines
FIREWALL
Virtual
Appliance
Checkpoint
Windows
CRM
Appliance
mySQL
Virtual
Apache
Linux
Tomcat
Linux
Copyright © 2008 VMware, Inc. All rights reserved.
Linux
Virtual appliance packaging
Open Virtual Machine Format (OVF)
a vendor and platform independent standard for
packaging and distributing virtual machines
handles single VMs and multi-tier VM “teams”
OVF 1.0 spec released by DMTF
The OVF descriptor file includes critical
infrastructure information
describes virtual hardware configuration and
properties
tells management tools and hypervisors what to do
with the virtual machines
resource management, security, and availability
become properties of the virtual machine,
independent of where or how it is deployed
Copyright © 2008 VMware, Inc. All rights reserved.
X.Ovf
Security = High
Performance = 500 ms
Availability = 99.99%
Access control
IP port restrictions
SLA
Definitions
Virtual
Apache Appliance
mySQL
Linux
Tomcat
Linux
Linux
Software Lifecycle on a Virtual Infrastructure
Deploy and Manage Complex Applications
As “Enterprise Virtual Appliances”
Distributed, Multi-site development
Dev/Staging Process Automation
Dev, test, debug with virtual machines
1
2
Dev
QA
3
CCR
Ops
(Change, Configuration and Release Management)
(Operations, Optimization and Support)
SHARED VIRTUAL
INFRASTRUCTURE
Copyright © 2008 VMware, Inc. All rights reserved.
Draw the Logical Datacenter and…
VI automatically deploys to physical
resources and…
dynamically adapts the mappings to
optimize efficiency within SLAs and
policies
Virtual Infrastructure
CPU
Pool
Memory
Pool
Storage
Pool
Interconnect
Pool
Copyright © 2008 VMware, Inc. All rights reserved.
Outline
Why virtualize?
How virtualization helps
Challenges and opportunities
Recap and speculate
Copyright © 2008 VMware, Inc. All rights reserved.
Challenge: supporting mobility
Uniform hardware abstraction
CPU: x86 standard
I/O devices: emulated vs. passthrough
Network switch management
port state, configuration and control
long-distance VMotion
Copyright © 2008 VMware, Inc. All rights reserved.
Passthrough I/O Devices
Guest OS
Guest OS
Guest OS
Device Driver
Device Driver
Device Driver
I/O MMU for DMA isolation
(Intel VT-d, AMD IOMMU)
Partitionable I/O devices for
device sharing (PCI-SIG IOV)
Virtualization
Layer
However, we lose
uniform abstraction and VM
mobility
I/O MMU
VF
Basic passthrough support
VF
VF
Potential solutions:
paravirtualization
I/O Device
PF
PF = Physical Function, VF = Virtual Function
Copyright © 2008 VMware, Inc. All rights reserved.
guest driver coordination
standardized hardware
interfaces
Network Switch Management
 Network-centric view:
virtualization blurs the
host/network boundary
core
distribution
Virtual network switches and
topologies within a host
access
VMs can move anywhere
The virtual network switch is a
new access layer.
hosts
Network administrators can no
longer rely on physical portbased access control
VMs
Copyright © 2008 VMware, Inc. All rights reserved.
Extend switching and management
protocols to virtual environments.
Distributed Virtual Switches
vSwitch
vSwitch
vSwitch
Today’s vSwitch
Distributed Virtual Switch
Distributed vSwitch
Copyright © 2008 VMware, Inc. All rights reserved.
Migrates port state with VM
ESX host 1
Copyright © 2008 VMware, Inc. All rights reserved.
ESX host 2
ESX host 3
Opportunity: making virtual better than real
Security
inspect OS activity from a safe platform, e.g., another VM.
Provide APIs for anti-virus software
Overshadow: defending applications from compromised OSes
(Chen et al., ASPLOS 2008)
minimize and harden virtualization stack
Fault tolerance
software-based tolerance against hardware failures
run VMs in lockstep (Bressoud and Schneider, SOSP 1995)
Synthesize useful functions in virtual hardware
Copyright © 2008 VMware, Inc. All rights reserved.
Virtual Machine Fault Tolerance
Primary
Secondary
Primary
Secondary
X
Lockstep
X
Copyright © 2008 VMware, Inc. All rights reserved.
Lockstep
Virtual Machine Record & Replay
Application
Application
Operating System
Operating System
Virtualization Layer
Virtualization Layer
RECORD
Logging causes of non-determinism
• Input (network, user), asynchronous I/O
(disk, devices), CPU timer interrupts
Copyright © 2008 VMware, Inc. All rights reserved.
REPLAY
Deterministic delivery of events
previously logged
•
Result = repeatable VM execution
Determinism
Given the exact same inputs, a processor will
deterministically execute the same instruction stream
and end up in the exact same state
“Input” is anything outside the CPU/memory that is
visible to software:
I/O and interrupts
non-deterministic processor behavior (e.g., CPU timestamp)
Hard to do on physical machines, but doable for
virtual machines
Record/replay in VMware Workstation for over a year
Copyright © 2008 VMware, Inc. All rights reserved.
Opportunity: client virtualization
Copyright © 2008 VMware, Inc. All rights reserved.
Client virtualization
User experience
access to applications and data from any device
with good graphics and interactive performance
on one easy to manage “desktop” environment
Centralized management
OS and application deployment and management
data backup and recovery
recovering from corruption
Thick vs. Thin, Mobile vs. Fixed, Online vs. Offline
Copyright © 2008 VMware, Inc. All rights reserved.
Client virtualization
A solution: virtual desktop in a VM
all the benefits of software lifecycle management
maintain single master version
Distributed virtual hardware: migrate computation
and data to appropriate locations
CPU and memory: client vs. server
Graphics processing: local vs. remote
Virtual disk storage: local vs. networked, replicated,
deduplicated
Copyright © 2008 VMware, Inc. All rights reserved.
Client virtualization scenario
Compute
Graphics
Storage
Online, standard graphics
Copyright © 2008 VMware, Inc. All rights reserved.
Client virtualization scenario
Compute
Graphics
Storage
Online, high-speed graphics
Copyright © 2008 VMware, Inc. All rights reserved.
Client virtualization scenario
Compute
Graphics
Offline
Copyright © 2008 VMware, Inc. All rights reserved.
Storage
Client virtualization
A solution: virtual desktop in a VM
all the benefits of software lifecycle management
Distributed virtual machine hardware: migrate
computation and data to appropriate locations
CPU and memory: client vs. server
Graphics processing: local vs. remote
Virtual disk storage: local vs. networked, replicated,
deduplicated
No lock-in to a particular configuration
Copyright © 2008 VMware, Inc. All rights reserved.
Outline
Why virtualize?
Infrastructure Management
Challenges and Opportunities
Recap and Speculate
Copyright © 2008 VMware, Inc. All rights reserved.
Recap
Why virtualize?
server consolidation
distributed infrastructure management
Infrastructure Management
Challenges and Opportunities
Recap and Speculate
Copyright © 2008 VMware, Inc. All rights reserved.
Recap
Why virtualize?
Infrastructure Management
data center management
software lifecycle management
Challenges and Opportunities
Recap and Speculate
Copyright © 2008 VMware, Inc. All rights reserved.
Recap
Why virtualize?
Infrastructure Management
Challenges and Opportunities
maintaining mobility
making virtual better than real
client virtualization
Recap and Speculate
Copyright © 2008 VMware, Inc. All rights reserved.
Speculating about the future
A Virtual, Mobile and Cloudy Future?
in your hand: multi-function mobile devices
in the cloud: multiple data centers
virtual appliances everywhere
Everything more distributed, more mobile
Copyright © 2008 VMware, Inc. All rights reserved.
Mobile clients
Proliferation of mobile client devices
notebooks, multi-function handhelds, smart phones
Can a mobile device serve all your computing needs?
limited size, compute power, network bandwidth
one (small) size does not fit all
We’ll be using various types of client devices
user environment and computation typically tied to device
User environment, data and computation should
migrate automatically and seamlessly to appropriate
hardware
Copyright © 2008 VMware, Inc. All rights reserved.
In the data center
Convergence of data center hardware
Traditional roles of data center hardware
Servers host applications
Storage arrays serve and manage storage blocks
Network switches process and route network traffic
Storage arrays and network switches are appliances
In a virtualized world
move storage and network processing into virtual appliances
servers = switches = storage = VM hosts
Copyright © 2008 VMware, Inc. All rights reserved.
In the cloud
How Do We Define The Cloud?
Improved economics: shared, managed infrastructure
Lightweight entry and exit
Consumption-based pricing
Accessible using standard Internet protocols
Scalable and elastic
Copyright © 2008 VMware, Inc. All rights reserved.
Challenges of Cloud Computing
Need for New, Highly Efficient and
Flexible Computing Infrastructure
Application Compatibility
Lack of Standardization Creates
Complexity and Switching Costs
Multi-tenancy
Copyright © 2008 VMware, Inc. All rights reserved.
Cloud Services
vCloud APIs
Virtual Datacenter
Copyright © 2008 VMware, Inc. All rights reserved.
Image Management
User Accounts
Chargeback
Mobility
Off-Premise Clouds
Federation: Connecting the Clouds
vApp
vApp
Primary
Datacenter
Cloud
Provider
Secondary
or Branch
Datacenter
Copyright © 2008 VMware, Inc. All rights reserved.
Seamless Cloud Connectivity
vApp
vApp
3
Primary
Datacenter
vCloud
Provider
3
Copyright © 2008 VMware, Inc. All rights reserved.
Security
Secondary
or Branch
Datacenter
1
A Distributed, Virtualized Infrastructure
Firewall
Mail
Storage
Virtual Infrastructure
Copyright © 2008 VMware, Inc. All rights reserved.
Web
Network
In conclusion
Virtualization plays a central role in managing the
globally-distributed infrastructure
run applications anywhere
manage software and hardware independently
break down traditional boundaries
Essential properties
uniform, isolated and mobile execution environment
global resource pools
compatibility
Do more with less
Copyright © 2008 VMware, Inc. All rights reserved.
Thank You!
Copyright © 2008 VMware, Inc. All rights reserved.