Download Managing Database Performance Within Virtual

Managing Database Performance
Within Virtual Environments
Walter Guerrero, Sr. Software Engineer
Terms of This Presentation
This presentation was based on current information and resource allocations as of
October 2009 and is subject to change or withdrawal by CA at any time without notice.
Notwithstanding anything in this presentation to the contrary, this presentation shall not
serve to (i) affect the rights and/or obligations of CA or its licensees under any existing
or future written license agreement or services agreement relating to any CA software
product; or (ii) amend any product documentation or specifications for any CA software
product. The development, release and timing of any features or functionality described
in this presentation remain at CA‘s sole discretion. Notwithstanding anything in this
presentation to the contrary, upon the general availability of any future CA product
release referenced in this presentation, CA will make such release available (i) for sale
to new licensees of such product; and (ii) to existing licensees of such product on a
when and if-available basis as part of CA maintenance and support, and in the form of a
regularly scheduled major product release. Such releases may be made available to
current licensees of such product who are current subscribers to CA maintenance and
support on a when and if-available basis. In the event of a conflict between the terms of
this paragraph and any other information contained in this presentation, the terms of
this paragraph shall govern.
2
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
For Informational Purposes Only
Certain information in this presentation may outline CA‘s general product direction. All
information in this presentation is for your informational purposes only and may not be
incorporated into any contract. CA assumes no responsibility for the accuracy or
completeness of the information. To the extent permitted by applicable law, CA provides
this document ―as is‖ without warranty of any kind, including without limitation, any
implied warranties or merchantability, fitness for a particular purpose, or noninfringement. In no event will CA be liable for any loss or damage, direct or indirect,
from the use of this document, including, without limitation, lost profits, lost
investment, business interruption, goodwill, or lost data, even if CA is expressly advised
of the possibility of such damages.
3
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
Abstract
Managing database performance in virtual environments
can be challenging when different database performance
products are being used for Oracle, SQL Server, DB2 for
LUW, and Sybase. CA can help.
CA Insight DPM will allow you to proactively manage the
performance of your virtualized databases as well as the
VMware virtual center repository. This presentation
discusses CA‘s current solutions and practices for managing
virtualized databases as well as our vision and roadmap for
virtualized environments.
4
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
The Database Performance Challenge
> Before virtualization
 What is happening to my database and why???
> After virtualization
 What is happening to my database and why???
> Managing database performance – Virtual vs Physical
 Same concerns, different world
 Need visibility to key performance metrics
 Need end-to-end visibility of DB health
 Need alerting with visibility across silos
 Need to detect dynamic changes
 Need flexibility
5
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
CA Database Performance Management
> Manage physical, virtual and cloud environments
 View performance metrics of VM, physical server and
database metrics in a single display
 Support for VMware, Sun Solaris Zones, IBM LPARs, Citrix
Xen and Hyper-V environments
 Manage VMware vCenter repository
> Improve service availability and performance with faster
time to resolution
> Integrate event & performance management across
technology domains to indentify the root cause of
problems
6
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
VMware vCenter Repository
Vital Component To Be Managed
> Holds inventory

Host and virtual machine details
> Holds alarms and Events

Data stored for event and each alarm triggered in the system
> Holds performance statistics

Makes up the majority of the vCenter database size and
processing: up to 90% of VMware

Performance statistics inserted (every five minutes)

Performance statistics rollup stored procedures
> Ad-doc queries against can present problems
7

Unexpected workload

Blocking / locking

Increased database reads and writes in active systems
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
vCenter Repository
Workload and Maintenance
> VPXD roll up – opportunity to monitor and notify when realtime five minute performance statistics are not able to be
archived to historical in the database
> Stored procedures – opportunity to monitor and notify when
scheduled jobs in SQL Server every thirty minutes, two hours
and twenty-four hours do not complete

Increased CPU utilization at these time intervals is normal
> Fragmentation in the vCenter database occurs mostly as a
result of statistics updates and rollup


8
Four database tables for storing historical performance data
–
vpx_hist_stat1, vpx_hist_stat2, vpx_hist_stat3, vpx_hist_stat4
–
Each of these tables has its own clustered index
Opportunity to defragmentation and reindex
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
vCenter Repository
Storage Growth Expectations
> Size of database dependent on number of hosts & VMs
managed, frequency of data collection and type of database

SQL Server - each stat collected 60 bytes, event stored 1600
bytes, Oracle - each stat collected 100 bytes event stored 600
bytes
–
Using default settings, data for 2 hosts running 8-16 VMs per host
approx 60 to 140 MB year. Each month, average number of
events generated will also consume about 190 MB in SQL Server,
and 70 MB in Oracle

–
Using default settings, data for 75 hosts running 8-16 VMs per host
approx 150 to 330 MB year. Each month, average number of
events generated will also consume about 190 MB in SQL Server,
and 70 MB in Oracle

9
October 12, 2009
Total database size after a year ~2.20 GB SQL Server, 1.0 GB Oracle
Total database size after a year ~2.40 GB SQL Server, 1.2 GB Oracle
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
vCenter Repository
SQL Server Key Performance Indicators
>
Memory

Buffer cache hit ratio: Should be high 90s or database is spending too much time waiting to
retrieve data from the disk drives. Opportunity to
–
monitor and notify when database does not have enough memory to cache working data set
–
Increase the amount of memory allocated to SQL Server
>
Page Reads/sec Page Writes/sec Page Requests/sec.
>
Page lookups/sec—Number of database pages requested by SQL Server.

>
Processor

>
High numbers can sometimes signify that data is not properly indexed or that the query optimizer
is not using the most efficient index.
%Processor Time—Percentage of time that the CPU is busy. If consistently over 80 percent, you
might be bottlenecked by CPU.
PhysicalDisk

Current Disk Queue Length—The number of outstanding disk I/Os at the time the time the data is
collected. If this number is consistently greater than two, your database might be bottlenecked
by disk I/O.

Disk Writes/sec—Number of disk writes per second. Important counter for transaction log disk
monitoring to ensure that transaction log writes are not bottlenecking your system.
>
Disk I/O – monitor and notify when disk device bandwidth for log devices bottlenecks on
disk I/O and impacts/prevents transactions
10
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
vCenter Repository
Key Performance Indicators
> Locks

Lock Waits/sec—Number of times a lock request cannot be
granted immediately. Monitor this along with the Lock Wait Time
counter.

Lock Wait Time (ms)—Number of milliseconds in the last second
that a SQL Server process is blocked waiting for a lock. SQL
Server uses
> Latches
11

Latch Waits/sec—Number of times a latch request cannot be
granted immediately. Monitor this along with the Latch Wait
Time counter.

Latch Wait Time (ms)—Number of milliseconds in the last second
that a SQL Server process is blocked waiting for a latch. Latches
are lighter weight than locks and should have much shorter, if
any, wait times.
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
Managing Databases in VMware & vCenter
Server
Database Health Sent to CA eHealth PM
DBMS
VM
VM
VM
Insight
Knowledge
Agents
VM
Insight
Knowledge
Agents
VM
Insight
Knowledge
Agents
ESX
CA eHealth PM
Server
CA
eHealth
PM View
VM
Insight
Knowledge
Agent
DBMS
VM
VM
VM
DBM
S
ESX
vCenter Server
w/Repository
CA
Spectrum
IM View
DBMS
VM
CA Spectrum IM
Server
VM
VM
ESX
Database Health Sent to CA Spectrum IM
12
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
End-to-End Service Assurance
Performance Metrics – VM Level
Performance metrics
can be displayed at
either the database
level or the VM level
13
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
End-to-End Service Assurance
vCenter Server - Manage and Alert
Monitor and alert
on the VC database
performance
14
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
End-to-End Service Assurance
Integration with
CA eHealth PM
gives visibility
without asking a
DBA
Robust metrics and
alerting for
managing database
performance
15
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
Architecture – CA Insight DPM Benefits
> Flexible

Manage performance for both physical & virtual environments

Local agent based or remote monitoring

Same agent integrates across CA eHealth PM, CA Spectrum IM,
CA Wily Introscope, and CA Spectrum SA (when GA)
> Dynamic


Automatically detects and monitors
–
New processes
–
Changes to virtual CPUs
–
New storage (SAN, NAS)
–
Changes to memory
Multi-threshold alarms on same condition
> Customizable and extensible

16
User defined functions for custom scanning
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
Architecture – CA Insight DPM Robust
> Excellent visibility on performance
 1500 different metrics
 CPU
 Database Physical and Logical IO
 Storage level physical and logical
 Memory
 Locks
 Database Objects
– Space, Fragmentation, Usage
 SQL
 Services
17
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
Potential CA Defined SQL
For vCenter Environment
> Opportunity to monitor/notify when host exceeds 20 or VM exceeds
200 to use separate disks

To ensure performance in 20+ host or 200+ virtual machine
environments, VMware recommends SQL Server and vCenter Server be
installed on separate physical disk drives
> Opportunity to notify on failed authentication attempts into Virtual
Center

select EVENT_TYPE, USERNAME, CREATE_TIME, HOST_NAME from
VPX_EVENT where EVENT_TYPE =
‗vim.event.BadUserNameSessionEvent‘
> Opportunity to notify on successful authentication attempts into
Virtual Center

18
select EVENT_TYPE, USERNAME, CREATE_TIME, HOST_NAME from
VPX_EVENT where EVENT_TYPE = ‗vim.event.UserLoginSessionEvent‘
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
Potential CA Defined SQL
For vCenter Environment – Cont'd
> Opportunity to monitor/notify when host exceeds 20 or VM exceeds 200 to use
separate disks

To ensure performance in 20+ host or 200+ virtual machine environments, VMware
recommends SQL Server and vCenter Server be installed on separate physical disk
drives
> Opportunity to notify on failed authentication attempts into Virtual Center

select EVENT_TYPE, USERNAME, CREATE_TIME, HOST_NAME from VPX_EVENT
where EVENT_TYPE = ‗vim.event.BadUserNameSessionEvent‘
> Opportunity to notify on successful authentication attempts into Virtual Center

select EVENT_TYPE, USERNAME, CREATE_TIME, HOST_NAME from VPX_EVENT
where EVENT_TYPE = ‗vim.event.UserLoginSessionEvent‘
> Opportunity to monitor for databases that have been vMotioned (moved)

Rogue or to just be notified
> Opportunity to monitor and track databases for licensing compliance

19
Oracle is the primary one as they charge for the full environment versus what is
actually used
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
vCenter Repository
Database Views Reference
> vpxv_FarmGroups
> vpxv_VM_Datastore
> vpxv_VMGroups
> vpxv_Host_Network
> vpxv_Entity
> vpxv_VM_Network
> vpxv_Hosts
> vpxv_Compute_Resource_Network
> vpxv_VM
> vpxv_Fields
> vpxv_Templates
> vpxv_Host_Fields
> vpxv_Tasks
> vpxv_VM_Fields
> vpxv_Alarms
> vpxv_Perf_Intervals
> vpxv_Host_Datastore
> vpxv_Perf_Host_Counters
20
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
vCenter SQL Server Plugin
Key Performance Indicators
> Default Instance Buffer Cache Hit Ratio
> Default Free Pages
> Default Instance Free Pages
> Named Instance Working Set
> Named Instance Buffer Cache Hit Ratio
> Named Instance Free Pages
> Named Instance Total Server Memory
21
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
VMware Repository
Metrics to Hardware Recommendation
Sample Size
CPU Cores
SQL Server
Memory
Log Device
I/Os per
second
40K
1
1GB
< 130
40K – 80K
2
2GB
120 - 200
80K – 120K
4
4GB
200 - 300
120K – 160K
4
6GB
400 - 500
160K – 200K
5
8GB
500 - 600
> 200K
8
12GB
650
22
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
DB Performance Prior to VM Migration Using
vMotion
View of the CA Insight DPM
workspace prior to vMotion
View of MS SQL Server
2005 workspace prior to
vMotion
23
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
CA eHealth PM At-a-Glance Report Prior to
VM Migration Using vMotion
CA eHealth PM At A
Glance report of MS
SQL Server 2005 prior
VM migration using
vMotion
24
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
VMware Migration using vMotion
VM migration
utilizing vMotion
technology
VM migration
complete utilizing
vMotion
25
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
VMware Migration Events Using vMotion
Migration events
utilizing vMotion
technology
26
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
vMotion Events In CA Insight DPM
vMotion events
being monitored
by CA Insight DPM
27
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
vMotion Event Alarms In CA Insight DPM
vMotion
events alarms
being reported
by CA Insight
DPM
28
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
CA Insight DPM After VM Migration using
vMotion
CA Insight DPM workspace
after the VM migration event
utilizing vMotion
CA Insight DPM SQL Server 2005
workspace after VM migration
event utilizing vMotion
29
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
CA eHealth PM At-a-Glance Report After VM
Migration Using vMotion
CA eHealth PM At A
Glance report of MS
SQL Server 2005 after
VM migration using
vMotion
30
October 12, 2009
Managing Database Performance Within Virtual Environments
Copyright © 2009 CA
Demonstration
Thank You!