Download The SQL Server Database Consolidation Appliance Reference

SESSION CODE: DAT409
THE SQL SERVER DATABASE
CONSOLIDATION APPLIANCE
REFERENCE ARCHITECTURE
Rob Reinauer
Product Unit Manager, SQL Systems Engineering
Microsoft
(c) 2011 Microsoft. All rights reserved.
SQL Server Private Clouds & The SQL Database Consolidation Solution
Agenda
►
►
►
►
►
►
►
►
Private Cloud Solutions Overview
SQL Server Appliance Engineering
The SQL Server Database Consolidation Solution
The SQL Server DBC Solution Hardware Architecture
The SQL Server DBC Solution Software Architecture
Consolidation, Virtualization & SQL Server
Application Deployment & Compatibility
Performance and Capacity Planning
SQL Server Private Clouds & The SQL Database Consolidation Solution
Private Cloud Value
► Radically lower the cost for managing and
maintaining compute infrastructures
Mechanisms
►
►
►
►
►
►
Integrated management and monitoring
Elastic capacity provisioning
Automated load balancing and servicing
Self Service deployment and monitoring
Transparent, automated high availability
Metering and chargeback capabilities
Introducing:
The SQL Server
Database Consolidation
Solution
A pre-built, optimized, SQL Server
Private Cloud Solution
SQL Server Private Clouds & The SQL Database Consolidation Solution
The SQL Server Database Consolidation Solution
Provides a complete, pre-built, integrated hardware &
software solution for SQL Server database consolidation
• Pre-installed and configured software stack utilizing
Windows Server, Hyper-V, SQL Server and System Center
• Pre-built, balanced hardware components based on HP
blade servers and iSCSI storage solutions
SQL Server Private Clouds & The SQL Database Consolidation Solution
The SQL Server Database Consolidation Solution
• Provides an extremely high level of application and
environmental compatibility
• Each SQL Instance provisioned in a unique virtual machine
• Physical to virtual DB server migration imports full execution
environment
• Balanced HW & SW design allows exceptional
consolidation density
• Between 20:1 and 50:1 should be typical
• Integrated monitoring & management
• Cascading health models from HW through SW stack
• Automated servicing and patching
SQL Server Private Clouds & The SQL Database Consolidation Solution
The SQL Server Database Consolidation Solution
• Transparent automatic load balancing
• Powered by Live Migration
• Self service portal and Infrastructure provisioning
workflows
• Pre-provisioned HA for SQL instances
• Chargeback & billing measurement and reports
• SQL Instance discovery and consolidation
characterization
SQL Server Private Clouds & The SQL Database Consolidation Solution
The SQL Systems Engineering approach to
appliance design
Workload
Architecture
Hardware
Software
Workload behavior drives architecture, hardware
and software component specification.
How do appliances supply value?
Accelerate
Accelerate time to value
Design, Build & Deploy in weeks rather than months
Assess and understand workload
Design
Build
1
Evaluate alternatives
Deploy
2
3
Tune & Balance HW & SW
Deploy
4
Monitor and troubleshoot
Extract and manipulate data
Use
Generate reports
Make decisions
Monitor & Manage
Use
2
5
3
Extract and manipulate data
Generate reports
Make decisions
Integrate in environment
Burn in & Stability
Months
Load data
Proof Of Concept & Validation
Extract & load data
Stand-up in production
Build solution
Build
1
Acquire appliance
Install appliance
Design specific implementation
Acquire HW & SW components
Choose appliance for workload
4
Weeks
Design
Simplify
Integrated & Optimized
Appliance
Custom-built solution
Define architecture
Minimize
Optimize
How do appliances supply value?
Accelerate
Minimize risk
Deploy with confidence
• Proven infrastructure built on
best practices of leading experts
• Secure, compliant infrastructure
for fewer vulnerabilities
• Single, trusted source of support
for simpler resolution
Minimize
Optimize
Simplify
Workload requirements
Reference architecture
Application
software
Server, storage,
networking
Integrated and optimized by
HP and MS experts
Tested
Tuned
Validated
Pre-configured and ready to run
Single source for support
How do appliances supply value?
Simplify operations
Enhance operations and lower TCO
• Tight integration across
applications and
infrastructure
• End-to-end, integrated
management and
virtualization consoles
• Standards-based
technology adapts easily
for growth
Accelerate
Minimize
Optimize
Simplify
Integrated Management & Servicing
Provision
Manage
Allocate physical
and virtual
resources within
appliance
Control and update
devices from
anywhere
Monitor
Optimize
Get real-time insight
to resource usage
Control
performance,
consumption, and
availability
How do appliances supply value?
Optimized performance
Accelerate
Minimize
Optimize
System efficiency through balanced systems
• Optimal mix of tuned
hardware and software
• High-performance, costeffective infrastructure
• Components jointly
tested and optimized by
HP & Microsoft
• Validated in customer
environments
Simplify
The SQL Server Database Consolidation Solution: Hardware Architecture
Half Rack Configuration
The SQL DBC Solution
Hardware Architecture:
Overview
Full Rack Configuration
ProCurve 10Gbps switches
ProCurve 1Gpbs switches
HP C3000 Blade Enclosure
4x BL 465c G7 Blades (2P)
• 10Gb Flex10 Enet
HP C3000 Blade Enclosure
8x BL 465c G7 Blades (2P)
• 10Gb Flex10 Enet
Storage Blocks:
• P2000 iSCSI Disk Array
• D2700 Disk Racks
The SQL Server Database Consolidation Solution: Hardware Architecture
SQL Server Database Consolidation Solution
Connectivity Architecture
Blade Enclosure
Blade
Blade
Blade
Blade
Blade
Blade
Blade
Blade
VC Ports
2
10GbE Switch
KEY:
Base Appliance
Full Rack Appliance
10 Gbit Enet
6 Gbit SAS
P2000
MSA
3
2
2
2
10GbE Switch
User
User
Workloads
User
Workloads
Workloads
P2000
MSA
D2700
JBOD
P2000
MSA
3
VC Ports
3
D2700
JBOD
P2000
MSA
D2700
JBOD
3
D2700
JBOD
The SQL Server Database Consolidation Solution: Software Architecture
The SQL Server DBC Solution Software Architecture
The SQL Server Database Consolidation Solution: Software Architecture
Solution
Accelerators
Data Tier Monitoring and
Application Management
Components
SQL Server DBC Monitoring and Management Infrastructure
Dynamic Infrastructure
Service Level Security Compliance
Toolkit
Dashboard for SC
Manager
Management
Studio
Database
ReportingDatabaseDatabase
ReportingReportingDatabase
Components
Reporting
Components
Components
Components
SQL server
ReportingSQL server
SQL server
Services ReportingReportingSQL server
Operating
Services Services Reporting
Operating
Operating Services
System
System System Operating
System
SSIS
Integration
Packages
SQL server
Integration
Services
Operating
System
Complianc
e
Manageme
nt
Provisioning Engine
Data BaseData Base
Data
Base
Application
Data Base
Application
Application
Components
Application
Components
Components
Components
SQL serverSQL server
SQL
server
SQL server
OperatingOperating
Operating Operating System System
System System
Infrastructure
Microsoft
SharePoint Server
The SQL Server Database Consolidation Solution: Software Architecture
Centralized utility Monitoring
System Center Operations Manager
• Huge volume of MOM pack support across industry
software and hardware products
• Cascading health models from hardware level up to
specific databases
• Health models can be fully customized to specific needs
• Custom MOM packs with DBC awareness
Computer
SQL Server 1
Database 1
Database 2
SQL Server 2
Database 3
The SQL Server Database Consolidation Solution: Software Architecture
Centralized utility Monitoring
System Center Operations Manager (continued)
• Customizable monitoring views and reporting
• Web based console for remote access
The SQL Server Database Consolidation Solution: Software Architecture
Configuration & Servicing
System Center Configuration Manager
• Operating System and Application Deployment
• Integrates with Virtual Machine Manager Software Library
• Provides customizable automation and workflows
• Automates construction of slipstreamed, patched images
• Software Update management
• Integrates and orchestrates WSUS updates and patching
• Provides for automated maintenance window execution and
reporting
• Asset intelligence and license management
• Deployment and usage reporting across hardware, software
assets
The SQL Server Database Consolidation Solution: Software Architecture
Self Service Provisioning
System Center VMM Self Service Portal
• Provisioning , Administration & Self Service Portals
• Lightweight infrastructure integration and provisioning
engine
• Extensibility authoring workflow & customized user
interface
Portals
Provisioning
engine
Management
Infrastructure
Resources
The SQL Server Database Consolidation Solution: Software Architecture
Solution Accelerators
• Service Level Dashboard for System Center
Operations Manager
• Service level definitions for individual and groups of applications
• SLA compliance and tracking reports
• Security Compliance Manager
• Centralized security baseline/standards management
• Portfolio of recommended baselines
• Baseline export to GPO, DCM and SCAP standard formats
• System Center Configuration Manger SCAP Extensions
• Provides compliance support for federal Security Content
Automation Protocol
• Maps System Center DCM compliance reports to SCAP format
The SQL Server Database Consolidation Solution: Software Architecture
Service Level Dashboards for System Center
Operations manager
• Provides near real-time, end-to-end reporting on
application response times
• Simulates user interactions through synthetic transactions
• Provides reporting and status to both System Center
Operations Manager console and Web based portals
The SQL Server Database Consolidation Solution: Software Architecture
Transparent, Automated, load balancing
• Hyper-V Live Migration provides the mechanisms
• All connections are continuously maintained
• All SQL Server transactions proceed normally – no failures,
no roll backs
• Reserves can be specified around CPU, Memory, Disk IOPS,
Disk Bandwidth and Network bandwidth
• Best load balancing targets are continuously and
transparently maintained
The SQL Server Database Consolidation Solution: Consolidation & Virtualization
SQL Server Consolidation
• Historically a variety of SQL Server consolidation strategies have
been utilized.
• Typically, as isolation goes up, density goes down.
• Isolation concerns include: Instance mobility, resources
contention, name spaces, security domains, security
effectiveness
The SQL Server Database Consolidation Solution: Consolidation & Virtualization
What SQL Server Recommends for Consolidation Today
Virtual Machine Based Consolidation
• Strong isolation between applications
• Simplified and accurate billing and
• Near perfect application compatibility
chargeback mechanisms
• Minimal and rapidly diminishing
overhead cost
• Zero down time migration of execution
loads
• Online Physical to Virtual conversions
The SQL Server Database Consolidation Solution: Consolidation & Virtualization
Virtual Machine Efficiency with SQL Server
SQL Server & Hyper-V Scales With Minimal Overhead
T
o
t
a
l
C
P
U
U
t
i
l
i
z
z
t
i
o
n
• Requires Modern CPUs - SLAT (second level address
translation)
• 1% - 2% performance overhead per Virtual Machine
Measurement
Configuration
B
a
t
c
h
R
e
q
u
e
s
t
s
CPU Types
 AMD Shanghai
 SLAT support
 No IOMMU
System Information
 HP DL585 16 Cores
 HP EVA8000 SAN
 Windows 2008 R2 RC
VM Configurations
 4 Virtual Processors
 7GB RAM
 Fixed VHDs
/
System Loading
 Approximately 10%
CPU utilization / VM
S
e
c
 Relative Throughput is
normalized per VM
The SQL Server Database Consolidation Solution: Consolidation & Virtualization
The Database Application Execution environment
The SQL Server Database Consolidation Solution: Consolidation & Virtualization
The Database Application Execution Environment
• Compelling advantages to provisioning one SQL
Instance per virtual machine
•
•
•
•
Settings & configuration isolation
Resource isolation
Billing & charge back effectiveness
Resource utilization overhead is rapidly diminishing
• Consistent execution environment across SQL Server
products
• SQL Server Relational Engine
• SQL Server Integration Services
• SQL Server Analysis Services
• SQL Server Reporting
Services
The SQL Server Database Consolidation Solution: Consolidation & Virtualization
Microsoft Assessment and Planning Toolkit (MAP)
• Sophisticated, Automated discovery of SQL Server Instances
• Automated toolkit with readiness assessment for planning server
migrations
• Agent-less inventory of clients, servers, applications, devices and
hardware and device Compatibility
• Runs over defined periods and categorizes
SQL instances on the basis of CPU,
I/O and memory usage
Windows
Azure & SQL
Azure
Software
Usage Tracking
MAP
5.5
Heterogeneous
Server &
Database
Inventory
Windows
Server 2008
R2
&
Hyper-V
SQL Server
2008 R2
The SQL Server Database Consolidation Solution: Application Deployment
Application Deployment Options
Existing Application Migration
• Physical to virtual migration
• The complete existing physical execution environment
of a system is imported into a virtual machine.
• Data-tier application component extraction and
deployment
• SQL Server Management Studio provides DAC wizards
• Existing VMWare based installations can be directly
imported
Self Service Deployment
• System Center VMM Self Service Portal
• Supplies additional roles and workflows around virtual
machine and infrastructure provisioning
The SQL Server Database Consolidation Solution: Application Deployment
Workload Characterization Design Point Assumptions
Initial Research Results
Workload
Size
Percent of
mix
Virtual
processors
RAM
Disk Space
IO Ops /
sec
Small
55%
1
2 GB
100 GB
100
Medium
35%
2
4 GB
200 GB
400
Large
10%
4
16 GB
400 GB
2000
Evolving Consensus Results
Workload
Size
Percent of
mix
Virtual
processors
RAM
Disk Space
IO Ops /
sec
X-Small
55%
.25
2 GB
100 GB
10
Small
35%
1
2 GB
100 GB
50
Medium
7%
2
4 GB
200 GB
400
Large
3%
4
16 GB
400 GB
2000
The SQL Server Database Consolidation Solution
The SQL Server
Database
Consolidation
Solution
Enrol in Microsoft Virtual Academy Today
Why Enroll, other than it being free?
The MVA helps improve your IT skill set and advance your career with a free, easy to access
training portal that allows you to learn at your own pace, focusing on Microsoft
technologies.
What Do I get for enrolment?
► Free training to make you become the Cloud-Hero in my Organization
► Help mastering your Training Path and get the recognition
► Connect with other IT Pros and discuss The Cloud
Where do I Enrol?
www.microsoftvirtualacademy.com
Then tell us what you think. [email protected]
Resources
www.msteched.com/Australia
www.microsoft.com/australia/learning
Sessions On-Demand & Community
Microsoft Certification & Training Resources
http:// technet.microsoft.com/en-au
http://msdn.microsoft.com/en-au
Resources for IT Professionals
Resources for Developers
(c) 2011 Microsoft. All rights reserved.
© 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other
countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing
market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this
presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
(c) 2011 Microsoft. All rights reserved.