Download SSIS - Prodata Blog

28th Sept, 2013
Migrating to Azure and the Cloud
Bob Duffy
Database Architect
Prodata SQL Centre of Excellence
Speaker Bio – Bob Duffy
•
•
•
•
•
•
•
20 years in database sector, 250+ projects
Senior Consultant with Microsoft 2005-2008
One of about 25 MCA for SQL Server globally (aka SQL Ranger)
SQL MCM on SQL 2005 and 2008
SQL Server MVP 2009+
SSAS Maestro
Database Architect at Prodata SQL Centre of Excellence
•
•
http://blogs.prodata.ie/author/bob.aspx
[email protected]
@bob_duffy
What we Will Cover
What is Azure
Our “Enterprise” Application to Migrate
Migrating to Infrastructure as a Service
Migrating to Platform as a Service
Migrating your data tier
Migrating your app tier
Infrastructure
Fabric
Services
What is the Microsoft Cloud: Azure
..
.
virtual
machines
..
.
web sites
..
.
cloud
services
SQL
database
Automated
Elastic
Managed
Usage Based
Resources
N Central US, S Central US, N Europe, W Europe, E
Asia, SE Asia + 24 Edge CDN Locations
..
.
noSQL
database
..
.
blob storage
connect
..
.
virtual
network
traffic
manager
Fabric
Option 1 – Infrastructure as a Service (IaaS)
..
.
virtual
machines
Web App
OLTP
..
.
web sites
..
.
cloud
services
SQL
database
..
.
noSQL
database
..
.
blob storage
connect
..
.
virtual
network
traffic
manager
IaaS Costs Per Month
COMPUTE
CORES RAM
INSTANCE NAME
BASE
WINDOWS
SQL WEB
SQL STANDARD
SQL ENTERPRISE
Shared (A0)
1
1.75 GB
15
48
424
1,576
Small (A1)
2
3.5 GB
67
100
476
1,629
Medium (A3)
4
7 GB
134
167
543
1,696
Large (A4)
4
7 GB
268
301
677
1,830
Extra Large (A7)
8
56GB
1,518
1,518
2,336
4,643
Egress Costs (outgoing)
11.40 per 100GB in NA and Europe
$18.05 per 100GB other locations
Top package is over $55k a year
Pre pay schemes can bring cost down by ~30%
New High Memory options available (Sept 2013)
The IaaS performance story
Scaling OLTP Workload with IaaS
30,000
25,913
25,000
20,000
15,000
11,658
10,120
10,000
6,100
5,000
3,400
0
My Laptop
4 Core VM (Private)
1
2
Cores
OPM
4
8
OPM
20,000
Fabric
Option 2 – Cloud Services
..
.
virtual
machines
..
.
web sites
..
.
cloud
services
SQL
database
..
.
noSQL
database
Web Role
Service Definition
Worker
Role
Web App
OLTP
..
.
blob storage
connect
..
.
virtual
network
traffic
manager
Fabric
Option 3 – Web Sites (PaaS)
..
.
virtual
machines
..
.
web sites
..
.
cloud
services
Web Site
SQL
database
..
.
noSQL
database
Web Site
OLTP
Web Site
Web App
..
.
blob storage
connect
..
.
virtual
network
traffic
manager
Windows Azure SQL Databases (WASD)
(AKA SQL Azure)
Applications use standard SQL
client libraries: ODBC,
ADO.Net, PHP, …
Application
Internet
Azure
Cloud
TDS (tcp)
Security Boundary
Load balancer forwards ‘sticky’
sessions to TDS protocol tier
LB
TDS (tcp)
Gateway
Gateway
Gateway
Gateway
Gateway
Gateway
Gateway: TDS protocol gateway, enforces AUTHN/AUTHZ policy; proxy to backend SQL
TDS (tcp)
SQL
SQL
SQL
SQL
SQL
SQL
Scalability and Availability: Fabric, Failover, Replication, and Load balancing
Objects NOT Supported
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Heap Table Types
Change Data Capture
Data Auditing
Data Compression
Extended Events
Extension of spatial types and
methods through Common
Language Runtime (CLR)
External Key Management /
Extensible Key Management
FILESTREAM Data
Integrated Full-Text Search
Large User-Defined Aggregates
(UDAs)
Large User-Defined Types (UDTs)
Performance Data Collection (Data
Collector)
Policy-Based Management
Resource Governor
USE X
Extended Properties
• Extended Stored Procedures
• SQL Server Agent/Jobs
• Common Language Runtime (CLR)
and CLR User-Defined Types
• Database Mirroring
• Trace Flags
• System Tables
• Service Broker
• Table Partitioning
• Typed XML and XML indexing is not
supported.
• (The XML data type is supported by
SQL Azure Database)
• Global Temporary Tables
• Sp_configure
• SQL Server Replication
• Transparent Data Encryption
• SQL Server PowerShell Provider
• Backup and Restore
• Replication
• File Groups
Common Tools for Schema Migration
Dacbac built into SSMS
Migration Wizard (Codeplex)
Generate TSQL Script
SSDT (Visual Studio)
Common Tools for Data Migration
BACPAC
Deploy to Azure Wizard in SSMS
BCP
SSIS
Third Party Tools
Pricing and Sizes
Size
$/Month Monthly Costs for 50GB
Comparing
2,000
0-100MB
1,830
4.995
1,800to 1GB
Up
9.99
1-10GB
1,600
3.996 per GB over 1
10-50GB
1,400
45.95 for first 10GB
1.996 per GB after that
1,200
50-150GB
125.874 for 50GB
0.999 per GB after that
1,000
800
677
*600
Plus Egress Network traffic costs
400
200
125
6.25
4.77
0
50GB
4 Core IaaS EE
4 Core IaaS STD
WASD 50GB
NoSQL (replicated)
NoSQL
WASD – The Performance story
OPM – Orders Per Minute
16,000
15,233
14,000
12,000
13,112
11,658
10,000
8,000
6,000
4,000
2,000
0
CPU
IaaS (Full Text)
Iaas with Cache
SQL Azure with Caching
Why is WASD slightly slower than IaaS?
In IaaS we hit a wall with disk performance
In WASD slightly earlier wall
Caused by change in table design (latch contention)
Option 3 – Scalability Next Steps
Co-located
Cache
Web Role
Web Role
Worker
Role
SQL
SQL
Database
Database
Dedicated
Cache
Call to Action and Win a Prize
If you have MSDN you can get €150/month free credit
Use this link or one on my blog
http://bit.ly/140w35v
Thank You
Resources
SQL Azure Delivery Guide
http://social.technet.microsoft.com/wiki/contents/articles/3398.sql-azure-delivery-guide-en-us.aspx
Business Continuity in SQL Azure
http://msdn.microsoft.com/en-us/library/windowsazure/hh852669.aspx
SQL Azure Data Sync Best Practices
http://social.technet.microsoft.com/wiki/contents/articles/2172.sql-azure-data-sync-bestpractices.aspx
SQL Azure Logic for Transient Failures
http://social.technet.microsoft.com/wiki/contents/articles/4235.retry-logic-for-transient-failures-insql-azure-en-us.aspx
SQL Azure Performance and Elasticity Guide
http://social.technet.microsoft.com/wiki/contents/articles/3507.windows-azure-sql-databaseperformance-and-elasticity-guide.aspx
The ROI Argument
Efficiency v Control