* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Download SSIS - Prodata Blog
Survey
Document related concepts
Extensible Storage Engine wikipedia , lookup
Entity–attribute–value model wikipedia , lookup
Concurrency control wikipedia , lookup
Oracle Database wikipedia , lookup
Ingres (database) wikipedia , lookup
Tandem Computers wikipedia , lookup
Microsoft Access wikipedia , lookup
Team Foundation Server wikipedia , lookup
Microsoft Jet Database Engine wikipedia , lookup
Database model wikipedia , lookup
Clusterpoint wikipedia , lookup
Relational model wikipedia , lookup
Open Database Connectivity wikipedia , lookup
Transcript
28th Sept, 2013 Migrating to Azure and the Cloud Bob Duffy Database Architect Prodata SQL Centre of Excellence Speaker Bio – Bob Duffy • • • • • • • 20 years in database sector, 250+ projects Senior Consultant with Microsoft 2005-2008 One of about 25 MCA for SQL Server globally (aka SQL Ranger) SQL MCM on SQL 2005 and 2008 SQL Server MVP 2009+ SSAS Maestro Database Architect at Prodata SQL Centre of Excellence • • http://blogs.prodata.ie/author/bob.aspx [email protected] @bob_duffy What we Will Cover What is Azure Our “Enterprise” Application to Migrate Migrating to Infrastructure as a Service Migrating to Platform as a Service Migrating your data tier Migrating your app tier Infrastructure Fabric Services What is the Microsoft Cloud: Azure .. . virtual machines .. . web sites .. . cloud services SQL database Automated Elastic Managed Usage Based Resources N Central US, S Central US, N Europe, W Europe, E Asia, SE Asia + 24 Edge CDN Locations .. . noSQL database .. . blob storage connect .. . virtual network traffic manager Fabric Option 1 – Infrastructure as a Service (IaaS) .. . virtual machines Web App OLTP .. . web sites .. . cloud services SQL database .. . noSQL database .. . blob storage connect .. . virtual network traffic manager IaaS Costs Per Month COMPUTE CORES RAM INSTANCE NAME BASE WINDOWS SQL WEB SQL STANDARD SQL ENTERPRISE Shared (A0) 1 1.75 GB 15 48 424 1,576 Small (A1) 2 3.5 GB 67 100 476 1,629 Medium (A3) 4 7 GB 134 167 543 1,696 Large (A4) 4 7 GB 268 301 677 1,830 Extra Large (A7) 8 56GB 1,518 1,518 2,336 4,643 Egress Costs (outgoing) 11.40 per 100GB in NA and Europe $18.05 per 100GB other locations Top package is over $55k a year Pre pay schemes can bring cost down by ~30% New High Memory options available (Sept 2013) The IaaS performance story Scaling OLTP Workload with IaaS 30,000 25,913 25,000 20,000 15,000 11,658 10,120 10,000 6,100 5,000 3,400 0 My Laptop 4 Core VM (Private) 1 2 Cores OPM 4 8 OPM 20,000 Fabric Option 2 – Cloud Services .. . virtual machines .. . web sites .. . cloud services SQL database .. . noSQL database Web Role Service Definition Worker Role Web App OLTP .. . blob storage connect .. . virtual network traffic manager Fabric Option 3 – Web Sites (PaaS) .. . virtual machines .. . web sites .. . cloud services Web Site SQL database .. . noSQL database Web Site OLTP Web Site Web App .. . blob storage connect .. . virtual network traffic manager Windows Azure SQL Databases (WASD) (AKA SQL Azure) Applications use standard SQL client libraries: ODBC, ADO.Net, PHP, … Application Internet Azure Cloud TDS (tcp) Security Boundary Load balancer forwards ‘sticky’ sessions to TDS protocol tier LB TDS (tcp) Gateway Gateway Gateway Gateway Gateway Gateway Gateway: TDS protocol gateway, enforces AUTHN/AUTHZ policy; proxy to backend SQL TDS (tcp) SQL SQL SQL SQL SQL SQL Scalability and Availability: Fabric, Failover, Replication, and Load balancing Objects NOT Supported • • • • • • • • • • • • • • • • Heap Table Types Change Data Capture Data Auditing Data Compression Extended Events Extension of spatial types and methods through Common Language Runtime (CLR) External Key Management / Extensible Key Management FILESTREAM Data Integrated Full-Text Search Large User-Defined Aggregates (UDAs) Large User-Defined Types (UDTs) Performance Data Collection (Data Collector) Policy-Based Management Resource Governor USE X Extended Properties • Extended Stored Procedures • SQL Server Agent/Jobs • Common Language Runtime (CLR) and CLR User-Defined Types • Database Mirroring • Trace Flags • System Tables • Service Broker • Table Partitioning • Typed XML and XML indexing is not supported. • (The XML data type is supported by SQL Azure Database) • Global Temporary Tables • Sp_configure • SQL Server Replication • Transparent Data Encryption • SQL Server PowerShell Provider • Backup and Restore • Replication • File Groups Common Tools for Schema Migration Dacbac built into SSMS Migration Wizard (Codeplex) Generate TSQL Script SSDT (Visual Studio) Common Tools for Data Migration BACPAC Deploy to Azure Wizard in SSMS BCP SSIS Third Party Tools Pricing and Sizes Size $/Month Monthly Costs for 50GB Comparing 2,000 0-100MB 1,830 4.995 1,800to 1GB Up 9.99 1-10GB 1,600 3.996 per GB over 1 10-50GB 1,400 45.95 for first 10GB 1.996 per GB after that 1,200 50-150GB 125.874 for 50GB 0.999 per GB after that 1,000 800 677 *600 Plus Egress Network traffic costs 400 200 125 6.25 4.77 0 50GB 4 Core IaaS EE 4 Core IaaS STD WASD 50GB NoSQL (replicated) NoSQL WASD – The Performance story OPM – Orders Per Minute 16,000 15,233 14,000 12,000 13,112 11,658 10,000 8,000 6,000 4,000 2,000 0 CPU IaaS (Full Text) Iaas with Cache SQL Azure with Caching Why is WASD slightly slower than IaaS? In IaaS we hit a wall with disk performance In WASD slightly earlier wall Caused by change in table design (latch contention) Option 3 – Scalability Next Steps Co-located Cache Web Role Web Role Worker Role SQL SQL Database Database Dedicated Cache Call to Action and Win a Prize If you have MSDN you can get €150/month free credit Use this link or one on my blog http://bit.ly/140w35v Thank You Resources SQL Azure Delivery Guide http://social.technet.microsoft.com/wiki/contents/articles/3398.sql-azure-delivery-guide-en-us.aspx Business Continuity in SQL Azure http://msdn.microsoft.com/en-us/library/windowsazure/hh852669.aspx SQL Azure Data Sync Best Practices http://social.technet.microsoft.com/wiki/contents/articles/2172.sql-azure-data-sync-bestpractices.aspx SQL Azure Logic for Transient Failures http://social.technet.microsoft.com/wiki/contents/articles/4235.retry-logic-for-transient-failures-insql-azure-en-us.aspx SQL Azure Performance and Elasticity Guide http://social.technet.microsoft.com/wiki/contents/articles/3507.windows-azure-sql-databaseperformance-and-elasticity-guide.aspx The ROI Argument Efficiency v Control