Download NeOSS - Microsoft

DAT201
SQL Server in the Enterprise
企业中的 SQL Server
Agenda – What we will cover
SQL Server Overview
Feature Highlights
技术要点
SQL Server Momentum in the Enterprise 企業使
用趨勢
Enterprise Customer Case Studies (企业用户案
例介绍)
Korea Telecom 韩国电信
NASDAQ 纳斯达克股票交易市场
Barnes & Noble
Questions & Answers
SQL Server Overview
1st Generation
2nd Generation
SQL Server
6.0/6.5



Differentiation
from Sybase SQL
Server
Windows
integration
First to include
Replication
Cross-release 
objectives 
SQL Server
7.0



Re-architecture of
relational server
Extensive auto
resource
management
First to include
OLAP & ETL
3rd Generation
SQL Server
2000




Performance,
scalability focus
XML support
First to include
Notification
First to include
Data Mining &
Reporting
Reliability and Security

Integrated Business Intelligence 
SQL Server
2005





High availability
Security
Developer
productivity
Native XML
First to include
Enterprise ETL and
Deep Data Mining
Lowest TCO
Best Developer Platform
AlwaysOn: High Availability for enterprise applications
Key security and performance features
Focus on self manageability and optimization
Integration with Visual Studio and .NET
Native XML technology
Interoperability via Web Services
Real time decision making: reporting, data mining
Rich client and SharePoint solutions
Comprehensive ETL solution: up to 600% faster
Note: All Higher Editions include same
functionality as the edition below it.
New for SQL Server 2005
Express
Workgroup
Standard
Fastest way for
developers to learn,
build & deploy simple
data driven applications
Easiest to use & most
affordable database
solution for smaller
departments & growing
businesses
Complete data
management & analysis
platform for medium
businesses and large
departments
Enterprise
Fully integrated data
management and
analysis platform for
business critical
enterprise applications
1 CPU
1 GB RAM
4GB DB Size
2 CPU
4 CPU
3 GB RAM
Simple
Management Tool
Management
Studio
Unlimited RAM
(64-bit)
Database Mirroring
Adv. DB mirroring,
Complete online &
parallel operations,
Report Wizard &
Report Controls
Import/Export
OLAP Server
DB snapshot
Limited Replication
Publishing
Reporting Server
Advanced Analysis
Tools including full
OLAP & Data
Mining
Replication &
SSB Client
Back-up Logshipping
Reporting Server
New Integration
Services
Data Mining
Full Replication &
SSB Publishing
Unlimited Scale
+ Partitioning
Customized & High
Scale Reporting
Adv SSIS
SQL Server Momentum
in the Enterprise
Source:
SQL Server in the Enterprise
Winter Corp Top Ten 2005
Survey of largest databases in the world (Aug 2005)
43 SQL Server entries over 1 TB, 25% of all entries
11 TB+ entries on SQL Server 2005 live by launch
6 winners in Top Ten categories for All Platforms
3rd largest OLTP db by rows, 50 billion rows & 7.8 TB
8th largest DW database in the world, 19.5 TB of data
Won & dominated all Windows DB size categories
SQL Server Metrics
Top Ten
2005
Top Ten
2003
#Terabyte+ Entries (> 1 TB)
43
15
#DW Entries
22
4
#OLTP Entries
21
13
#OLTP Entries in Top Ten categories for All Platforms
4
1
#DW Entries in Top Ten categories for All Platforms
2
0
#DW Entries in DB Size Top Ten for Windows
7
1
Top Scale SQL Server
Mission Critical OLTP Apps
Runs Peoplesoft ERP Suite on SQL Server
High intensity OLTP
7.8 TB & 50B rows in single DB, Winter Corp winner
50 TB+ of data total,13,000 customer service reps
GLOSS financial system, Sybase migration
2 TB OLTP instance, 2000 stored procedures
Full range of telecom systems, developed in VS.Net
Terabytes of data, Several 64-way HP Superdomes
1000+ TPS application, 1 TB of data, Oracle migration
Real-time manufacturing app, runs all WD output
US Dept of Agriculture runs PeopleSoft ERP Suite
75K employees, 500 GB database, high concurrency
Top Scale SQL Server
TB+ Data Warehouse & BI
20 TB European digital payment archive system
Unisys Payments Services Archive
13 TB Geospatial DW, to reach 25 TB
4 TB data mart, 2500 field offices, 55 TB storage
1.5 TB DW, plus multiple OLAP data marts
Data feeds from JD Edwards ERP system
1 TB DW, Informix migration
Heavy concurrent usage on OLAP
1.7 TB DW, 2900 DW users ramping up to 5000
Runs on HP Superdome
6 TB Call Detail Record (CDR) DW, OLAP usage
20-way HP Superdome
Top Scale SQL Server
Major SAP Deployments
China Light & Power runs mySAP suite on SS2005
10 TB of total data, 500 concurrent users
8 TB SAP R/3, 1500 conc users, Unisys 16-way
3 TB Business Warehouse system
Shell Lubricants (+ Penzoil/Quaker State)
2 TB database, 1800 conc user + SQL Server BI
Top computer retailer in USA
.5 TB in SAP, SQL Server also as strategic BI platform
$23 Bil photo products company
Worldwide SAP implementation, now on SS2005
38,000 employees, 2 x 32-way Unisys ES7000
1 TB+ db, 5 TB Storage, 2000 concurrent users
Top Scale SQL Server 2005
Mission Critical Apps Live Today on SQL Server 2005
Fixed Income Trading System running on SS2005
30% performance increase, 1,000 trades / second
Runs airline scheduling services operations
High intensity OLTP on SQL Server 2005
Market Data Dissemination System, runs on SS2005
5K transactions / second, 100K queries / day
Web hosted solution
Managing 7 million transactions per day
World’s largest online grocery retailer
Runs web-site on SS2005 and VS.Net 2005
2nd largest Shipping Co in the word, 160 countries
15 Bil transactions per year, 5 TB of data
Top SQL Server 2005
TB+ Data Warehouse & BI Live Today on SQL Server 2005
5 TB Retail Data Warehouse on HP Superdome
Uses SQL Server OLAP, SSIS, SSRS
6 TB retail data warehouse from 700 stores, OLAP, RS
15 TB total across multiple instances
5.3 TB Credit Card DW, 5 Mil card holders
300 users, OLAP, SSIS, SSRS, Office BSM
5 TB retail DW, 10 TB storage, data from 1000 stores
Largest retailer in African continent, OLAP, RS, DTS
4 TB Consumer Packaged Goods (CPG) DW
350 users, complex relational query, SSIS & SSRS
2 TB DW, originally migrated from Informix
300 users, complex query, OLAP & Data Mining
SQL Server Customer Advisory Team
Part of SQL Server product team
Senior DB architects each with 10+ years of enterprise development
and deployment experience
World-wide coverage – US, EMEA, Asia
Howard Yin –APAC
Nicholas Dritsas (BI) – APAC
Ex member - Prakash Sundaresan - APAC
Work with largest, most complex SQL Server projects worldwide
Architecture and design reviews
Project risk mitigation
Create and share best practices with community
http://blogs.msdn.com/sqlcat
You will see us at PASS & TechEd
Drive enterprise requirements back into product
SQL Server Customer Advisory Team
Engagement Profile
Last year – 10-20 TB databases; 50,000+
transactions/sec; AS with 50+ GBs of cube sizes
Currently – 20-100 TB databases; 100,000+
transaction/sec; AS with 100+ GBs of cube sizes;
10,000+ reporting service users
Sample Active Engagements
Major high-speed railway operation environment with
0 downtime and guaranteed execution time
Core banking environment with extremely high
availability requirements
Major stock exchange trading platform
Korean Telecom
Enterprise Case Study
韩国电信案例介绍
KT - Customer Profile and Situation
Largest TelCo in South Korea
26 million+ customers – residential and business
65,000 employees
Diverse product set:
Fixed-line, IP, wireless telephony;
Wired and wireless internet
Web storage, Integrated e-business, Next-generation Network (NGN)
Changing Customer Environment
Growing Competition
Changing Landscape of Services: Wireless, Internet, …
End-customer (consumer) expects simple, integrated offerings
Create new revenue streams, roll out services quickly and reliably
Pain-points with previously existing Operations Support
System (OSS)
Decentralized – one system per province
Not flexible – hard to implement new functions
Expensive – licensing, maintenance, development costs
KT - Solution
Build a New OSS (NeOSS) solution from scratch
Centralize and eliminate per-province systems
Modern service-oriented architecture (SOA)
Built using a modern application platform:
Windows Server 2003 (DataCenter and Enterprise Editions)
SQL Server 2000 Enterprise Edition (64-bit)
Biztalk Server 2004
Visual Studio.Net 2003
Operations Manager 2005
Windows Mobile 2003
First tier-1 Telco to run core OSS system on
100% Microsoft platform
KT NeOSS Modules
Service Ordering (SO)
Integrated service ordering function - manages workflows amongst the network
domain and controls
Service Assurance (SA)
Integrated trouble-ticket reception and processing for customer complaints
Facility Management (FM)
Manages facility information of all domains: access network, data network,
transmission network, switching network, etc.
Access Domain Manager (ADM)
Service provisioning and maintenance
Workforce Management (WM)
Schedules work plans, dispatches necessary information to PDAs for
repair/installation field engineers
Service Level Agreement (SLA)
Handles the quality guarantees for various services
Network Management (NM)
Manages network components
KT NeOSS - Architecture
BSS
Subscription
Registry
Subscription
Order
Entry
Problem Report
NeOSS-SO
Service Configuration
Management
Integrated Order
Management
NeOSS-SA
Service Problem Management
.
Customer
Network
Care
Test
Trouble
Management
Ticketing
Provisioning
Management
NeOSS-CSG
Service Quality and
Operation Information Management
SLA
Management
Network DW
Service QOS
Management
Network/Planning
Engineering
EAI Information Bus (Biztalk Server)
NeOSS-FM
Facility
Management
Inventory
Management
Service
Resource
Management
NeOSS-WM
Workforce
Management
NeOSS-ADM
Access Domain Manager
NeOSS-NM
Network Management
Service Provision
Work
Scheduling
Management
Service Maintenance
Field work
Management
Access Domain
Domian
Network management
Network
Network
Network
Element
Activation
Fault
Performance
Management Management Management Management
KT NeOSS – Interesting System
Facts
Data Size
28 TB of SAN storage
15 TB of system data across all modules
Processing
280,000 orders / day
150 million SQL transactions / day
20,000 peak SQL transactions / sec across all modules
Logic
Application logic split over mid-tier and database tier
Close to 10,000 stored procedures total
DB Hardware Platform
4 pairs of 64-way, 64-bit, 256 GB RAM HP Superdomes
Using MSCS for High-availability
Several other pairs of 32-way 64-bit 256 HP Superdomes for
smaller modules and Biztalk Server
KT Project Structure and Benefits
Project Structure and Duration
Started in January 2003
100 KT engineers, 200 3rd-party system integrator (SI), 20 Microsoft
Consulting Services (MCS) resources
Local resources, with help from Singapore and Redmond as necessary
Development completed in 18 months
Phased roll-out across in 6 stages over a period of 12 months
Benefits
Single, unified OSS system – greater agility, more flexibility and reduced
management overhead
Cost savings of around US$90 million / year
Now looking at Data Warehouse solution for Business Insight
For more details, see
http://members.microsoft.com/CustomerEvidence/Common/FileOpen.as
px?FileName=7718_KT___SQL_Server_2000_Case_Study.doc or
search for ‘KT’ on http://www.microsoft.com/sql/prodinfo/casestudies
NASDAQ
Enterprise Case Study
纳斯达克案例介绍
“The fact that we can move mission critical applications from
Tandem to SQL Server 2005 proves that it is enterprise-grade.”
Ken Richmond, Vice President for Software Engineering, NASDAQ
Largest US electronic
stock market
Replacing aging
Tandem systems
Wanted to update
system for real-time
trade summary, risk
management, and
broker clearing
MDDS: Market Data
Dissemination System
5K txs / second,
100K queries / day
Running on
SQL Server 2005 with
database mirroring for
high availability
Enterprise availability
Scalability to handle
8 million new rows of
data per day
Lower total cost of
ownership
Real-time reporting
Developer agility
NASDAQ Market Data Feed System
Customer & Project Profile
Scenario/Business
Market Data feed system – key component of NASDAQ revenue
Part of Super Montage set of services around trading data
Data directly from trading system, used for order-display app (TotalView)
90,000 paying feeds (vendors or brokerage houses)
Migrated from in-memory design on Tandem, live since July 2002
In 2004 moved second quote system to SQL Server (NQDS)
Achieved great cost savings and programming versatility
Workload/Architecture
5000-8000 quotes/second design criteria (each a stored proc)
32K inserts design criteria, 12-14K in recent peaks
Increasingly more ambitious latency goals (initial goal: 1 sec, now @ 200 ms)
50-100 GB of data, flushed daily, archived for 14-days
20 million records pass-through/day typical. 6 mil for NQDS.
3-tier processing: app servers > DB servers > app servers
All data passes through both DB systems
Scale-out app servers partitioned by security
DB Platform: SS2000 on WS2000 on Dell 4-way
NASDAQ SuperMontage Feeds
System Architecture
Windows Gateway
MSMQ
3 Channels
Windows Gateway
Backup
MSMQ
(4 processors)
3 Channels
Primary
(4 processors)
Windows Gateway
MSMQ
Windows Gateway
3 Channels
MSMQ
Backup
3 Channels
(4 processors)
Primary
(4 processors)
Microsoft SQL Server 2000 Database Cluster
Business Logic
Microsoft SQL Server 2000
(4 processors)
Vendor Output
Microsoft SQL Server 2000
(4 processors)
Cache Tables
Windows Multicast
Disseminator
2 Channels (2 processors)
Disseminator
Backup Channels (2 processors)
Transmission
Tables
Windows Multicast
Disseminator
2 Channels (2 processors)
Disseminator
Backup Channels (2 processors)
Windows Multicast
Disseminator
2 Channels (2 processors)
Disseminator
Backup Channels (2 processors)
NASDAQ
SuperMontage
TotalView system
architecture
(previously named
PrimeFeed)
Barnes & Noble
Enterprise Case Study
连锁书店数据仓库案例介绍
Barnes & Noble Retail DW
Customer & Project Profile
Scenario/Business
Largest bookseller in the USA, 850 stores, plus online
40K employees, 1.5 mil titles across all stores
Retail Data Warehouse
End-to-end use of SQL Server BI, DW & AS cubes
Moved relational DW to SQL Server 2005 on June CTP
First went live with SQL Server Integration Services in 2004
Loading Data from mostly Oracle sources
Workload/Architecture
2 TB sales & inventory data warehouse on SQL Server 2000
Currently holds 3 years of transactions, will build up to 5 years
SSIS using Slowly Changing Dimension transforms & lookups
SS2005 Reporting Services used for primary reporting
AS2005 Data Mining prediction using Decision Trees
AS2K OLAP: Store sales/inventory, Distribution Center inventory
Key Dim: Store, Item, Time, Demographic, Buyer, Vendor, Customer
DB Platform
Windows Server 2003 64-bit
HP Superdome w/20 CPU partition for DW, 20 TB EMC SAN
Live on SS2005!
Barnes & Noble Retail DW
Production Environment
Barnes & Noble Retail DW
Data Warehouse Architecture
Live on SS2005!
Oracle
SRS
database
POS transactions
Dimension
Updates
Inserts / Updates
Staging
database
IS
IS
Relational
data
warehouse
Inventory deltas
Oracle
IMM
database
Sales
Store
inventory
Proclarity
interactive
reports
Distr.
Center
inventory
Reporting
Services
reports
Strategy
Question
& Answers
Related Session
DAT100 微软的数据平台构想
DAT313 SQL Server 永不停顿技术：构架稳定，
可恢复和可靠系统的最佳实践
DAT323 微软新武器挑战数据的价值极限
DAT414 SQL Server 永不停顿技术：针对人为错
误的灾难恢复策略
DAT330 快速简便地从 Oracle，Sybase 迁移到
SQL Server
DAT211 SQL Server 永不停顿技术：选择正确的
高可用性解决方案
DAT321 端到端商业智能
DAT201 企业中的 SQL Server