Download Oracle's HA Vision

1
Oracle’s High-Availability Vision:
What’s New in Oracle Database 11g Release 2
Juan Loaiza
Senior Vice President, Oracle System Technology
Oracle High Availability Architecture
1. Scale-Out & Low-Cost
–
–
High-volume hardware
All components active
2. Application Oriented
–
–
Protect and recover application objects
Enable online application changes
3. Integrated & Simple
–
–
Availability integrated into all components
Automated
4. Complete & Open
–
–
Handles all planned and unplanned downtime
Pluggable components
3
Oracle’s Database HA
Unplanned
Downtime
Server
Failures
Data
Failures
System
Changes
Planned
Downtime
Data
Changes
App
Changes
4
Best-of-Breed Server Protection
At Lowest Cost
Unplanned
Downtime
Server
Failures
Real Application
Clusters (RAC)
Data
Failures
System
Changes
Planned
Downtime
Data
Changes
App
Changes
5
Real Application Clusters
HR
•
•
•
•
SALES
ERP
Scale workloads across multiple low cost servers
Consolidate into fewer servers and databases
Runs all Oracle database applications
Built-in HA
6
New in 11.2
RAC One Node
Virtualization Benefits for Oracle Databases
• A virtualized single instance database
– Omotion - live migration of instances
across servers
• Move services, then shutdown
transactional
– Built-in cluster failover for high availability
• Better than OS level virtualization
– Rolling database patches
– Manage fewer Operating Systems
• 10 DBs on a node does not mean 10
Operating Systems to manage
– Rolling OS upgrades
7
Best-of-Breed Data Failure Protection
At Lowest Cost
Unplanned
Downtime
Server
Failures
Data
Failures
Human
Errors
Data
Corruptions
Storage
Failures
System
Changes
Planned
Downtime
Data
Changes
Site
Failures
Flashback
RMAN
Oracle Secure
Backup
ASM
Data Guard
Streams
App
Changes
8
Traditional
Recovery
Flashback Technologies
80
• Flashback revolutionizes error recovery
– View ‘good’ data as of a past point-in-time
– Simply rewind data changes
– Time to correct error equals time to make error
Recovery Time
Error Detection & Correction
60
40
20 Flashback
0
Correction Time = Error Time + f(DB_SIZE)
• Low impact, easy – simple commands, no complex procedure
• Flashback Query, Table, Transaction, Database, Drop
• SQL> flashback database to <timestamp>;
• Enhancements in 11.2:
New in 11.2
• Flashback database performance & monitoring optimizations
• Flashback archive support for schema evolution
9
Oracle Backup & Recovery
Integrated Disk, Tape & Cloud Backup
Oracle Enterprise
Manager
• Recovery Manager (RMAN) manages
Database Backup & Recovery
Oracle Secure
Backup
RMAN
Tape Drive
• Intrinsic knowledge of database file
formats and recovery procedures
• Block validation
• Online block-level recovery
• Unused block compression
• Online, multi-streamed backup
• Native encryption
Fast Recovery
Area
Data Files
Cloud
10
New in 11.2
Multiple RMAN Compression Levels
More Cost Savings
• Backup compression: popular way to save
on storage
• Multiple RMAN backup compression levels
– Choose between compression levels & backup
throughput
• [BASIC] | HIGH | MEDIUM | LOW
11
Oracle Secure Backup
Enterprise Tape Backup Management
Oracle Enterprise
Manager
Oracle Secure Backup
File System Data
Tape Backup for
Oracle Environment
Oracle Database
• Built-in Oracle Integration
RMAN Integration
• 25 – 40% faster than
leading competition
• 4X less expensive
Tape
Library
Virtual
Tape
Library
(VTL)
than comparable products
• Supports Oracle Database
11g through Oracle9i
12
Oracle Secure Backup Cloud Module
Offsite Database Backups in the Cloud
Database Files /
Fast Recovery Area
RMAN
Compression /
Encryption
Oracle Secure
Backup Cloud
Module
Amazon S3
• Oracle Secure Backup Cloud module: Backup databases to Amazon
Cloud
– Complements local disk and/or tape backup
– Eliminates IT management overhead of a disaster recovery site
13
Automatic Storage Management (ASM)
Stores & Manages All Data
Database
Application
3rd Party FS
ASM
Disk
Group
•
•
•
•
ASM dynamic volume manager supports file systems
ASM directly supports Clusterware files – Cluster Repository, Voting Disk
Built-in mirroring protects from disk failures
Enables auto-repair from corrupt blocks using a valid mirror copy
14
New in 11.2
ASM Cluster File System
Oracle Management of File System Data
• Manage both database & file system data
– E.g.: Oracle & Application binaries, trace
files, alert logs, BFILEs, image files, etc.
• Clustered or local file system
– Data stored in ASM
– Inherits all ASM manageability benefits
• Online disk add/drop/rebalance
• Integrated mirroring
• Cross-platform
Shared File System
• Read-Only Snapshots
– Up to 63 point-in-time space efficient
copies of file system
• Linux and Windows only in first release
15
Active-Active Availability
Minimizing Downtime During Site Failures
Unplanned
Downtime
Server
Failures
Data
Failures
Human
Errors
Data
Corruptions
Storage
Failures
Site
Failures
Data Guard
GoldenGate
Streams
16
Oracle Data Guard
Best Disaster Recovery
Physical
Standby
Dallas
Sync or Async
Redo Shipping
Production
Database
Open R/O with
Active Data Guard
Redo
Apply
Network
Backup
DIGITAL DATA STORAGE
DIGITAL DATA STORAGE
Broker
Chicago
Logical
Standby
Transform
Redo to SQL
SQL
Apply
Open R/W for
peripheral writes
Boston
17
New in 11.1
Active Data Guard
Offload Queries to Standby
Real-time
Queries
Continuous Redo
Shipment and Apply
Primary
Database
Concurrent
Real-Time
Query
Physical
Standby
Database
• Queries on standby database concurrent with apply
• Available with Physical Standby in 11.1
– Handles all data types, very fast, operationally simple
• Eliminates cost of DR
– All hardware used for production load
18
New in 11.2
Oracle Active Data Guard
Read Scalability, with DR
Queries
Updates
Scalable Reader
Farm
Queries
Queries
Queries
Production
Database
• Up to 30 active
standby databases
• Flexible options to
scale read
performance
• Add more active
standby databases
• Scale active standby
databases using
Oracle RAC
19
New in 11.2
Oracle Active Data Guard
Auto Block Protection
• Automatically repair block corruptions online
• Primary repaired from standby and vice-versa
Real-time
Reporting
Read/Write
Workload
Primary
Database
Continuous redo shipping validation & apply
Active Standby
Database
20
New in 11.1
Snapshot Standby
Test with Production Data Before Deployment
Physical Standby
Apply Logs
Open
Database
Back out
Changes
Snapshot Standby
Perform Testing
Continuous Redo Shipping
• Use Standby Database for testing
and development
– Eliminates cost of DR
– Justify full scale test and DR
environments by combining into one
• Preserves zero data loss while in
test/dev mode
– But no real time query or fast failover
• Similar to storage snapshots, but:
– Provides DR at the same time
– Single copy of storage
21
New in 11.2
Oracle Data Guard
Better Application Availability
• Automate client failover with role-based services and FAN
Auto-start of
primary
database
services
FAN
enabled
JDBC
and OCI
clients
Wide Area Network (ASYNC)
Primary
Database
Fast notification
of application
clients
Standby
New
Primary
Database
22
New in 11.2
Oracle Active Data Guard
Ensure Service Levels for Query Latency
• Automatically enforce service levels for standby queries
• Query receives error if data delay exceeds SLA
• Applications can redirect query to primary
Real-time
Reporting
Read/Write
Workload
Primary
Database
Continuous redo shipping validation & apply
Active Standby
Database
23
New in 11.2
Additional Data Type Support
Both Data Guard SQL Apply & Streams
• Additional Data Type support:
– Basic Table Compression
– OLTP Table Compression
– SecureFiles
• Without deduplication
– Online Table Redefinition
– Extended data type support for SDO_GEOMETRY (SQL Apply)
24
Comprehensive Data Guard Monitoring
Using Enterprise Manager 10g Release 5
• Critical Data Guard metrics reported on HA console
25
Oracle Streams
Built-in Oracle Database Replication Solution
Source
Database
Target
Database
Propagate
Redo
Logs
Capture
Apply1
Apply2
• Active-active databases with automatic
conflict detection & optional resolution
• Provides HA for custom apps where update
conflicts can be avoided or managed
Transparent
Gateway
Non-Oracle
Database
26
New in 11.2
XStream
Fast Real-Time Programmatic Access to Data Changes
• Extended Streams - XStream
– API for fast real-time access to changes in Oracle database
– Client attaches directly to Streams apply process using OCI/Java
– Outbound server (XStream Out)
• Stream changes out of the Oracle database
– Inbound server (XStream In)
• Stream changes from external
sources into an Oracle database
XStream
27
New in 11.2
Better Streams Performance
• Performance optimizations of uni-directional Streams extended
to one-to-many
• Faster transformations
– Statement DML Handlers
• Up to 4x faster than procedural DML handlers
– New Declarative Transformation - Keep Columns
• Extensive tuning throughout Streams
• Improved JMS integration and faster Streams Advanced
Queuing
– AQ dequeue is 30%-100% faster than previous releases
28
GoldenGate
• Best-in-class leader in real-time data solutions
• Continuous Availability for heterogeneous
systems
• Real-time data access for Reporting
• Real-time data for BI, EPM, Exadata
• Zero-downtime migrations / upgrades to Oracle
Database and Applications
Real-time
information
Real-time Access
• Over 400 customers with 4,000+ implementations
across Fortune 500 companies: Financial Services,
Communications, Healthcare, Public Sector, Retail &
Utilities industries
• Top 3 of 5 largest commercial banks
• Top 3 of 3 busiest ATM networks
• Top 7 of 10 financial data services companies
• Top 4 of 5 telecommunications providers
• Top 3 of 5 largest food & drug stores
29
GoldenGate for Heterogeneous Platforms
Databases
O/S and Platforms
Capture:
 Oracle
 DB2
 Microsoft SQL Server
 Sybase ASE
 Teradata
 Enscribe
 SQL/MP
 SQL/MX
• Windows 2000, 2003, XP
• Linux
Delivery - all listed above, plus:
 HP Neoview, Netezza, Greenplum, and
any ODBC compatible databases
 ETL products
 JMS message queues
 MySQL
 TimesTen
• Sun Solaris
• HP NonStop
• HP-UX
• HP TRU64
• HP OpenVMS
• IBM AIX
• IBM z/OS
30
GoldenGate and Streams
Oracle GoldenGate
Oracle Streams
• GoldenGate is Oracle’s strategic replication solution
• Streams continues to be a supported Oracle Database feature
• Best Streams technology will be integrated into GoldenGate
31
GoldenGate and Data Guard
Heterogeneous
Distributed
Fully-active
Subset
Replicas
Oracle
Active Data
Guard
Oracle
GoldenGate
Oracle DB Primary
Oracle DB Standby
• Information Distribution & Consolidation, Application Upgrades & Changes
– Use GoldenGate - heterogeneous, active-active, transformations, subsetting
• Disaster Recovery / Data Protection / HA
– Simple Full Oracle Database Protection
• Use Active Data Guard
• High-performance, simple, drop-in solution for HA and DR, readable at standby
• Works for all apps and data types, including packaged apps that can’t be changed
– Application desiring flexible HA, active-active, schema changes, platform changes
• Use GoldenGate
• Avoid or manage active-active conflicts at application level
• Combine the two for full database protection and information distribution
32
Best Online Planned Maintenance
At Lowest Cost
Unplanned
Downtime
Planned
Downtime
Server
Failures
Data
Failures
System
Changes
Online Reconfiguration
Rolling Upgrades
Data
Changes
Online Redefinition
App
Changes
Edition-based
Redefinition
33
Online Reconfiguration
Scaling on Demand
• Servers
– Add/Remove RAC nodes online
– No data movement needed
Database
• Storage
– Add/Remove ASM disks or arrays online
– Automatically rebalance after storage change
Storage
• Clusterware, ASM
– Upgrade Oracle Clusterware and ASM (11g)
in an online manner
34
Online Patching and Upgrades
• Most one-off patches can be applied to a running Oracle instance
– Linux-x86, Solaris 10, HP-UX 11i
– [New in 11.2] Windows 32-bit and Windows 64-bit, AIX v6.1 [TL2 SP1]
• More complex one-off patches can be deployed online using RAC
rolling patches (available 10g onwards)
• Database release/patchset upgrades, operating system upgrades,
platform migrations can be applied in rolling fashion using Data
Guard / GoldenGate / Streams
• Data Center moves / SAN migration / Technology Refresh etc. can
be done with minimal downtime using Data Guard / GoldenGate /
Streams
35
Online Index & Table Redefinition
• All index changes can be done online
– 11gR1 – table is never locked during online index creation
• Tables can be Reorganized & Redefined online
– Allows changing location, table type, partitioning, columns, column types
– Contents can be transformed as they are copied
Source
Table
Continuous
Queries &
Updates
Copy
Table
Update
Tracking
Transform
Result
Table
Store
Updates
Transform
Updates
36
New in 11.2
Edition-based Redefinition
Overview
• Enables online application patches and upgrades
• Allows old and new version of application to co-exist
even though schema is changed by new version
• Capabilities primarily used by application developers
37
New in 11.2
Edition-based Redefinition
How Does it Work?
Post-upgrade Edition
• Maintains logical versions of changed database
objects, through:
– Edition
– Editioning View
– Crossedition Trigger
Crossedition
Triggers
• PL/SQL code changes and view changes installed
in the privacy of a new edition
• New data changes made to new
Pre-upgrade Edition
columns/tables not seen by old edition
• Editioning view exposes a private
projection of a table into each edition
• Crossedition trigger propagates changes made by
old edition into new edition’s columns, or vice-versa
38
End-to-End Availability
39
Sun Oracle Database Machine
• Grid is the architecture of the future
• Highest performance, lowest cost, incrementally scalable
• Redundant and Fault Tolerant
• Sun Oracle Database Machine delivers the first and only complete
grid architecture for all data management needs
Oracle Database Server Grid
• 8 High-performance compute
servers
InfiniBand Network
• 40 Gb/sec fault-tolerant unified
server and storage network
© 2009 Oracle Corporation - Confidential
Exadata Storage Server Grid
• 14 High-performance storage
servers
• 5TB flash storage
• Data is mirrored across storage
servers
40
40
Database Technology Drives Availability
Real
Application
Clusters
Active
Data Guard
WAN
ASM
Fast
Recovery Area
• Protection from
–
–
–
–
Server Failures
Storage Failures
Network Failures
Site Failures
Oracle Secure
Backup
• Real-time remote standby open for
queries
• Human error correction
– Database, table, row, transaction level
• Online indexing and table redefinition
• Online patching and upgrades
41
Database Machine HA Metrics
• Backup & Recovery
– Backup shows extreme performance and scalability using Exadata
– Full Database Backup to tape demonstrated at 7.8 TB/hr
 Limited by tape performance of 14 tape drives used in test
– Incremental backup to tape at 10% change rate: 70TB/hr
– Single RMAN backup channel runs full backup to disk at 2.5 TB/hr
• Data Guard
– Full DR demonstrated with uncompressed loads over 2TB/hour
– Compressed tables reduce redo & net traffic enhancing Data Guard
• 5 TB/hour load rates with Data Guard into compressed tables
– 5 customers have implemented Data Guard on a Database Machine in
first year
42
Oracle High Availability Architecture
1. Scale-Out & Low-Cost
–
–
High-volume hardware
All components active
2. Application Oriented
–
–
Protect and recover application objects
Enable online application changes
3. Integrated & Simple
–
–
Availability integrated into all components
Automated
4. Complete & Open
–
–
Handles all planned and unplanned downtime
Pluggable components
43
HA Sessions, Labs, & Demos by Oracle Development
Sunday, 11 October – Hilton Hotel Imperial Ballroom B
3:45p Online Application Upgrade
Tuesday, 13 October – Marriott Hotel Golden Gate B1
Monday, 12 October – Marriott Hotel Golden Gate B1
11:30a Introducing Oracle GoldenGate Products
1:00p GoldenGate Deep Dive: Architecture for Real-Time
Monday, 12 October – Moscone South
1:00p Oracle’s HA Vision: What’s New in 11.2, Room 103
2:30p Oracle Streams: What's New in 11.2, Room 301
4:00p Database 11g: Performance Innovations, Room 103
5:30p Comparing Data Protection Solutions, Room 102
11:30a GoldenGate Zero-Downtime Application Upgrades
Wednesday, 14 October – Moscone South
10:15a Announcing OSB 10.3, Room 300
11:45a Active Data Guard, Room 103
5:00p Exadata Storage & Database Machine, Room 104
Thursday, 15 October – Moscone South
Tuesday, 13 October – Moscone South
9:00a Empowering Availability for Apps, Room 300
11:30a Oracle Streams: Replication Made Easy, Room 308
11:30a Backup & Recovery on the Database Machine, Room 307
11:30a Next-Generation Database Grid Overview, Room 103
1:00p Oracle Data Guard: What’s New in 11.2, Room 104
2:30p GoldenGate and Streams - The Future, Room 270
2:30p Backup & Recovery Best Practices, Room 104
2:30p Single-Instance RAC, Room 300
12:00p Exadata Technical Deep Dive, Room 307
Demos Moscone West DEMOGrounds
4:00p Enterprise Manager HA Best Practices, Room 303
Oracle Streams: Replication & Advanced Queuing, W-043
1:30p Zero-Downtime DB Maintenance, Room 103
Mon & Tue 10:30a - 6:30p; Wed 9:15a - 5:15p
Maximum Availability Architecture (MAA), W-045
Oracle Active Data Guard, W-048
Hands-on Labs Marriott Hotel Golden Gate B2
Oracle Secure Backup, W-044
Monday 11:30a-2:00p Oracle Active Data Guard, Parts I & II
Oracle Recovery Manager & Flashback, W-046
Thursday 9:00a-11:30a Oracle Active Data Guard, Parts I & II
Oracle GoldenGate, 3709
44
Complete List of New HA Features
Oracle Database 11g Release 2
Oracle Database 11g Release 1
45
Complete List of New HA Features
Oracle Database 11g Release 2
Data Guard
Data Guard (contd.)
RAC
• Active Data Guard:
• Online block repair
• Query SLA
• Primary with 30 standbys
• Parallel local & remote SYNC
transport
• Retrieve remaining redo from
primary before failover
• Improved client failover
• Role-based services
• Broker support for ONS
• Support auto-client failover
for logical standby for JDBC,
OCI, ODP.Net
• No shutdown of RAC instances
in old standby for switchover
• No shutdown moving from Max
Availability to Max Protection
• Comprehensive support for
compressed redo transport
• SQL Apply support of OLTP
Compression, SecureFiles, XA
in RAC, Online Redefinition &
Edition-based Redefinition,
SDO_GEOMETRY (EDS)
• Use logical standby as
Streams source
• Server pools
• RAC One Node
• Omotion
ASM
• Cluster File System
• OCR & Voting Disk in ASM
Streams
• XStream IN & OUT
• Statement DML Handlers
• Better infrastructure to track
changes to table data
• New Declarative
Transformation: keep_columns
• Optimized one-to-many
propagation
• AQ: Improved JMS integration
& performance improvements
• Support of OLTP
Compression, SecureFiles,
Online Redefinition
Flashback
• Flashback Database: better
performance for direct loads
• Flashback Database: enable
while database is open
• Flashback Database: better
monitoring of progress
• Flashback Transaction: track
foreign key dependency
46
Complete List of New HA Features
Oracle Database 11g Release 2
Online Patching & Upgrades
OSB 10.3
Grid Control 10.2.0.5
• Edition-based Redefinition
using Edition, Editioning View
and Crossedition Trigger
• Online Patching for Windows
& AIX
• Server-less tape duplication
for VTL using NDMP tape copy
• Better automation for tape
vaulting
• Support for IPv6 as well as
IPv4
• Supports LTO-4 tape drive
encryption
• Manages encryption key
seamlessly between native or
LTO-4 encryption
• More comprehensive backup /
restore monitoring
• Verification of tape device
configurations
• HA Console
• MAA Advisor
• Minimal downtime ASM
migration & RAC conversion
• Streams dashboard and
improved monitoring of Streams
configurations.
• Database Clone from existing
database backups
• Comprehensive OSB
management
• OSB File System
Backup/Restore and reports
• Task based workflow for mining
redo and archived logs
RMAN
• Multiple compression levels
• Target-less DUPLICATE
• Optimized checks for
DUPLICATE
• Expanded DUPLICATE
options
• Enhanced tablespace point-intime recovery using
transportable tablespace and
Data Pump
• Improved flexibility of SET
NEWNAME
• Faster transportable database
47
Complete List of New HA Features
Oracle Database 11g Release 1
Clusters
• Better performance, failover,
management
• Seamless integration with XA
and Microsoft Transaction
Server
• Optimized Cache Fusion
protocols
ASM
• Temporarily freeze I/O to
unresponsive storage and
replay writes when it returns
• Rolling Upgrade for ASM
instances
Data Guard - Generic
 Snapshot standby
 Fast-Start Failover in secs
 Fast-Start Failover for
asynchronous mode
 Fast Redo Transport
 Redo Transport Compression for
gaps
 SYS user no longer required for
redo shipping
 Standby across Linux/Windows
on x86
Flashback
 Flashback Transaction
 Flashback Data Archive
Data Guard SQL Apply
 Support XMLType data type
(CLOB)
 Support Transparent Data
Encryption (TDE)
 Apply performance improved
significantly
 Support Fine Grained Auditing
 Support Virtual Private
Database
Data Guard Redo Apply
 Active Data Guard
 New parallel media recovery
doubles redo apply
performance
 Fast Incremental Backup
 Better RMAN integration
48
Complete List of New HA Features
Oracle Database 11g Release 1
Backup & Recovery
 Data Recovery Advisor
 Intra-file parallel backup and
restore
 Faster backup compression
 Duplicate database over the
network
 Integration with Windows
Volume Shadow Copy
Services (VSS) API
 Integrated protection through
ultra safe mode
Upgrades
• Online patching
• Transient logical standby
Online Redefinition
• Fast add column with default
value
• Invisible Indexes prevent
premature use of newly created
indexes
• Online index build with NO
pause to DML
• No recompilation of dependent
objects
• Easier to execute table DDL
operations online
Streams
 Support XMLType data type
(CLOB)
 Support Transparent Data
Encryption (TDE)
 Apply performance improved
significantly
 Support AWR, ADDM, ASH
 Streams Performance Advisor
 Synchronous capture
 Table Data Comparison
 JMS/AQ performance
improvements
49
Oracle GoldenGate
Key Features in v10
•
•
•
•
•
•
General – Across the Platforms
– Event Marker Infrastructure
– Start Delivery as of CSN (Commit Sequence Number) for efficient instantiation
– Enhanced Memory Management
– Deferred Apply
– Array Fetching to increase initial load performance
Oracle
– Additional data type support – Spatial, IOTs, Sequences, clustered table, object table
– Support of Append hints (Apply only)
– Increased Oracle DDL text maximum size to 2MB
– Filtering by User for more efficient loop detection and capture task type separation (e.g. batch vs OLTP)
– Expanded Support of ALO (Archive Log Only) mode for RAC environments
SQL Server
– SQL Server 2008 Delivery
– Capture of tables without primary keys (SQL Server 2005)
DB2 LUW
– Support for Multi Dimensional Clustered Tables (MDC)
– Support for Materialized Query Tables (MQT)
NSK
– Support of HP Blades
– Support Primary Key Updates from Open Systems (e.g. Oracle to NSK)
Teradata
– Integration of Oracle GoldenGate Director with TMSM (Teradata Multi-System Manager)
– Support of Teradata v13 – DDL replication
– Support for additional platforms: Solaris 10, SUSE 9/10
– Full Unicode Support for Linux ODBC
50
Resources
• Oracle.com:
http://www.oracle.com/ha
• Oracle HA Customer Success Stories on OTN:
http://www.oracle.com/technology/deploy/availability/htdocs/HA_CaseStudies.html
• Maximum Availability Architecture (MAA):
http://otn.oracle.com/goto/maa
• MAA Assessment:
http://www.oracle.com/goto/hasurvey
51
QUESTIONS
ANSWERS
52
For More Information
search.oracle.com
or
oracle.com
53
54