Download OGEC_11g_PA

A Brief Look at
Oracle Database 11g
Penny Avril
Principal Product Manager
Database, Server Technologies
The following is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into any
contract. It is not a commitment to deliver any
material, code, or functionality, and should not be
relied upon in making purchasing decisions.
The development, release, and timing of any
features or functionality described for Oracle’s
products remain at the sole discretion of Oracle.
Agenda
• Recent Announcements
• New Products Introduced this Year
• Information Appliance Initiative
• Information Lifecycle Management
• Sneak Peek at Oracle Database 11g
What a year it has been –
New Product Releases
• Jan’06:
• Feb’06:
• Mar’06:
•
•
•
•
Apr’06:
May’06
Jul’06
Aug’06
Oracle Application Express
Oracle Database Express Edition
Oracle SQL Developer
Secure Enterprise Search
Oracle Secure Backup
Oracle Warehouse Builder
Oracle Developer Tools for .NET
Oracle Content Database
Oracle Records Database
Oracle Database Vault
Oracle Database Vault
released August 2006
• Database DBA views HR
data
Compliance and
protection from insiders
• HR DBA performs
unauthorized actions
during production
Multi-factor
authorization
• HR DBA views Fin. data
Eliminates security
risks from server
consolidation
select * from HR.emp
DBA
create procedure…
HR DBA
3pm Monday
HR
HR
HR Realm
Fin
Fin
FIN DBA
Fin Realm
Project Audit Vault
Enterprise Audit
Sources
Coming !
Customer Reports
(custom)
Oracle
Database
Partner Reports
9i R2
3rd Party
Audit Warehouse
Audit
Sources
Oracle
Database
Enterprise Database
Audit Settings
10g R2
Pre-defined Roles
For Separation of Duty
Oracle App Svr
Oracle
Protected Schema
Security Feature
Applications
Oracle
Data Mining
Database
10g R1
Partitioning
Oracle Audit Vault
Reporting
Oracle Information Appliance Initiative
making it easy to deliver DW systems
• Appliance Foundations
• Information Appliances
• Documented best-practice
configurations for data
warehousing
• For customers requiring
flexibility and choice
• Benefits:
• Scalable systems pre-installed and
pre-configured: ready to run out-ofthe-box
• For customers looking for the
simplest, fastest solutions
• Benefits:
• High performance
• Simple to scale: modular
building blocks
• Built on Oracle database
and standard hardware
• Available today with HP,
IBM, and EMC
•
•
•
•
High performance
Simple to buy
Fast to implement
Built on Oracle database and
standard hardware
• Available today with Panta Systems
• Further announcements in coming
months
Information Appliance:
Significant Cost Savings
• An Oracle-based appliance
delivers:
PANTA 2700
8250z 1)
# Racks
3
2
Disks
532 spindles
(250GB each)
224 spindles
(150GB each)
HW/SW Costs
$1,152,429
$1,560,000
3 Yr
Maintenance
$1,019,140
$842,000
Total 3YR Cost
of Ownership
$2,171,569
$2,402,000
1)
• High performance out-of-thebox
• Re-usable, general-purpose
software and hardware
• Leading support for the full
breadth of applications
• Enterprise-level security and
availability
• Leverages existing resources
and expertise
• Lower costs
Netezza, 2006 Whitepaper “How the Simplicity of the NPS Data Warehouse Appliance Lowers TCO”
Business Requirement – ILM
(Information Lifecycle Management)
• Reduce cost to retain data
• Vast amounts of data are retained by enterprises for business
and regulatory reasons
• Need to optimize the cost of retaining data in the database to
avoid skyrocketing costs
Active Data
Less Active Data
Historical Data
Typical Database Implementation
without ILM
Active
Data Lifecycle
Less
Historical
Active
Archive
DIGITAL DATA STORAGE
High Performance
Storage Tier
Tape
Archive
Solution: Match Storage to Lifecycle
Optimize Cost
Active
Data Lifecycle
Less
Historical
Active
Offline
Archive
DIGITAL DATA STORAGE
High Performance
Storage Tier
Low Cost
Storage Tier
Online Archive
Storage Tier
Offline
Archive
The Oracle Database with Partitioning
is Ideal for implementing ILM
Database
+ Partitioning
Active
Less
Active
Historical
•
•
•
•
•
•
•
Understands Business Data
Hardware Independent
Application Transparent
Fine Grained – Partitioning
Customizable
Central Point of Control
Low Cost – Use ASM to
manage multiple storage
tiers
Storage
ILM Assistant
helps manage the lifecycle of data
Database Features for ILM
Oracle Database 10g
Oracle Database 11g adds
• Partition, Table Level
Compression
• Range, List and Hash
Partitioning
• Composite Partitioning
• Enhanced Table, Partition, LOB
Compression
• New Interval, Ref and Virtual
Column Partitioning
• New Composite Partitioning
• Range List, Range Hash
• Range Range, List Range, List
List, List Hash
What is the next big challenge ?
Change
Oracle Database 11g will focus on
helping you preserve order amid change
Change is the only Constant
• Enterprise production systems are complex
• Actual workloads are difficult to simulate
• Realistic testing before production is impossible
• Change is the most common cause of instability
• Reluctant to make changes
• Unable to adopt new competitive technologies
KEY: Not to avoid Change but to minimize the instability
New Change Assurance Capabilities in
Oracle Database 11g
Detect &
Tune
Performance
Changes
Perform
Online
Application
Upgrades
Capture &
Replay
Workload
Manage
Execution
Plan
Evolution
Set Up Test
Environments
Package
Incidents
for
Support
Online
Hot
Patching
Set up Test Environments using
Snapshot Standbys
Physical Standby
Apply Logs
Open
Database
• Convert Physical Standby to Snapshot
Standby and open for writes by testing
applications
• ALTER DATABASE CONVERT TO
SNAPSHOT STANDBY;
• Discard testing writes and catch-up to
Back out
primary by applying logs
Changes
• ALTER DATABASE CONVERT TO
PHYSICAL STANDBY;
Snapshot Standby
Perform Testing
Continuous Redo Shipping
• Preserves zero data loss
• But no real time query or fast
failover
• Similar to storage snapshots, but:
• Provides DR at the same time
• Single copy of storage
Database Replay
• Capture Workload in Production
• Capture production workload with actual load & concurrency
• Move the captured workload to test system
• Replay Workload in Test
• Make the desired changes in test system
• Replay workload with production load & concurrency
• Analyze & Report
• Errors
• Data divergence
• Performance divergence
• Use ADDM, AWR for further performance analysis
Pre-Change Production System
Client
Client
Client
…
Changes
Unsupported
App
Server
App
Server
App
Server
Changes
Supported
•Database Upgrades, Patches
•Schema, Parameters
•RAC nodes, Interconnect
•OS Platforms, OS Upgrades
Process
Process
…
Process
Captured
Workload
Capture Workload
…
•CPU, Memory
•Storage
•Etc.
Backup
Pre-Change Production System
Client
Client
Post-Change Test System
Client
…
Replay
Driver
App
Server
App
Server
App
Server
Process
Process
…
Processed
Captured
Workload
Process
…
Process
Capture Workload
…
Backup
Can use Snapshot Standby as
test system
…
Replay
Driver
…
Process
…
…
Process
SQL Replay
• Focus on impact of change on SQL query workload
• Capture SQL in Production
•
•
•
•
Automatically capture SQL workload over a specified period
Capture SQL text, plans, bind variables, execution statistics
Can capture 10.2 SQL workload
Move captured SQL workload to test system
• Replay SQL in Test
• Replay SQL in pre and post-change configurations
• Compare and analyze performance
• For regressed SQL, use SQL Tuning Advisor (10g) to improve
performance with SQL Profiles
• Changes supported
• Major & minor database releases, patches, parameters, schema,
optimizer statistics, tuning recommendations
SQL Replay Performance Analysis
New Change Assurance Capabilities in
Oracle Database 11g
Detect &
Tune
Performance
Changes
Perform
Online
Application
Upgrades
Capture &
Replay
Workload
Manage
Execution
Plan
Evolution
Set Up Test
Environments
Package
Incidents
for
Support
Online
Hot
Patching
Online Application Upgrade
• Large, mission critical applications are often
unavailable for tens of hours while a patch or an
upgrade is installed
• Oracle Database 11g introduces revolutionary new
capabilities that allow online application upgrade with
uninterrupted availability of the application
• The pre-upgrade application and the post-upgrade
application can be used at the same time
• End-user sessions therefore enjoy hot rollover
Online Application Upgrade
The challenge
• The installation of the upgrade into the production
database must not perturb live users of the
pre-upgrade application
• The changes must be made in privacy
• Transactions done by the users of the pre-upgrade
application must by reflected in the post-upgrade
application
• For hot rollover, we also need the reverse of this:
• Transactions done by the users of the post-upgrade
application must by reflected in the pre-upgrade application
Online Application Upgrade
How did we do it?
• Evolutionary capability improvements
• Some table DDLs that used to fail if another session had
outstanding DML now always succeed
• Others, that cannot succeed while there’s outstanding DML,
are now governed by a timeout parameter
• Online index creation and rebuild now never wait
• The dependency model is now fine-grained:
e.g. adding a new column to a table, or a new subprogram to
a package spec, no longer invalidates the dependants
Online Application Upgrade
Revolutionary new capabilities
• 11.1 brings the edition, the editioning view, and the
crossedition trigger
• Code changes are installed in the privacy of a new edition.
• Data changes are made safely by writing only to new columns
or new tables not seen by the old edition
• An editioning view exposes a different projection of a table
into each edition to allow each to see just its own columns
• A crossedition trigger propagates data changes made by
the old edition into the new edition’s columns, or (in hotrollover) vice-versa
New Change Assurance Capabilities in
Oracle Database 11g
Detect &
Tune
Performance
Changes
Perform
Online
Application
Upgrades
Capture &
Replay
Workload
Manage
Execution
Plan
Evolution
Set Up Test
Environments
Package
Incidents
for
Support
Online
Hot
Patching
SQL Plan Management
controlled plan evolution
Business Requirement
• Data is changing over time
• Statistics and execution plans become suboptimal
• Statistics have to be updated
• Possibly unpredictable changes of execution plans
• Today you have ‘freeze’ critical plans or statistics
Solution
• Optimizer automatically manages SQL Plan Baselines
• Only known and verified plans are used
• Plan changes are automatically verified in maintenance window
• Only comparable or better plans are used going forward
• Can pre-seed critical SQL with baselines from SQL Replay
Automatic Diagnostic Workflow
Reduce Time to Problem Resolution
Automatic
Diagnostic
Repository
Critical
Error
2
1
 Incident Packaging Service
 First-failure Capture
3
 Alert DBA
 Targeted assessments
 Assisted SR Filing
Auto Bug
Matching
(post 11gR1)
No
5
Duplicate
Bug?
4
EM Support Workbench:
 Package Incident information
including CCR info
 Guided Repair
Yes
EM Support Workbench:
 Apply Patch or Workaround
 Guided Repair
Incident Packaging Service
Feature-Based Patching
Recommended interim
patch becomes
available in Metalink
Database
targets/groups
1
Proactively push
metadata (version,
feature relevance)
for evaluation
2
Features &
versions
collected
5
Apply patch
3
Grid/DB Control
Customer
Relevant
Patch
Found?
Yes
 Automatic correlation against feature
usages eliminates unnecessary
downtime
 Both ad-hoc searches and subscription
supported
4
Download patch
Online Patching of One-off Patches
• Oracle already supports rolling
patches between nodes in a cluster
• The next major release adds online
patching of a running Oracle
executable (single instance or
cluster) with no downtime
• Integrated with OPatch
• Many one-off patches can be hot
patched
• Great for diagnostic patches
• Initially available on Linux and Solaris
• Long term goal is online patching of
Critical Patch Updates (CPUs).
Manageability,
High Availability
and
Performance
Highlights
Automatic SQL Tuning
Packaged
Apps
Customizable
Apps
High-Load SQL
AWR
Nightly
Automatic SQL Tuning
SQL
Profiling
Index, Stats,
Structure Analysis
SQL Profiles
Test Execute
Implement
Automatic
Well-tuned SQL
Advisor Report
Manual
• Automatically chooses high-load
SQL based on response time,
throughput and frequency criteria
• Automatically tunes SQL by
creating SQL Profiles
• Automatically test executes the
tuned plans to verify improvement
• Automatically implements greatly
(3X) improved plans (optional)
• Automatically reports missing
access structures, stale stats, poorly
structured SQL
• Automatically runs during
maintenance window or manually
triggered
Partition Management Made Easy
Partition Advice from Access Advisor
Packaged
Apps
Customizable
Apps
SQL Workload
Access Advisor
Index, MV
Analysis
Index, MV
Advice
Partition
Analysis
Partition
Advice
Well-Designed
Schema
• Provide advice on Partitioning methods
• Partitioning advice for tables,indexes, MVs
• Consider entire query & DML workload to
improve query performance
• Integrated, non-conflicting advice with Indexes,
MVs
Automatic Interval Partition Creation
• On first insert
• With constant width intervals for dates and
numbers
• Existing RANGE partitioned tables can be
converted to INTERVAL
• RANGE and INTERVAL can coexist in a single
table
Flashback Data Archive
Select * from orders
AS OF
‘Midnight 31-Dec-2004’
ORDERS
Archive
Tables
User
Tablespaces
Flashback
Data Archive
Oracle Database
Total Recall
• Long term retention - years
• Automatically stores all
changes to selected tables in
Flashback Data Archive
• Archive cannot be modified
• Old data purged per retention
policy
• View table contents as of any
time using Flashback SQL
• Uses
•
•
•
•
•
Change Tracking
ILM
Long term history
Auditing
Compliance
Physical Standby with Real-Time Query
Real-time
Queries
Concurrent
Continuous Redo
Shipment and Apply
Primary
Database
Real-Time
Query
Physical Standby
Database
• Read-only queries on physical standby concurrent with redo apply
•
•
•
• Supports RAC on primary / standby
• Queries see transactionally consistent results
Immediate appeal to the many users of physical standby
DR with real time query is unique in the industry – no idle resources
Handles all data types, but not as flexible as logical standby
Performance
Major New Performance Innovations
• Automatic “native” PL/SQL and Java compilation
• Now fully transparent, no C compiler required
• SecureFiles
• New generation LOBs just as fast as files
• Query Results caches
• Fast caching of query/function results for read-mostly data
• Table Compression
• Now for OLTP as well as DW applications
• And much more …
• RAC optimizations, TimesTen enhancements, faster
triggers, Auto NFS, faster upgrades, faster Streams, faster
Data Guard, …
Oracle SecureFiles
Unified Storage
• SecureFiles is a new database feature designed to break the
performance barrier keeping file data out of databases
• Similar to LOBs but much faster, and with more capabilities
• Transparent encryption, compression, deduplication, etc.
• Preserves the security, reliability, and scalability of database
• Superset of LOB interfaces allows easy migration from LOBs
• Enables consolidation of file data with associated relational data
• Single security model
• Single view of data
• Single management of data
Server Results Cache
taking the buffer cache to the next level
• Automatically Caches results of queries, query blocks, or
pl/sql function calls
•
•
Cache is shared across statements and sessions on server
Significant speed up for read-only / read-mostly data
join
join
join
join
T1
T1
T1
T2
T2
Q2:
Q1: Use
builditquery
transparently
cache
GBY
GBY
GBY
GBY
cache
join
join
join
T4
T3
T3
join
T5
T6
OCI Consistent Client Cache
like cache fusion between server and client
Application Server
Consistent
Caching
Database
• Caches query results on client
• Improves performance for read-mostly tables
• Faster response time - eliminates network round trips
• Saves server CPU
• Consistent with server
• Cache proactively refreshed when result set changes
• Maximum age of consistency info can be set
Compression for OLTP
• Oracle Database 9i table compression works for DW
• Compression for bulk load operations
• Direct Path Load
• Create Table Select As …
• Compression is now viable for OLTP
• Regular (non-bulk) INSERT, UPDATE, DELETE
• Add, Drop Column
• Compression benefits
•
•
•
•
Reduced disk space consumption – typically 2x to 3x
Reduced IO
Enhanced cache efficiency
Better read performance
Information Management Platform
•
•
•
•
•
•
Complete
Integrated
Robust
Scalable
Secure
Available on all platforms
Oracle Content and Records DB
Content Management
XML DB
Integrated Native XML Database
Oracle Text
Text Indexing and Search
Oracle Locator & Spatial
Location and Proximity Searching
Oracle interMedia
Multimedia management
Relational
Characters, Numbers, Dates, LOBs
Information Management
•
•
•
•
•
•
Complete
Integrated
Robust
Scalable
Secure
Available on all platforms
Oracle Content and Records DB
11g Feature Refresh
XML DB
Binary XML, Schema Evolution
Information Retrieval
Text Improvements, Semantic Processing
Oracle Locator & Spatial
Improved maps, 3D support, traffic updates
Oracle interMedia
DICOM Medical Image support
Relational
Secure Files
Some other Oracle Database 11g Highlights
• High Availability
• Logminer, Physical Standby, Streams support • Manageability and Diagnosability
• Unified Automatic Memory Management
for XMLType, TDE
• Scheduler supports remote jobs
• Fast Start Failover with Async Propagation
• Automatic Health Monitoring
• Faster Logical Standby Apply
• Faster Database Upgrades
• Flashback Transaction
• ASM
• Data Repair Advisor
• Variable extent sizes, Fast resync, Preferred reads
• Integration
• RAC
• Faster Gateways
• Highly optimized protocols
• Gateways to Legacy Databases
• ADDM for RAC
• Streams Synchronous Capture
• Streams Faster Apply
• Content Management Infrastructure
• Binary XML storage
• Performance and Scalability
• Enhanced XML indexing
• RAC Scalability Enhancements
• Combined Text and Relational Indexes
• Faster PL/SQL Triggers
• DICOM Medical Imaging Support
• Security
• Storage & Query of Semantic Content (RDF, OWL)
• Tablespace and LOB Encryption
• Secure By Default
• Enterprise Manager support for TDE, OLS,
VPD, EUS
• TDE works with LOBS, log miner
• Windows
• VSS Writer for Point In Time Copies
• Business Intelligence
•
•
•
•
Next generation OLAP
Supermodels for Data Mining
Enterprise Manager is DW aware
PIVOT/UNPIVOT operators
The preceding is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into any
contract. It is not a commitment to deliver any
material, code, or functionality, and should not be
relied upon in making purchasing decisions.
The development, release, and timing of any
features or functionality described for Oracle’s
products remain at the sole discretion of Oracle.
QUESTIONS
ANSWERS