Download Slide 1

Survey
yes no Was this document useful for you?
   Thank you for your participation!

* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project

Document related concepts

Big data wikipedia , lookup

Entity–attribute–value model wikipedia , lookup

Microsoft Jet Database Engine wikipedia , lookup

Concurrency control wikipedia , lookup

Database wikipedia , lookup

Oracle Database wikipedia , lookup

Extensible Storage Engine wikipedia , lookup

Clusterpoint wikipedia , lookup

Functional Database Model wikipedia , lookup

Database model wikipedia , lookup

Transcript
Applications Archiving
Applimation is the leading provider of Application Lifecycle Management solutions
Thursday
November 20th, 2008
Diane Hallahan
Paul Capobianco
Account Manager
Sales Engineer
Agenda
• Overview of Applimation
• Application Archiving
– Types of Archiving – Performance, Compliance,
Retirement
• Database Subsetting
• Intelligent Data Masking
• Informia Archive – Components and details
• Informia Subset – Components and details
• Informia Secure – Components and details
CONFIDENTIAL
SLIDE: 2
Applimation – Broad Application Coverage
 A leader in enterprise
data management
software
 Focus on business
applications
 Unified, integrated
product suite
CONFIDENTIAL
SLIDE: 3
Applimation: Informia Solutions
Improve Production
Database Performance
Maintain Complete
Application Integrity
Comply with Data
Retention Regulations
Enable Accessibility
to Archived Data
CONFIDENTIAL
SLIDE: 4
Applimation: Informia Solutions
Test & Development
Optimization
Automate the Creation of
Smaller Database Copies
Update Copies with Current,
Relevant Production Data
Reduce Storage Space
Requirements
CONFIDENTIAL
SLIDE: 5
Applimation: Informia Solutions
Protect Sensitive
Application Data
Enable Safe Data Sharing
Reduce Risk of Data Breaches
Enhance Test-Data Quality
CONFIDENTIAL
SLIDE: 6
Applimation: Informia Solutions
Ensure Data Accessibility
Reduce Infrastructure and
Licensing Costs
Enable Regulator Compliance
CONFIDENTIAL
SLIDE: 7
Applimation: Informia Solutions
Automate Divestiture
Process
Preserve History and Integrity
of Data
Speed
Reduced Risk
CONFIDENTIAL
SLIDE: 8
Premier Customers
Performance Improvement
Reports completed 4 times faster
MRP Demand Planning process cut by 50%
Inventory process cut from 2.5 hours to 15 mins
More than 50% improvement in Currency
Translation, FSGs, and Discoverer Queries
3 mo retention policy enables consolidation of retail
inventory from legacy to Oracle
Enabled never ending month-end Fixed Assets
process to finish
Compliance
Employee Privacy Protection
Archive/Purge personal data in 22 countries
Data Privacy Protection
Archive/Purge across European countries
Read-only access to archived data ensures
information integrity
SOX audit facilitated by read-only access to
archived data
Masking sensitive HR data in non-production
environments
Archive Before Upgrading
Shortened 11i upgrade outage by 36 hours
Reduced upgrade outage by 40%
Saved 14% of downtime during upgrade
Users return to system 7 hours sooner
Time of each upgrade test cycle reduced
by 30%
Oracle beta customer archiving 11i data before
upgrade to R12
Return on Investment
Shrunk production by 46%
1.3 TB  700 GB
Before: 37 TB total, 40 instances
After: 17 TB total, 40 instances
Removed 2 TB from PROD
14 Envs X 2 TB = 28 TB Total Savings
6 TB savings across 23 instances
450 GB removed from production
10 TB savings across 22 instances
Cut AR by 66% 900 GB  300 GB
Archiving – A Repeatable Process
Daily
Weekly
Monthly
Quarterly
Annually
Scalability
5+ TB
3.5 TB
3 TB
900 GB
600 GB
300GB
Multi-stage Archiving for ILM
Archived
Data
Data Accessibility
Current Data
High
Enterprise
Disk
Modular
Disk
Low
$50 - $70/GB
$20 - $35/GB
SATA - Serial Advanced Technology Attachment
SATA
Disk
$5 - $15/GB
Tape Library
$2 - $4/GB
Tape
$1 - $2/GB
Systemic problems caused by data growth
IF YOU DO NOT MANAGE GROWTH
•
•
•
•
•
Application Performance Degradation
Decreased Application Availability
Increased Time for Backups/Restores
Upgrades continue to take Longer
Copies of Production take Longer
• Production Size become unwieldy for testing and development
• Hardware Costs Continue
• Bigger CPU / More Disk / More Memory
• Power and Cooling Costs Continue
• Analysts expect U.S. companies will spend twice as much on
power and cooling by 2009 as they did to acquire their IT
devices (SearchStorage.com)
Data Management – Traditional Options
• Purchase additional hardware
• DBAs tune application
standard code
• Rebuild Indexes / Update Stats
• Vendor provided
• Purge routines if available
THE PROBLEM: - constantly spending on hardware
- tuning only does so much
- purging doesn’t archive
Model ERD
Applimation Informia Archive
Informia Archive
CONFIDENTIAL
SLIDE: 21
Informia Archive Product Objective
Objective
Better performing production database
Method
Relocating inactive data
Primary Challenge
Complex transactional chaining
Solution
Informia Archive
CONFIDENTIAL
SLIDE: 22
What is archiving?
Archiving is an application-aware method of relocating
enterprise data out of a production database.
What Archiving is NOT: (and was not repurposed from)
• Backup
• Disaster recovery
• Mirroring
• Reporting instance
• Data warehouse
• ETL
CONFIDENTIAL
SLIDE: 23
Business Reasons to Manage Growth
Many copies of production
Project teams require many testing
and development environments
How Much Disk does that Total?
PROD
Increased Overhead
Dev 1
Copies of Production take Longer
Dev 2
• Production Size become unwieldy
for testing and development
Dev 3
Hardware Costs Continue
Dev 4
• Bigger CPU / More Disk / More Memory
Dev x
Business Reasons to Manage Growth
Many copies of production
Project teams require many testing
and development environments
How Much Disk does that Total?
PROD
Inactive
Data
Increased Overhead
DEV 1
Copies of Production take Longer
• Production Size become unwieldy
DEV 2
for testing and development
Hardware Costs Continue
DEV 3
• Bigger CPU / More Disk / More Memory
DEV 4
DEV x
Informia Today – Broad Application and Database Support
Applimation Informia
Archive
Data on
Demand
Data Subset
Secure
Business Applications
Oracle
e-Business
Suite
SAP
PeopleSoft
Custom/
3rd Party
Siebel
Databases
Oracle
SQL
Server
DB2
UDB
MySQL
Sybase
DB2
z/OS
Informia Archive Accelerators - Oracle E-Business
Oracle Financials
Oracle Distribution
General Ledger
GL
Order Entry
OE
Payables
AP
Order Management
ONT
Receivables
AR
Oracle Payroll
Purchasing
PO
Time and Labor
T&L
Fixed Assets
FA
Payroll
HR
Cash Management
CE
Oracle Projects
Global Accounting Engine
AX
Project Accounting
Federal Financials
FV
Oracle CRM
Oracle Manufacturing
PA
Contracts Core
OKC
Inventory
INV
Service Contracts
OKS
Cost (BOM)
CST/BOM
Telesales
AST
Work in Process
WIP
Collections
IEX
Master Scheduling
MRP
Customer Online
IMC
E-Records
EDR
iSupport - Service
CS/BU
OPM – Process Execution
GME
Install Base
CSI
OPM - Financials
GMF
Configurator
CZ
OPM - Inventory
GMI
Incentive Compensation
CN
Shipping
WSH
Oracle Sales Online
Oracle Workflow
Workflow
WF/FND
Order Capture/Quoting/Sales
OSM/ASO,AS,ASF,QOT
Sales
ASN
Informia Archive Accelerators – PeopleSoft Enterprise
PeopleSoft Financials/SCM
PeopleSoft HCM
General Ledger
GL
Human Capital Management
HCM
Accounts Payable
AP
Payroll
HPY
Accounts Receivable
AR
Base Benefits
HBN
Purchasing
PO
Benefits Administration
HBA
Asset Management
AM
Time & Labor
HTL
Billing
BI
Expenses
T&E
Project Costing
PC
PeopleSoft Campus Solutions
Order Management
OM
Student Records
SR
Production Management
PM
Campus Community
CC
Inventory
INV
Student Financials
SF
Financial Aid
FINAID
PeopleSoft CRM
Cases
RC
Academic Advisement
AA
Leads
RS
Recruiting and Admissions
RANDA
Orders
RO
Quotes
RO
Informia Archive Accelerators – Siebel
Horizontal
Verticals
Activities
Activities
Invoices
Invoices
Messages
Messages
Opportunities
Opportunities
Orders
Orders
Change Requests
(Quality)
Change Requests
(Quality)
Quotes
Quotes
Service Requests
Service Requests
Solutions
Attachments
MDF
Accounts
Assets
Contacts
Two Important Accelerator Components
Entity Definition
• Logical unit to archive
• Database and application
level relationships
• Policy scoping criteria
Business Rules
• Transaction chaining
• Within an entity
• To other applications
• Testing of Fields, Flags
& Codes
CONFIDENTIAL
SLIDE: 30
Database Archiving – What to Call it
Database Archiving
a.k.a. Active Archiving
a.k.a. Data Movement
a.k.a. Data Relocation
Done online
Separates ‘active’ data from ‘seldom’
accessed data
Informia: An Enterprise Solution
SHARED
SERVICE CENTER
ACQUIRED DIVISION
Custom Billing
Application
Oracle
Applications
11.5.10
Sybase
HPUX
10 Years = 600 GB
7 Years = 1.4 TB
CALL CENTER
Siebel 7.8
Oracle 10g
Sun Solaris 10
CORPORATE HQ
PeopleSoft
HR 8.3
DB2 AIX
5 Years = 350 GB
SQL Server
Windows
8 Years = 800 GB
CONFIDENTIAL
SLIDE: 32
Archive for Compliance – Long Term Retention
With Online Archive
Archived
Data
Current Data
Production
Database
Seamless
Access
Layer
Online Archive
Database
DataDiscovery
Portal
Direct from Production –
Archive Only
Current
Data
Current Data
DataDiscovery
Portal
CONFIDENTIAL
SLIDE: 33
Meeting the Challenge – Online Archive
OEM
TOAD
DBArtisan
Oracle APPS
PeopleSoft
SQL Plus
CUSTOM
• Always Accessible
• No Developer Modifications Needed
• No Customizations Required
SIEBEL
DISCOVERER
Seamless Access Layer
PRODUCTION
DATABASE
ONLINE ARCHIVE
DATABASE
ENCAPSULATED
XML ARCHIVES
Active Data
Inactive Data
(Read Only)
Inactive
Data
Retired
data
(Read Only)
Retire
Inactive Data
xml
Multi-stage Archiving for Information Lifecycle Management (ILM)
Seamless Access Layer
Current
Data
(less than 2 years old)
CONFIG. DATA 1
CONFIG. DATA 2
OPERATIONAL DATA 1
OPERATIONAL DATA 2
OPERATIONAL DATA 3
DataDiscovery
Online Archive
Database
Encapsulated
XML Archive
(2 – 7 years old)
(over 7 years old)
TRANSACTION 1
TRANSACTION 2
TRANSACTION 3
TRANSACTION 4
TRANSACTION 5
TRANSACTION 6
TRANSACTION 7
CONFIDENTIAL
SLIDE: 35
Multi-stage Archiving for Information Lifecycle Management (ILM)
Seamless Access Layer
DataDiscovery
Current
Data
Online Archive
Database
Encapsulated
XML Archive
(less than 2 years old)
(2 – 7 years old)
(over 7 years old)
CONFIG. DATA 1
CONFIG. DATA 2
OPERATIONAL DATA 1
OPERATIONAL DATA 2
OPERATIONAL DATA 3
TRANSACTION 4
TRANSACTION 6
TRANSACTION 7
TRANSACTION 1
TRANSACTION 2
TRANSACTION 3
TRANSACTION 5
CONFIDENTIAL
SLIDE: 36
Online Archive Process – Another Look
AR Schema
500+ Tables
History
Schema
Only High Volume
Transaction Tables
Production
History
Business Rule Validation – Same Process for All Applications
CONFIDENTIAL
SLIDE: 38
Actual Candidate Summary Report
Actual
Example
Archive Flag
Transaction Table
Biz Rule # n
Production
Biz Rule # 2
Biz Rule # 1
Online Archive Process – Detailed
Txn ID
Date
Status
1
01-JAN-2001
Closed
2
01-JAN-2002
Closed
2006
3
01-FEB-2003
Open
2005
4
01-MAR-2003
Closed
N
Y
5
01-OCT-2004
Open
N
2008
2007
2004
2003
2002
2001
Staging Area
1. Build Interim Tables and test
against business rules
2. Move into Staging Area ONLY
2001 - 2004 transactions that
pass business rules
3. Purge 2001 - 2004 transactions
from Production
4. Merge 2001 - 2004 transactions
to History location
5. Drop Staging Area
CONFIDENTIAL
Y
N
Archive/
History
APPLIMATION
HOME
History
Tables
SLIDE: 40
Online Archive Architecture – Seamless Access – More Detail
30,000 tables
Production
APPS
Packages Tables Views
Procs, Syns, Java, etc.
History
29,980 have 7 years of data
20 have 2 years of data
APPS
20 tables
20 have 5 years of data
APPS_COMBINED
APPS
VIEW
SYNSYN
SYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
APPLIMATION HOME
HISTORY
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
GL
VIEW
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
AP
VIEW
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYNSYN
SYN
SYNSYN
PO
INV
About 200+ Schemas
HISTORY_ONLY
VIEW
COMBINED
VIEW
SELECT column_names from GL.GL_BALANCES
UNION ALL
(SELECT column_names from GL_BALANCES@HISTORY_DBLINK)
The Challenge of Increasing Data Growth
AFTER SOLUTION
BEFORE SOLUTION
Growing storage costs
Predictable manageable growth
Diminishing performance
Improved, stable performance
Increasing maintenance &
Compliance work
Reduced maintenance &
compliance work
CONFIDENTIAL
SLIDE: 42
Seamless Data Access in Oracle Apps
• Auto-generated
• No user re-training
• Access to
• Current Only
• Current + History
• No modifications
to code base
• Support for any/all
query tools
Seamless Access – Application Layer
•
•
•
•
•
Uses Responsibilities to enable access
No modifications to application code
No additional application server
No new user IDs
No user re-training
Seamless Data Access in PeopleSoft
• Auto-generated
• No user re-training
• Access to
• Current Only
• Current + History
• No modifications
to code base
• Support for any/all
query tools
Seamless Data Access for End-Users
Custom Applications
Custom Seamless Data Access
• Auto-generated
• No user re-training
• Access to
• Current Only
• Current + History
• No modifications
to code base
• Support for any/all
query tools
Flexibility – Patches and Upgrades
Production
GL
GL_DAILY_BALANCES CHANGE
GL_JE_HEADERS
GL_JE_BATCHES
GL_BALANCES
NEW_COL
GL_DAILY_BALANCES
GL_IMPORT_REFERENCES
GL_JE_LINES
CHANGE
GL
GL_BALANCES
GL_DAILY_BALANCES
GL_IMPORT_REFERENCES
GL_JE_LINES
INV
MTL_ACTUAL_COST_SUB
INV
MTL_ACTUAL_COST_SUB
2 to 7 Years Archive
MTL_CST_ACTUAL_COST_DET
MTL_CST_ACTUAL_COST_DET
MTL_MATERIAL_TRX
MTL_MATERIAL_TRX
MTL_UNIT_TRANSACTIONS
MTL_UNIT_TRANSACTIONS
MTL_TRANSACTION_LOT_NUM
MTL_CST_TXN_COST_DETAILS
WIP_SCRAP_VALUES CHANGE
MTL_CST_TXN_COST_DETAILS
MTL_TRANSACTION_LOT_NUM
MTL_CST_TXN_COST_DETAILS
History Tables
Full Production Database
2 Years Current
Archive / History
Schema
Multi-stage Archiving for ILM
Archived
Data
Data Accessibility
Current Data
High
Enterprise
Disk
Modular
Disk
Low
$50 - $70/GB
$20 - $35/GB
SATA - Serial Advanced Technology Attachment
SATA
Disk
$5 - $15/GB
Tape Library
$2 - $4/GB
Tape
$1 - $2/GB
Questions……