* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Download Slide 1
Survey
Document related concepts
Transcript
Applications Archiving Applimation is the leading provider of Application Lifecycle Management solutions Thursday November 20th, 2008 Diane Hallahan Paul Capobianco Account Manager Sales Engineer Agenda • Overview of Applimation • Application Archiving – Types of Archiving – Performance, Compliance, Retirement • Database Subsetting • Intelligent Data Masking • Informia Archive – Components and details • Informia Subset – Components and details • Informia Secure – Components and details CONFIDENTIAL SLIDE: 2 Applimation – Broad Application Coverage A leader in enterprise data management software Focus on business applications Unified, integrated product suite CONFIDENTIAL SLIDE: 3 Applimation: Informia Solutions Improve Production Database Performance Maintain Complete Application Integrity Comply with Data Retention Regulations Enable Accessibility to Archived Data CONFIDENTIAL SLIDE: 4 Applimation: Informia Solutions Test & Development Optimization Automate the Creation of Smaller Database Copies Update Copies with Current, Relevant Production Data Reduce Storage Space Requirements CONFIDENTIAL SLIDE: 5 Applimation: Informia Solutions Protect Sensitive Application Data Enable Safe Data Sharing Reduce Risk of Data Breaches Enhance Test-Data Quality CONFIDENTIAL SLIDE: 6 Applimation: Informia Solutions Ensure Data Accessibility Reduce Infrastructure and Licensing Costs Enable Regulator Compliance CONFIDENTIAL SLIDE: 7 Applimation: Informia Solutions Automate Divestiture Process Preserve History and Integrity of Data Speed Reduced Risk CONFIDENTIAL SLIDE: 8 Premier Customers Performance Improvement Reports completed 4 times faster MRP Demand Planning process cut by 50% Inventory process cut from 2.5 hours to 15 mins More than 50% improvement in Currency Translation, FSGs, and Discoverer Queries 3 mo retention policy enables consolidation of retail inventory from legacy to Oracle Enabled never ending month-end Fixed Assets process to finish Compliance Employee Privacy Protection Archive/Purge personal data in 22 countries Data Privacy Protection Archive/Purge across European countries Read-only access to archived data ensures information integrity SOX audit facilitated by read-only access to archived data Masking sensitive HR data in non-production environments Archive Before Upgrading Shortened 11i upgrade outage by 36 hours Reduced upgrade outage by 40% Saved 14% of downtime during upgrade Users return to system 7 hours sooner Time of each upgrade test cycle reduced by 30% Oracle beta customer archiving 11i data before upgrade to R12 Return on Investment Shrunk production by 46% 1.3 TB 700 GB Before: 37 TB total, 40 instances After: 17 TB total, 40 instances Removed 2 TB from PROD 14 Envs X 2 TB = 28 TB Total Savings 6 TB savings across 23 instances 450 GB removed from production 10 TB savings across 22 instances Cut AR by 66% 900 GB 300 GB Archiving – A Repeatable Process Daily Weekly Monthly Quarterly Annually Scalability 5+ TB 3.5 TB 3 TB 900 GB 600 GB 300GB Multi-stage Archiving for ILM Archived Data Data Accessibility Current Data High Enterprise Disk Modular Disk Low $50 - $70/GB $20 - $35/GB SATA - Serial Advanced Technology Attachment SATA Disk $5 - $15/GB Tape Library $2 - $4/GB Tape $1 - $2/GB Systemic problems caused by data growth IF YOU DO NOT MANAGE GROWTH • • • • • Application Performance Degradation Decreased Application Availability Increased Time for Backups/Restores Upgrades continue to take Longer Copies of Production take Longer • Production Size become unwieldy for testing and development • Hardware Costs Continue • Bigger CPU / More Disk / More Memory • Power and Cooling Costs Continue • Analysts expect U.S. companies will spend twice as much on power and cooling by 2009 as they did to acquire their IT devices (SearchStorage.com) Data Management – Traditional Options • Purchase additional hardware • DBAs tune application standard code • Rebuild Indexes / Update Stats • Vendor provided • Purge routines if available THE PROBLEM: - constantly spending on hardware - tuning only does so much - purging doesn’t archive Model ERD Applimation Informia Archive Informia Archive CONFIDENTIAL SLIDE: 21 Informia Archive Product Objective Objective Better performing production database Method Relocating inactive data Primary Challenge Complex transactional chaining Solution Informia Archive CONFIDENTIAL SLIDE: 22 What is archiving? Archiving is an application-aware method of relocating enterprise data out of a production database. What Archiving is NOT: (and was not repurposed from) • Backup • Disaster recovery • Mirroring • Reporting instance • Data warehouse • ETL CONFIDENTIAL SLIDE: 23 Business Reasons to Manage Growth Many copies of production Project teams require many testing and development environments How Much Disk does that Total? PROD Increased Overhead Dev 1 Copies of Production take Longer Dev 2 • Production Size become unwieldy for testing and development Dev 3 Hardware Costs Continue Dev 4 • Bigger CPU / More Disk / More Memory Dev x Business Reasons to Manage Growth Many copies of production Project teams require many testing and development environments How Much Disk does that Total? PROD Inactive Data Increased Overhead DEV 1 Copies of Production take Longer • Production Size become unwieldy DEV 2 for testing and development Hardware Costs Continue DEV 3 • Bigger CPU / More Disk / More Memory DEV 4 DEV x Informia Today – Broad Application and Database Support Applimation Informia Archive Data on Demand Data Subset Secure Business Applications Oracle e-Business Suite SAP PeopleSoft Custom/ 3rd Party Siebel Databases Oracle SQL Server DB2 UDB MySQL Sybase DB2 z/OS Informia Archive Accelerators - Oracle E-Business Oracle Financials Oracle Distribution General Ledger GL Order Entry OE Payables AP Order Management ONT Receivables AR Oracle Payroll Purchasing PO Time and Labor T&L Fixed Assets FA Payroll HR Cash Management CE Oracle Projects Global Accounting Engine AX Project Accounting Federal Financials FV Oracle CRM Oracle Manufacturing PA Contracts Core OKC Inventory INV Service Contracts OKS Cost (BOM) CST/BOM Telesales AST Work in Process WIP Collections IEX Master Scheduling MRP Customer Online IMC E-Records EDR iSupport - Service CS/BU OPM – Process Execution GME Install Base CSI OPM - Financials GMF Configurator CZ OPM - Inventory GMI Incentive Compensation CN Shipping WSH Oracle Sales Online Oracle Workflow Workflow WF/FND Order Capture/Quoting/Sales OSM/ASO,AS,ASF,QOT Sales ASN Informia Archive Accelerators – PeopleSoft Enterprise PeopleSoft Financials/SCM PeopleSoft HCM General Ledger GL Human Capital Management HCM Accounts Payable AP Payroll HPY Accounts Receivable AR Base Benefits HBN Purchasing PO Benefits Administration HBA Asset Management AM Time & Labor HTL Billing BI Expenses T&E Project Costing PC PeopleSoft Campus Solutions Order Management OM Student Records SR Production Management PM Campus Community CC Inventory INV Student Financials SF Financial Aid FINAID PeopleSoft CRM Cases RC Academic Advisement AA Leads RS Recruiting and Admissions RANDA Orders RO Quotes RO Informia Archive Accelerators – Siebel Horizontal Verticals Activities Activities Invoices Invoices Messages Messages Opportunities Opportunities Orders Orders Change Requests (Quality) Change Requests (Quality) Quotes Quotes Service Requests Service Requests Solutions Attachments MDF Accounts Assets Contacts Two Important Accelerator Components Entity Definition • Logical unit to archive • Database and application level relationships • Policy scoping criteria Business Rules • Transaction chaining • Within an entity • To other applications • Testing of Fields, Flags & Codes CONFIDENTIAL SLIDE: 30 Database Archiving – What to Call it Database Archiving a.k.a. Active Archiving a.k.a. Data Movement a.k.a. Data Relocation Done online Separates ‘active’ data from ‘seldom’ accessed data Informia: An Enterprise Solution SHARED SERVICE CENTER ACQUIRED DIVISION Custom Billing Application Oracle Applications 11.5.10 Sybase HPUX 10 Years = 600 GB 7 Years = 1.4 TB CALL CENTER Siebel 7.8 Oracle 10g Sun Solaris 10 CORPORATE HQ PeopleSoft HR 8.3 DB2 AIX 5 Years = 350 GB SQL Server Windows 8 Years = 800 GB CONFIDENTIAL SLIDE: 32 Archive for Compliance – Long Term Retention With Online Archive Archived Data Current Data Production Database Seamless Access Layer Online Archive Database DataDiscovery Portal Direct from Production – Archive Only Current Data Current Data DataDiscovery Portal CONFIDENTIAL SLIDE: 33 Meeting the Challenge – Online Archive OEM TOAD DBArtisan Oracle APPS PeopleSoft SQL Plus CUSTOM • Always Accessible • No Developer Modifications Needed • No Customizations Required SIEBEL DISCOVERER Seamless Access Layer PRODUCTION DATABASE ONLINE ARCHIVE DATABASE ENCAPSULATED XML ARCHIVES Active Data Inactive Data (Read Only) Inactive Data Retired data (Read Only) Retire Inactive Data xml Multi-stage Archiving for Information Lifecycle Management (ILM) Seamless Access Layer Current Data (less than 2 years old) CONFIG. DATA 1 CONFIG. DATA 2 OPERATIONAL DATA 1 OPERATIONAL DATA 2 OPERATIONAL DATA 3 DataDiscovery Online Archive Database Encapsulated XML Archive (2 – 7 years old) (over 7 years old) TRANSACTION 1 TRANSACTION 2 TRANSACTION 3 TRANSACTION 4 TRANSACTION 5 TRANSACTION 6 TRANSACTION 7 CONFIDENTIAL SLIDE: 35 Multi-stage Archiving for Information Lifecycle Management (ILM) Seamless Access Layer DataDiscovery Current Data Online Archive Database Encapsulated XML Archive (less than 2 years old) (2 – 7 years old) (over 7 years old) CONFIG. DATA 1 CONFIG. DATA 2 OPERATIONAL DATA 1 OPERATIONAL DATA 2 OPERATIONAL DATA 3 TRANSACTION 4 TRANSACTION 6 TRANSACTION 7 TRANSACTION 1 TRANSACTION 2 TRANSACTION 3 TRANSACTION 5 CONFIDENTIAL SLIDE: 36 Online Archive Process – Another Look AR Schema 500+ Tables History Schema Only High Volume Transaction Tables Production History Business Rule Validation – Same Process for All Applications CONFIDENTIAL SLIDE: 38 Actual Candidate Summary Report Actual Example Archive Flag Transaction Table Biz Rule # n Production Biz Rule # 2 Biz Rule # 1 Online Archive Process – Detailed Txn ID Date Status 1 01-JAN-2001 Closed 2 01-JAN-2002 Closed 2006 3 01-FEB-2003 Open 2005 4 01-MAR-2003 Closed N Y 5 01-OCT-2004 Open N 2008 2007 2004 2003 2002 2001 Staging Area 1. Build Interim Tables and test against business rules 2. Move into Staging Area ONLY 2001 - 2004 transactions that pass business rules 3. Purge 2001 - 2004 transactions from Production 4. Merge 2001 - 2004 transactions to History location 5. Drop Staging Area CONFIDENTIAL Y N Archive/ History APPLIMATION HOME History Tables SLIDE: 40 Online Archive Architecture – Seamless Access – More Detail 30,000 tables Production APPS Packages Tables Views Procs, Syns, Java, etc. History 29,980 have 7 years of data 20 have 2 years of data APPS 20 tables 20 have 5 years of data APPS_COMBINED APPS VIEW SYNSYN SYN SYNSYN SYNSYN SYNSYN SYNSYN SYNSYN SYNSYN SYNSYN APPLIMATION HOME HISTORY SYNSYN SYNSYN SYNSYN SYNSYN SYNSYN SYNSYN SYNSYN SYNSYN SYNSYN GL VIEW SYNSYN SYNSYN SYNSYN SYNSYN SYN SYNSYN SYNSYN SYNSYN SYNSYN AP VIEW SYNSYN SYNSYN SYNSYN SYNSYN SYNSYN SYNSYN SYNSYN SYN SYNSYN PO INV About 200+ Schemas HISTORY_ONLY VIEW COMBINED VIEW SELECT column_names from GL.GL_BALANCES UNION ALL (SELECT column_names from GL_BALANCES@HISTORY_DBLINK) The Challenge of Increasing Data Growth AFTER SOLUTION BEFORE SOLUTION Growing storage costs Predictable manageable growth Diminishing performance Improved, stable performance Increasing maintenance & Compliance work Reduced maintenance & compliance work CONFIDENTIAL SLIDE: 42 Seamless Data Access in Oracle Apps • Auto-generated • No user re-training • Access to • Current Only • Current + History • No modifications to code base • Support for any/all query tools Seamless Access – Application Layer • • • • • Uses Responsibilities to enable access No modifications to application code No additional application server No new user IDs No user re-training Seamless Data Access in PeopleSoft • Auto-generated • No user re-training • Access to • Current Only • Current + History • No modifications to code base • Support for any/all query tools Seamless Data Access for End-Users Custom Applications Custom Seamless Data Access • Auto-generated • No user re-training • Access to • Current Only • Current + History • No modifications to code base • Support for any/all query tools Flexibility – Patches and Upgrades Production GL GL_DAILY_BALANCES CHANGE GL_JE_HEADERS GL_JE_BATCHES GL_BALANCES NEW_COL GL_DAILY_BALANCES GL_IMPORT_REFERENCES GL_JE_LINES CHANGE GL GL_BALANCES GL_DAILY_BALANCES GL_IMPORT_REFERENCES GL_JE_LINES INV MTL_ACTUAL_COST_SUB INV MTL_ACTUAL_COST_SUB 2 to 7 Years Archive MTL_CST_ACTUAL_COST_DET MTL_CST_ACTUAL_COST_DET MTL_MATERIAL_TRX MTL_MATERIAL_TRX MTL_UNIT_TRANSACTIONS MTL_UNIT_TRANSACTIONS MTL_TRANSACTION_LOT_NUM MTL_CST_TXN_COST_DETAILS WIP_SCRAP_VALUES CHANGE MTL_CST_TXN_COST_DETAILS MTL_TRANSACTION_LOT_NUM MTL_CST_TXN_COST_DETAILS History Tables Full Production Database 2 Years Current Archive / History Schema Multi-stage Archiving for ILM Archived Data Data Accessibility Current Data High Enterprise Disk Modular Disk Low $50 - $70/GB $20 - $35/GB SATA - Serial Advanced Technology Attachment SATA Disk $5 - $15/GB Tape Library $2 - $4/GB Tape $1 - $2/GB Questions……