Download Universal Data Access via SAP BW Java Integration Functionality Arnd Graf,

SAP TechEd ‘03 Las Vegas
Universal Data Access
via SAP BW Java
Integration Functionality
Arnd Graf, Dev. Architect BI Analysis Platform
Rainer Uhle, Product Management BI
SAP AG
Learning Objectives
As a result of this lecture, you will
be able to:
„ Explain the benefits that SAP Business Information
„
„
„
„
Warehouse (BW) derives from the J2EE components that
are integrated into SAP Web Application Server 6.40
Understand the architecture of SAP BW’s integration with
the SAP Web Application Server Java Environment
Describe which protocols and standards are supported by
the BI Java Connectors
Describe the concept of data migration and integration in
heterogeneous system landscapes using the Universal Data
Connect
Explain how the BI Java SDK complements and extends
SAP BW’s existing open analysis interfaces
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 2
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
1
SAP TechEd ‘03 Las Vegas
Agenda
Overview
Migration and Integration of diverse data sources
Enabling J2EE applications to access BW data
„ SAP NetWeaver & BI Java Connectors
„
„
SAP BW 3.5 Universal Data Connect (UDC)
„ Architecture
„ Application Scenarios
„ UDC Details
BI Java SDK for Custom Applications
„ Architecture
„ Application Scenarios
„ SDK Details
Outlook
Summary
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 3
Agenda
Overview
Migration and Integration of diverse data sources
Enabling J2EE applications to access BW data
„ SAP NetWeaver & BI Java Connectors
„
„
SAP BW 3.5 Universal Data Connect (UDC)
„ Architecture
„ Application Scenarios
„ UDC Details
BI Java SDK for Custom Applications
„ Architecture
„ Application Scenarios
„ SDK Details
Outlook
Summary
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 4
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
2
SAP TechEd ‘03 Las Vegas
Overview – Diverse Data Sources Quantitatively
Data sources in 18 months
Data sources now
Packaged
External, 14%
applications,
Mainframe/
39%
legacy, 65%
Other, 30%
XML, 29%
Replication or
CDC, 15%
Web, 15%
XML, 15%
Flat files, 81%
Packaged
EAI, 5%
applications,
18%
Excel, 12%
EAI/Messaging,
12%
Mainframe, 12%
Relational, 34%
Relational
Flat files, 23%
databases, 89%
Source: TDWI-Giga
Information Group
Quarterly Technology
Survey, 2/2003, 150
respondents.
Source: The Data
Warehousing Institute
(TDWI); based on 756
respondents.
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 5
SAP NetWeaver - A Broader View of Data Acquisition
SAP BW
BAPI
DB
Connect
File
UDC
A
B
C
D
http/
SOAP
SAP XI
E
F
G
Universal Data Connect
„ Integrates data for analysis and enables a complete business view
„ Persistent and transient data handling possible
„ Java based connectors for different drivers, providers, and protocols available
ƒ JDBC
ƒ OLE DB for OLAP
ƒ XML for Analysis
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 6
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
3
SAP TechEd ‘03 Las Vegas
Overview – Enabling Applications to Access BW
BI Java
SDK
OLAP BAPIs
OLE DB for OLAP
XML for Analysis
„ based on COM as
protocol
„ Business Application
Programming interface
„ based on XML as
exchange format
„ driver installation on
clients
„ based on RFC as
protocol
„ based on HTTP/SOAP
as protocol
„ Windows platform only
„ access library available
on any SAP platform
„ any platform
„ MDX as query language
„ available since BW 1.2B
„ MDX as query language
„ available since BW 3.0A
„ MDX as query language
„ available since BW 2.0A
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 7
Overview – Java Connectivity in SAP NetWeaver
„ Industry standard Connection
Architecture (JCA)
SAP NetWeaver
PEOPLE INTEGRATION
Portal
INFORMATION INTEGRATION
Bus. Intelligence
Knowledge Mgmt
Master Data Management
PROCESS INTEGRATION
Integration
Broker
Business Process
Management
APPLICATION PLATFORM
J2EE
‹
Pluggability for 3rd party
connectors
‹
Uniform connection management,
monitoring and foundation for all
connectors
‹
Portability and Synergies with
other J2EE standards
…
Collaboration
Life Cycle Management
Composite Application Framework
Multi channel access
„ BI Java Connectors fully leverage
the SAP J2EE connection
framework and provide integration
with diverse data sources
„ Visualization of SAP BW and nonSAP BW data via the SAP BW
Business Explorer BI Suite and
SAP Enterprise Portal
ABAP
DB and OS Abstraction
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 8
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
4
SAP TechEd ‘03 Las Vegas
Overview - BI Java Connectors
Connectors for diverse data sources
Used together with the Universal Data Connector or the BI Java SDK to extract and consume BW or
non-BW data.
„
Relational
‹ BI
JDBC Connector
z JDBC is the standard Java API for RDBMS
z Connectivity to over 170 JDBC drivers, supporting data sources such as: Teradata,
Oracle, MS SQL Server, MS Access, DB2, Excel, text files (CSV) …
‹ BI
SAP Query Connector
z Connectivity to SAP operational applications (4.x)
z R/3, Ad-Hoc, Operational Reporting
„
OLAP
‹ BI
ODBO Connector
z Established industry-standard OLAP API for the Windows platform
z Connectivity to MS Analysis Services, SAS, MS PTS
‹ BI
XMLA Connector
z Web services-based, platform independent access to OLAP providers
z Connectivity to MS Analysis Services, Hyperion, MicroStrategy, MIS, BW 3.x
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 9
Overview – Java Industry Momentum
ADABAS, Clipper, DB2,
dBase, FoxPro, IBM AS/400,
Informix, Ingres,
InterBase, LDAP,
MS Access, News Server,
OS/390, Paradox,
Redbrick, SAS,
Sybase, Teradata,
Text (CSV, Tab separated etc.),
TinySQL, VSAM, XML.
C
JDB
177 vers
i
Dr
le
ilab
ava
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 10
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
5
SAP TechEd ‘03 Las Vegas
Agenda
Overview
Migration and Integration of diverse data sources
Enabling J2EE applications to access BW data
„ SAP NetWeaver & BI Java Connectors
„
„
SAP BW 3.5 Universal Data Connect (UDC)
„ Architecture
„ Application Scenarios
„ UDC Details
BI Java SDK for Custom Applications
„ Architecture
„ Application Scenarios
„ SDK Details
Outlook
Summary
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 11
BW 3.5
UDC - Architecture
InfoSource
Generic DataSource
with
Rules
FM
J2EE Server 6.40
DB
WAS 6.40
BI Java Integration ...
Universal Data Connect
JDBC Connector
XMLA Connector
ODBO Connector
JDBC Driver
http-URL, port
ODBO Prov.
RDBMS
MS AS, SAS, Hyperion
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 12
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
6
SAP TechEd ‘03 Las Vegas
UDC - Integration Scenario with JDBC
Enterprise Portal 6.0
BW 3.5
Web Application
Query
RemoteCube
„ Transient data. No data
physically stored in SAP BW.
„ DB access via JDBC driver
(from DB provider)
„ Mapping via Transfer Rules in
BW, Inversion of Transfer
Rules
InfoSource
Generic DataSource
with
Rules
FM
„ RemoteCube
J2EE Server 6.40
WAS 6.40
BI Java Integration ...
Universal Data
Connect
JDBC Connector
JDBC Driver
DB
File
Syst.
Supporting JDBC
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 13
UDC - Extraction Scenario with JDBC
BW 3.5
Data Mart Layer
EDW Layer
InfoPackage
„ Persistent data
„ DB access via JDBC driver
(from DB provider)
„ Mapping via Transfer Rules in
BW, no Inversion of Transfer
Rules required
InfoSource
Generic DataSource
with
Rules
FM
„ Data load via InfoPackage
J2EE Server 6.40
WAS 6.40
BI Java Integration ...
Universal Data
Connector
JDBC Connector
JDBC Driver
DB
File
Syst.
Supporting JDBC
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 14
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
7
SAP TechEd ‘03 Las Vegas
UDC Details – Connector Deployment and Connection
Configuration
JNDI: Java Naming Directory Interface
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 15
UDC Details - InfoSource Maintenance
Create BW DataSource with UDConnect
Order No.
Patner No.
RC Date
Commission Da
Shipping Date
Lineitem No.
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 16
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
8
SAP TechEd ‘03 Las Vegas
UDC Details – DataSource Wizard
BW InfoSource
Connect Info
Fields of table
ITEM
in ext. DB
Man. Mapping
Autom. Mapping
Generate DS
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 17
UDC – Feature Summary
„ Scenarios
‹
Connection of diverse data source systems to SAP BW
z E.g. Extraction/Remote Access from a relational database via open interface JDBC
z E.g. Extraction/Remote Access from OLAP source using OLE DB for OLAP and
extraction from an OLAP source using XML for Analysis
„ Features
‹
Leveraging SAP WebAS J2EE Connectivity for SAP BW
‹
Enhancing SAP BW Openness: Connectivity to virtually all data sources
z UDConnect: Universal Data Connect
z Extraction to SAP BW and Remote Cube Access via UDConnect
‹
Uses the BI Java Connectors
z JDBC (170+ drivers available for: Adabas, Clipper, DB2, FoxPro, Informix, Ingres, MS
Access, Sybase, SAS, Teradata, XML, CSV text files, … ) - see http://java.sun.com for
more information
z OLE DB for OLAP
z XML for Analysis
z SAP Query
z The set of connectors will be extended in future
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 18
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
9
SAP TechEd ‘03 Las Vegas
Agenda
Overview
Migration and Integration of diverse data sources
Enabling J2EE applications to access BW data
„ SAP NetWeaver & BI Java Connectors
„
„
SAP BW 3.5 Universal Data Connect (UDC)
„ Architecture
„ Application Scenarios
„ UDC Details
BI Java SDK for Custom Applications
„ Architecture
„ Application Scenarios
„ SDK Details
Outlook
Summary
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 19
BI Java SDK - Architecture
BI
BIJava
JavaSDK
SDK
OLAP APIs
OLAP Query API
ResultSet API
Relational APIs
Relational Metadata API
Relational Query API
Connection Management
Logging and Tracing
OLAP Metadata API
Documentation (including Javadocs, Developer’s Guide); Examples
BI XMLA Connector
BI XMLA Connector
OLAP
BI JDBC Connector
BI JDBC Connector
Relational
BI ODBO Connector
BI ODBO Connector
OLAP
BI SAPQ Connector
BI SAPQ Connector
Relational
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 20
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
10
SAP TechEd ‘03 Las Vegas
BI Java SDK – Scenarios
Managed Application Scenario
Unmanaged Application Scenario
EP 6.0
Enterprise Portal
Web Application
J2SE
WAS 6.40
Java Components
BI XMLA Connector
http-URL, port
Any OS
J2EE Server 6.40
BI XMLA Connector
http-URL, port
BW XMLA Service
DB
BW XMLA Service
DB
J2SE Application
BW
BW
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 21
BI Java SDK – Supported Open Standards
JCA (J2EE Connector Architecture)
Standard architecture for integration of J2EE servers
with EISs. The architecture defines a set of contracts that a
resource adapter has to support to plug in to an application
server.
CWM (Common Warehouse Metamodel)
Describes the exchange of shared, global metadata.
Capable of modeling a wide spectrum of OLAP
and relational providers.
JMI (Java Metadata Interface)
Provides a common Java programming model for accessing
metadata.
XMI (XML Metadata Interchange)
Standard for exchanging metadata between UML-based
modeling tools and MOF-based metadata repositories.
Why’s this important?
Connection Management
JCA provides an API for connecting to heterogeneous
data sources in a consistent way. Supports pluggability
of connectors into multiple J2EE engines. The SDK’s
connectors are JCA-compliant.
Metadata Integration
¾ Common Metamodel (CWM)
You need a common understanding of metadata to be
able to exchange it between different, heterogeneous
systems. The SDK uses CWM to represent metadata.
¾ Common Access API (JMI)
Provides a common access API. The SDK uses JMI
mapping to render its metadata models into Java APIs.
¾ Common Exchange Format (XMI)
The SDK supports XMI to exchange and persist
metadata objects in a platform-independent manner.
MOF (Meta Object Facility)
Standard for the specification of interoperable metamodels,
integrated in XMI. MOF can also refer to any metadata service
which abides by the MOF specifications.
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 22
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
11
SAP TechEd ‘03 Las Vegas
BI Java SDK - Developer’s Documentation Set
Features:
Features:
Complete
Completeset
setof
ofJavadocs
Javadocs
Developer’s
Developer’sGuide
Guide
Code
Examples
Code Examples
Integrated
IntegratedCWM
CWMDocumentation
Documentation
Navigable
UML
Navigable UMLDiagrams
Diagrams
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 23
BI Java SDK – Feature Summary
„ Scenarios
‹
Java developers will use the SDK to create custom BI applications and
deploy them on the SAP NetWeaver’s J2EE server
‹
For accessing SAP (BW) or non-SAP data
‹
Access to diverse sources (SAP or non-SAP) supported by the BI Java
Connectors (JDBC, XMLA, OLE DB for OLAP, SAP Query)
„ Features
‹
Easy to use and learn
z Simplified command interfaces hide the complexity of underlying low-level
data access protocols (MDX, SQL, HTTP, JNI …)
z Leverages resources, skills, and infrastructure customers already have
z Provides complete documentation on an API level (Javadocs), tutorials, and
examples
‹
Based on open and accepted standards for interoperability
z
z
z
z
Common access APIs (JMI)
Common meta models (CWM)
Common interchange format (XMI)
Connection management (JCA)
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 24
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
12
SAP TechEd ‘03 Las Vegas
Agenda
Overview
Migration and Integration of diverse data sources
Enabling J2EE applications to access BW data
„ SAP NetWeaver & BI Java Connectors
„
„
SAP BW 3.5 Universal Data Connect (UDC)
„ Architecture
„ Application Scenarios
„ UDC Details
BI Java SDK for Custom Applications
„ Architecture
„ Application Scenarios
„ SDK Details
Outlook
Summary
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 25
Outlook – BEx and Portal Integration
„ BEx Integration (BW 4.0)
‹
BEx as an XMLA, ODBO,
JDBC consumer
‹
Ad-hoc reporting on non-SAP
OLAP and relational data
sources
‹
Data ready for reporting
without modeling
„ Portal Integration (Availability
tbd)
‹
Visual tool (GUI Machine) to
enable code-free
development of portal
content
‹
Designed for content experts
and content managers
‹
BI Extension for creation of
BI content
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 26
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
13
SAP TechEd ‘03 Las Vegas
Summary
SAP NetWeaver supports an industry standard
pluggable connector architecture
SAP BW leverages and integrates with this
architecture via BI Java Connectors
SAP BI Java Connectors enable integration of
diverse data sources based on JDBC, XMLA and
OLE DB for OLAP
SAP BI Java SDK, based on BI Java Connectors,
enables rapid development of custom Java
applications with access to BW
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 27
Further Information
Î
Internet:
J2EE Connector Architecture (JCA): http://www.jcp.org/en/jsr/detail?id=16
Java Database Connectivity (JDBC): http://java.sun.com/products/jdbc/
XML for Analysis (XMLA): http://www.xmla.org/
Java Metadata Interface (JMI): http://java.sun.com/products/jmi/
OLE DB for OLAP (ODBO):
http://msdn.microsoft.com/library/default.asp?url=/library/enus/oledb/htm/olprpart3.asp
Î
Related Workshops/Lectures at SAP TechEd 2003
BW 253: XML for Analysis; 2-hour hands-on:
z Sept. 30, 2003, 4:00 PM - 6:00 PM, H11
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 28
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
14
SAP TechEd ‘03 Las Vegas
Questions?
Q&A
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 29
Feedback
Please complete your session evaluation and
drop it in the box on your way out.
Thank You !
The SAP TechEd ’03 Basel Team
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 30
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
15
SAP TechEd ‘03 Las Vegas
Copyright 2003 SAP AG. All Rights Reserved
„
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express
permission of SAP AG. The information contained herein may be changed without prior notice.
„
Some software products marketed by SAP AG and its distributors contain proprietary software components of other
software vendors.
„
Microsoft®, WINDOWS®, NT®, EXCEL®, Word®, PowerPoint® and SQL Server® are registered trademarks of
Microsoft Corporation.
„
IBM®, DB2®, DB2 Universal Database, OS/2®, Parallel Sysplex®, MVS/ESA, AIX®, S/390®, AS/400®, OS/390®,
OS/400®, iSeries, pSeries, xSeries, zSeries, z/OS, AFP, Intelligent Miner, WebSphere®, Netfinity®, Tivoli®, Informix
and Informix® Dynamic ServerTM are trademarks of IBM Corporation in USA and/or other countries.
„
ORACLE® is a registered trademark of ORACLE Corporation.
„
UNIX®, X/Open®, OSF/1®, and Motif® are registered trademarks of the Open Group.
„
Citrix®, the Citrix logo, ICA®, Program Neighborhood®, MetaFrame®, WinFrame®, VideoFrame®, MultiWin® and
other Citrix product names referenced herein are trademarks of Citrix Systems, Inc.
„
HTML, DHTML, XML, XHTML are trademarks or registered trademarks of W3C®, World Wide Web Consortium,
Massachusetts Institute of Technology.
„
JAVA® is a registered trademark of Sun Microsystems, Inc.
„
JAVASCRIPT® is a registered trademark of Sun Microsystems, Inc., used under license for technology invented
and implemented by Netscape.
„
MarketSet and Enterprise Buyer are jointly owned trademarks of SAP AG and Commerce One.
„
SAP, R/3, mySAP, mySAP.com, xApps, xApp and other SAP products and services mentioned herein as well as
their respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other
countries all over the world. All other product and service names mentioned are the trademarks of their respective
companies.
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 31
SAP TechEd `03 EMEA
Online
WATCH THE
REPLAYS,
DOWNLOAD THE
SLIDES, AND READ
THE TRANSCRIPTS.
www.sap.com/community
 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 32
© 2003 SAP AG, Germany
BW204, Eric Schemer/Rainer Uhle
16