Download What’s new in Optim® Performance Management tooling for DB2® for Linux®,

What’s new in Optim® Performance
Management tooling for DB2® for Linux®,
UNIX®, and Windows®
Torsten Steinbach
([email protected])
Jean-Marc Blaise
([email protected])
Optim Performance Manager Lead
Architect
Technical Architect, VENEDIM
A PDF of these slides can be downloaded from:
ibm.com/developerworks/data/events/idmbriefings.html
© 2010 IBM Corporation
Information Management
Agenda
ƒ Introductions
ƒ Overview of Optim Performance Manager (Torsten)
ƒ Beta feedback (Jean-Marc)
ƒ Demo (Torsten)
ƒ Questions and survey
2
© 2010 IBM Corporation
Information Management
Poll question placeholder
ƒ What do you currently use for performance monitoring and management of DB2 for LUW?
– DB2 Performance Expert
– Other vendor tool
– Homegrown software
– Some combination of the above
– None of the above or NA
3
© 2010 IBM Corporation
Information Management
Optim Performance Manager in integrated data management
ƒ Goal: Proactive Performance Management
ƒ Resolve emergent database problems before they
impact the business
ƒ Prevent
– Includes DB2 WLM solution to assign resources to high
priority applications
– Reports help to proactively plan for future capacity
– Historical Analysis
ƒ Identify
– Monitor database health
– Monitor applications by transaction response times
– Alert and system overview dashboards to quickly
identify problems
– Get alert emails
Design
DBA
Optimize
Analyze,
Tune,
Optimize
Archive,
Upgrade,
retire
Operate
Develop
Models
Policies
Metadata
Deploy
ƒ Diagnose
– Drill down from the health and alert overviews to
detailed information
ƒ Solve
– Force application
– Cancel activity
– Tune SQL with Optim Query Tuner and pureQuery
– Integrate with Tivoli Monitoring for broader enterprisewide insights
• OS diagnostics
• Complete transaction path information
4
© 2010 IBM Corporation
Information Management
Optim Performance Manager – Functional highlights
ƒ Successor product of DB2 Performance Expert
– Following is what‘s new compared to PE 3.2
ƒ New easy-to-use browser interface
–
–
–
–
–
–
To access health and availability information outside of the office
DB Health summary with immediate problem detection & drill-down
Designed with DBA‘s best practises in mind
Reduce „up and running“ costs with single simplified install per site
Integrated configuration of monitoring
Moniutoring privileges control
ƒ Dedicated dashboards for typical problem areas (Inflight Analysis)
– Memory, I/O, System, Workload, Locking, Active SQL, Logging, Utilities
ƒ Performance management by exception
– E.g. eMail notification for alerts
– Individual transaction response time SLA checking
ƒ In context partition/member monitoring (DPF, pureScale)
ƒ Optim familiy integration
– Query Tuner, Development Studio (pureQuery)
ƒ Integrated reporting for trend detection and capacity planning
– Top SQL, Connections, Disk space, DB and DBM cfg
ƒ Enhanced Extended Insight (end-to-end monitoring)
– Support for JCC and CLI applications
– Out of the box support for Cognos, SAP, SQW, and DataStage
– Response time details for data server (I/O time, lock wait time, etc.)
5
© 2010 IBM Corporation
Information Management
OPM – Information Lifecycle Integration Support
ODS / pureQuery
Runtime
Cognos
InfoSphere
SAP
Data Stage
WebSphere
Application Server
Integrated application
meta information
Integrated connection
pool monitoring
Tivoli Monitoring
(ITCAM)
Specific views for
standard applications
Integrated invocation
and context transfer
Shared logon, console,
system overview, alerts
Same dashboard for
various data servers
DB2 z/OS
DB2 LUW
OPM
(Beta)
Optim Web
Tooling
Control identified
problem workload
WLM Setup
6
Fix identified
problem queries
Query Tuner
© 2010 IBM Corporation
Information Management
OPM Extended Edition - Extended Insight
ƒ Database workload monitoring based on response times
ƒ Manage response time SLAs
o
Wh
ƒ Identify the problem workload (user, client machine, application etc.)
User
en ƒ
Wh
Identify the problem period
at ƒ
Wh
Identify the problem SQLs
User experience
App pre- and post-processing
y ƒ Identify the problem layer
Wh
Application
transaction
SQL 1
SQL 2
COMMIT
WebSphere or
Java App Server
JCC driver
Network
DB2 LUW
7
Operating
System
© 2010 IBM Corporation
Information Management
Time Spent indicators in data server
User experience
User
App pre- and post-processing
Appl
transaction
SQL 1
SQL 2
COMMIT
Extended Server insight:
Data Server layers
WAS
JCC driver
Network
DB2 LUW
OS
Extended Client Insight :
•All layers
•Data server time is presented as one
single value containing the sum of all
data server layers
8
DB2 V9.7 FP 1 required
Utilities processing time
Lock wait time
I/O time
Transaction end processing time
Routine processing time
Sort processing time
Workload manager queue time
Compilation processing time
Other time
© 2010 IBM Corporation
Information Management
OPM 4.1 Architecture with Extended Insight
Optim Performance Manager
WebSphere
repository
Meta
snapshot
RS API
Console server
E2E
Insert
maintain
Repository server
DB2 LUW ESE
Http
Configuration,
Dashboards
Alerts, Health
TCP/IP
Performance Expert Client
TCP/IP
TCP/IP
TCP/IP
TCP/IP
OPM Extended
Insight
DB2 Attachment
-> Snapshots
Java application
DB2 Connection
-> SQL Collection
-> Event Monitors
-> Extended Server
Insight workload data
(DB2 V9.7 FP 1
Transaction event
monitor)
JCC
driver
OPM EI
TCP/IP
9
Cognos
Adobe Flex
All PE V3.2 level
functionality
Extended Client Insight
workload data
WAS
Browser (IE/Firefox)
SQW
Monitored
Monitored
Monitored
database
database
database
TCP/IP
Extended Cient Insight
workload data
CMX
OPM Extended
Insight
C/C++ application
CLI
driver
OPM EI
DataStage
SAP
© 2010 IBM Corporation
Information Management
Optim Performance Manager Extended Edition ( OPM EE )
OPM EE
New Web UI for easy access anywhere
Base
Extension
Optim Performance Manager (OPM)
• Health monitoring
• Alerting
• Inflight analysis
• Reporting
Optim Performance Manager
Extended Insight (OPM EI)
• ITCAM Integration
• Extended Insight
• WLM config
Performance Expert Client for legacy
access
10
© 2010 IBM Corporation
2010-APRIL-29
2010-APRIL-29
Optim Performance
Manager 4.1
Beta feedback
[email protected]
2010-APRIL-29
AGENDA
Beta feedback objective
OPM41 architecture
OPM41 welcome
OPM41 database declaration
OPM41 db monitoring configuration
OPM41 db alert configuration
OPM41 bufferpool dashboard
OPM41 active SQL dashboard
OPM41 overview dashboard
OPM41 extended insight dashboard
OPM41 positioning in Information System
OPM41 wrap-up
2010-APRIL-29
Venedim
Company profile:
z
Founded in 2005, ~80 persons, Boulogne Billancourt, France
3 branches: infrastructure, consulting and telecom. Technology: Unix,
Linux, Virtualisation, Storage, High-Availability, SAP, DB2 and Oracle.
z
• Regarding DB2 on LUW and related software:
¾
¾
Beta tester for servers and HA solutions: DB2 ESE, SolidDB, Tivoli
System Automation, Xkoto Gridscale (active/active).
Beta tester for tools: Optim Performance Manager, Optim
Developer Studio, Optim Database Administrator.
https://www.ibm.com/developerworks/wikis/display/im/Venedim
2010-APRIL-29
Beta feedback objective
OPM41 beta feedback objective
¾
Give my overall impression on the tool
¾
Explain what I like in the tool
¾
Explain how the tool could be used at customer sites
Point out potential future enhancements that I would like, as a beta
tester
¾
Disclaimer: the following slides are based on a simulation of OPM41
functionality tested on VMWare, for the purpose to present and discuss
OPM41. This is not a real production case, and beta-3 driver.
https://www.ibm.com/developerworks/wikis/display/im/Venedim
2010-APRIL-29
OPM41 architecture
¾
3-tier architecture, no fat client
¾
Simple to setup
¾
Colorful display
Much easier to understand
compared to PE32
¾
2010-APRIL-29
OPM41 welcome
guidance for first discovery of the tool, getting starting tasks,
documentation, and community
9
2010-APRIL-29
OPM41 database declaration
9
Very easy to setup a new reference to a database
2010-APRIL-29
OPM41 db monitoring configuration (1/3)
Extremely easy to configure with pre-defined templates: OLTP, BI, SAP …
with low overhead or all details; « configure like » ...
9
2010-APRIL-29
OPM41 db monitoring configuration (2/3)
9
Sampling rate by default to 1 minute, can be customized by section. So
not so much to configure, but some possibilities to customize as well.
2010-APRIL-29
OPM41 db monitoring configuration (3/3)
After a few minutes for configuration, right into the action by
clicking on health summary … you are guided every time
9
2010-APRIL-29
OPM41 db alert configuration (1/3)
A summarized view for warning, critical conditions … Alerts can be
accessed from Task Manager upper left as well.
9
2010-APRIL-29
OPM41 db alert configuration (2/3)
9
Thresholds could be refined according to application typology
2010-APRIL-29
OPM41 db alert configuration (3/3)
9
Notification can be used as well …
2010-APRIL-29
OPM41 bufferpool dashboard (1/3)
A drill down to the bufferpool dashboard with a very nice capability to
display contained objects
9
2010-APRIL-29
OPM41 bufferpool dashboard (2/3)
9
Locate easily problematic tablespace.
2010-APRIL-29
OPM41 bufferpool dashboard (3/3)
9
Locate table with most I/Os.
2010-APRIL-29
OPM41 Active SQL dashboard
9
Can tune the problematic SQL by clicking « Tune », opens Optim Query Tuner
2010-APRIL-29
OPM41 Overview dashboard (1/2)
From health summary, clicking on the first icon right to the monitored db
opens the overview panel. This gives a very well summarized view : what
ressources are fine, what should you check. It's intuitive to drill down to
the appropriate dashboard.
9
2010-APRIL-29
OPM41 Overview dashboard (2/2)
Two interesting functions: recent: sampling rate refreshed. historical:
possibility to analyse degradation. Move slider and choose window frame
9
2010-APRIL-29
OPM41 Extended Insight dashboard
Very interesting to display transaction time distribution at server (V9.7 fp1); can
also extend E2E monitoring up to client if Extended Insight client part installed.
9
2010-APRIL-29
OPM41 in Information System
Optim Performance Manager 4.1
2010-APRIL-29
OPM41 wrap up
9
9
9
9
OPM41 offers very nice, intuitive and summarised capabilities to monitor
and track down problems
OPM41 is part of DB2 Performance Optimization Feature and works in
completion with WLM
OPM41 has the unique capability to integrate with other tools from the
Optim suite, like IBM Data Studio, Optim Development Studio or Optim
Query Tuner as well as with Tivoli products such as ITCAM for
Transactions.
OPM41 provides nice and dynamic reports, but those need to be
completed to integrate WLM, ressource consumption graphs ...
Contact: [email protected]
Information Management
Resources
ƒ Optim Performance Manager Extended Edition product page
http://www.ibm.com/software/data/optim/performance-manager-extended-edition/
ƒ Technical article
http://www.ibm.com/developerworks/data/library/techarticle/dm-1004optimperformance/
ƒ High level demo: Optim Performance Management Solution
http://www.ibm.com/developerworks/offers/lp/demos/summary/im-performmgtsolution.html
ƒ High level demo: Integrating Tivoli and OPM EE
http://www.ibm.com/developerworks/offers/lp/demos/summary/im-TivoliOPMintegration.html
ƒ Youtube video deep dive on Tivoli/OPM integration – Part 1 is here:
http://www.channeldb2.com/video/opmitcam-integration-4
ƒ developerWorks discussion forum
https://www.ibm.com/developerworks/forums/forum.jspa?forumID=2181
ƒ Optim updates on Twitter: www.twitter.com/IBM_Optim
ƒ Community page: Integrated Data Management (Optim and Data Studio); articles, tutorials,
blogs, forums …http://www.ibm.com/developerworks/spaces/optim
33
© 2010 IBM Corporation
Information Management
Demo
34
© 2010 IBM Corporation
Information Management
Join us for our next Virtual Tech Briefing:
Best Practices in Data Modeling using InfoSphere
Data Architect.
Don’t leave yet.
Please fill out the survey!
Whether you are a new or experienced user of InfoSphere Data
Architect, you are bound to learn something new from our speaker, IBM
Information Management champion Dr. Vladimir Bacvanski, who uses
practical use cases to demonstrate the value of model-driven
development, as well as practical recommendations for logical and
physical data model creation for diverse databases, and guidance on
improving productivity using automation and team development
capabilities.
This session will be held on May 13th 1 PM Eastern, 10 AM Pacific.
Registration avaialable soon at
ibm.com/developerworks/data/events/idmbriefings.html
35
© 2010 IBM Corporation
Information Management
Survey question placeholder
36
© 2010 IBM Corporation
Backup
© 2010 IBM Corporation
Information Management
Tune queries with Optim Query Tuner
Advisors give you hints how to tune the query …
Statistics advisor
Provides advice for missing, outdated and conflicting statistics, and suggests
additional statistics that you can gather to improve query performance.
RUNSTATS jobs are provided with the recommendations.
Index advisor
Provides advice on new indexes that may improve performance as well as the
ability to define and validate user-defined virtual indexes. The index advisor
provides DDL scripts that you can run to create the recommended indexes.
Query advisor
Provides query rewrite advice based on a set of best practice rules.
Access path advisor
38
Provides advice on how to resolve access path issues that might result in
poor performance.
© 2010 IBM Corporation
Information Management
Reports
ƒ Value
–
–
–
–
Proactive monitoring
Trend detection
Capacity planning
Performance baselines
ƒ Features
–
–
–
–
39
Based on BIRT technology
Specify report timeframe
Print
Export to PDF, XLS, PPT
ƒ
Reports
– Top dynamic SQLs in a given period of
time
– Disk space consumption by table space
and growth rate
• Includes table space, container and
table details
– Active database connections at a given
point in time
• Key performance indicators per
connection
– Database configuration per partition or
partition type (e.g. ETL, Coordinator, Data)
• Includes comparison of partitions of
same type
• Includes changes over time
– Database manager configuration
• Includes changes over time
© 2010 IBM Corporation
Information Management
Disk space consumption report – Part 1
40
© 2010 IBM Corporation
Information Management
Extended Insight Detailed Drill-Down
Where
Where is
is this
this DB
DB workload
workload spending
spending its
its time
time ––
client,
client, network,
network, or
or inside
inside DB2?
DB2? Most
Most insight
insight into
into
DB2
DB2 will
will be
be offered
offered with
with DB2
DB2 V9.7.
V9.7.
Which
Which statements
statements have
have been
been executed.
executed.
Which
Which app
app servers
servers or
or DB
DB clients
clients are
are involved.
involved.
For
For aa partition
partition DB
DB how
how does
does itit look
look on
on each
each partition.
partition.
This
This area
area shows
shows then
then the
the details
details to
to the
the
selected
selected layer
layer or
or entity
entity above
above …
…
41
© 2010 IBM Corporation
Information Management
WebSphere – a first class OPM citizen
WebSphere support
has a built-in support for OPM (starting
with V6.0.21), allowing to ...
47
57.67
47
•
52
42
57.67
identify problems with
connection pool
0.34
WAS
•
identify differences in the
configuration of nodes in a
WAS cluster
•
check if a node in a WAS
cluster has a system or
network problem
© 2010 IBM Corporation
Information Management
OPM can tell you where the query came from …
Application source
Capture SQL with pureQuery runtime
Upload collected metadata into OPM
SELECT * FROM DB2ADMIN.I…
SELECT * FROM DB2ADMIN.INVENTORY
TestOPM
43
my.test
main
13
blahVer
N/P
N/P
blah
capture…
© 2010 IBM Corporation
Information Management
Identify where the problem is with the help of ITCAM ...
Tivoli Enterprise Portal
transaction topology
Drill down to
database analysis
provided by
integrated OPM
44
© 2010 IBM Corporation
Information Management
OPM Extended Edition – OPM integrated in TEP
Full OPM and OPM EI capabilities can be used from inside TEP
45
© 2010 IBM Corporation
Information Management
Configure Costs and Concurrency
Specify the estimated cost of activities for your low, medium and high
concurrency subclasses.
Specify a concurrency limit for this service subclass to restrict how many large queries are
allowed to run concurrently
46
© 2010 IBM Corporation
Information Management
The DB2 client information fields
DB2 allows applications to send information about them to the database with each SQL operation.
–
–
–
–
47
The database externalizes this information then in its monitoring data
The performance impact of setting them is negligible (but for DB2 on LUW V9.1 FP6 is recommended)
The data can be set by the application itself, or via database driver properties (see next slides)
The following information can be set:
Field
Description
Length (LUW, z/OS)
Client user ID
This user ID is for identification purposes only, and is not used for
any authorization. It typically identifies the user of an application.
255, 16
Client workstation
name
The workstation name of the client system. Some applications also
use this field to identify the business transaction executed within
an application.
255, 18
Client application
name
It can be used to identify the application hosted in an application
server, or to identify the business transaction within an application.
255, 32
Program name
Identifies the application running on the client. It is only supported
for a connected DB2 on z/OS database.
-, 80
Accounting string
It can be used to specify charge-back information, or to add
additional monitoring details about the database workload.
200, 200
© 2010 IBM Corporation
Information Management
Ways to instrument you application
JDBC offers methods of class com.ibm.db2.jcc.DB2BaseDataSource^1
public static void main(String[] args) {
String url = "jdbc:db2://lap1.boeblingen.de.ibm.com:50000/DEMO";
Class.forName("com.ibm.db2.jcc.DB2Driver");
Connection conn = DriverManager.getConnection(url, user, password);
conn.setClientInfo("ClientUser", “xyz");
conn.setClientInfo("ClientHostname, “my laptop");
conn.prepareStatement("SELECT * FROM SYSIBM.SYSDUMMY1" + "WHERE 0 = 1").executeQuery();
}
CLI offers the setsqli()^2 interface
SQL_API_RC SQL_API_FN sqleseti (
unsigned short DbAliasLen,
char * pDbAlias,
unsigned short NumItems,
struct sqle_client_info* pClient_Info,
struct sqlca * pSqlca);
SQL_STRUCTURE sqle_client_info {
unsigned short type;
unsigned short length;
char *pValue; };
___________________________________________________________________________________________________
^1) see http://publib.boulder.ibm.com/infocenter/db2luw/v9r7/index.jsp?topic=/com.ibm.db2.luw.apdv.java.doc/doc/r0021822.html
^2) see http://publib.boulder.ibm.com/infocenter/db2luw/v9r5/index.jsp?topic=/com.ibm.db2.luw.apdv.api.doc/doc/r0001709.html
48
© 2010 IBM Corporation
Information Management
What if you can‘t change the application logic?
For applications using the CLI driver:
Specify the connection properties in file db2cli.ini^1:
...
[COMMON]
…
; Settings for data source <data source name>
[<data source name>]
ClientUserID = <my end-userID>
ClientApplName = <my application>
ClientWrkStnName = <my system, or my business transaction>
ClientAcctStr = <other charge-back or useful information>
...
For java applications using the JDBC driver:
Specify the JDBC properties in the connection URL, such as
jdbc:db2://tphkarn:50000/DEMO:clientWorkstation=myLaptop;
____________________________________________________________________________________________________________________________________
^1) see http://publib.boulder.ibm.com/infocenter/db2luw/v9r7/index.jsp?topic=/com.ibm.db2.luw.apdv.cli.doc/doc/c0007882.html
^2) see http://publib.boulder.ibm.com/infocenter/db2luw/v9r5/index.jsp?topic=/com.ibm.db2.luw.apdv.java.doc/doc/r0021822.html
49
© 2010 IBM Corporation
Information Management
More details about what EI offers for standard applications
ƒ
IBM WebSphere sets it with V6.1.0.21 and iFix PK74962, or V7.0.0.1 with iFix PK74962
– identifies hosted application, and real user
– Has to be activated
•
•
ƒ
IBM Cognos will set it with V8.4 FP2
– identifies report, report package, path, and real user
– has to be switched explicitly on in file CQEconfig.xml under section QueryEngine (add ‘<entry name=“DB21WFM”
value=“1”/>’)
ƒ
IBM Information Server will set it with V8.5
– identifies project, job, step, invocation id, and partition
ƒ
IBM InfoSphere Warehouse sets it with V9.7.1
– identifies WH application and flow
ƒ
SAP sets it with SAP Kernel Version 7.0 SR3 or higher
– Identifies real user, SAP transaction name, SAP source module
– plus an additional activation via one of the following two ways:
•
•
50
WAS Administrative Console -> Resources -> JDBC -> JDBC providers -> JDBC_provider. On this panel select a data source and create a new
Custom Property enableEndToEndMonitoringFeature of type java.lang.String and set it to TRUE.
WAS Administrative Console -> Servers -> Server Types -> WebSphere application servers -> [server] -> Server Infrastructure -> Java and
Process Management -> Process Definition -> Java Virtual Machine. On this panel enter the following argument into the Generic JVM Arguments
field: -Dcom.ibm.cacheLocalHost=true
SAP profile parameter dbs/db6/dbsl_accounting = 1
SAP start environment DB6_DBSL_ACCOUNTING=1
© 2010 IBM Corporation