Mapping Performance Analyzer tasks to the back end Database

How does the tasks in ITPA map to OS Agent attribute.

In other words - where does the ITPA look for in the Database - to get the data and render this.

Here,I will try to delve into just 1 attribute of the UNIX agent - i.e Unix_Memory, and one ITPA task "Available Memory' and connected to DB2 data base.


 



Requirements : Historical collections for UNIX agent has to be configured first.
Next, the Summarization and Pruning for the Unix Attribute has to be configured.
The UNIX agent has these columns for "Available Memory ".

If you look at the DB2 Database, and the Historical colleciton for the UnixOS agent is configured and active.


Unix_Memory                     ITMUSER         T     2013-06-26-12.19.15.589568
Unix_Memory_D                   ITMUSER         T     2013-06-26-12.20.50.073287
Unix_Memory_DV                  ITMUSER         V     2013-06-26-12.20.53.727654
Unix_Memory_H                   ITMUSER         T     2013-06-26-12.20.45.292147
Unix_Memory_HV                  ITMUSER         V     2013-06-26-12.20.49.760437
Unix_Memory_W                   ITMUSER         T     2013-06-26-12.20.54.066615
Unix_Memory_WV                  ITMUSER         V     2013-06-26-12.20.58.156429


Unix Memory_D means the daily sumarization is configured.
_H and _W - are the Hourly and the Weekly.

// lists all the records.
select count(*) from itmuser."Unix_Memory"  <== typically will have  245 records for example.

// lists summarized data.
Summarized data:
select count(*) from itmuser."Unix_Memory_D" <== will have 2 - since we have had daily - and its two days since the agent was started.

select count(*) from itmuser."Unix_Memory_H" <== will have based on the hours - for 2 hours it will have 7 or 8 entries.
7 <========= This is what we will focus in this blog.

Since we have set the ITPA task to forecast based on the Hourly - the TEP GUI will show 7 entries. ( and it has been close to 2 hours since I started monitoring the agent.
and at 15 minutes each, there will be 7 summarized entries)



describe table itmuser."Unix_Memory"

                                Data type                     Column
Column name                     schema    Data type name      Length     Scale Nulls
------------------------------- --------- ------------------- ---------- ----- ------
TMZDIFF                         SYSIBM    INTEGER                      4     0 No    
WRITETIME                       SYSIBM    CHARACTER                   16     0 No    
System_Name                     SYSIBM    VARCHAR                     64     0 No    
Timestamp                       SYSIBM    CHARACTER                   16     0 Yes  
Total_Virtual_Storage_MB        SYSIBM    INTEGER                      4     0 Yes  
Used_Virtual_Storage_MB         SYSIBM    INTEGER                      4     0 Yes  
Avail_Virtual_Storage_MB        SYSIBM    INTEGER                      4     0 Yes  
Virtual_Storage_Pct_Used        SYSIBM    DECIMAL                     31     1 Yes  
Virtual_Storage_Pct_Avail       SYSIBM    DECIMAL                     31     1 Yes  
Total_Swap_Space_MB             SYSIBM    INTEGER                      4     0 Yes  
Used_Swap_Space_MB              SYSIBM    INTEGER                      4     0 Yes  
Avail_Swap_Space_MB             SYSIBM    INTEGER                      4     0 Yes  
Used_Swap_Space_Pct             SYSIBM    DECIMAL                     31     1 Yes  
Avail_Swap_Space_Pct            SYSIBM    DECIMAL                     31     1 Yes  
Total_Real_Mem_MB               SYSIBM    INTEGER                      4     0 Yes  
Used_Real_Mem_MB                SYSIBM    INTEGER                      4     0 Yes  
Avail_Real_Mem_MB               SYSIBM    INTEGER                      4     0 Yes  
Used_Real_Mem_Pct               SYSIBM    DECIMAL                     31     1 Yes  
Avail_Real_Mem_Pct              SYSIBM    DECIMAL                     31     1 Yes  
Page_Faults                     SYSIBM    INTEGER                      4     0 Yes  
Page_Reclaims                   SYSIBM    INTEGER                      4     0 Yes  
Page_Ins                        SYSIBM    INTEGER                      4     0 Yes  
Page_Outs                       SYSIBM    INTEGER                      4     0 Yes  
Page_In_Reqs                    SYSIBM    INTEGER                      4     0 Yes  
Page_Out_Reqs                   SYSIBM    INTEGER                      4     0 Yes  
Page_In_KB_S                    SYSIBM    INTEGER                      4     0 Yes  
Page_Out_KB_S                   SYSIBM    INTEGER                      4     0 Yes  
Page_In_1Min                    SYSIBM    INTEGER                      4     0 Yes  
Page_In_5Min                    SYSIBM    INTEGER                      4     0 Yes  
Page_In_15Min                   SYSIBM    INTEGER                      4     0 Yes  
Page_In_60Min                   SYSIBM    INTEGER                      4     0 Yes  
Page_Out_1Min                   SYSIBM    INTEGER                      4     0 Yes  
Page_Out_5Min                   SYSIBM    INTEGER                      4     0 Yes  
Page_Out_15Min                  SYSIBM    INTEGER                      4     0 Yes  
Page_Out_60Min                  SYSIBM    INTEGER                      4     0 Yes  
Page_Scan                       SYSIBM    INTEGER                      4     0 Yes  
Page_Scan_KB                    SYSIBM    INTEGER                      4     0 Yes  
Page_Scan_1Min                  SYSIBM    INTEGER                      4     0 Yes  
Page_Scan_5Min                  SYSIBM    INTEGER                      4     0 Yes  
Page_Scan_15Min                 SYSIBM    INTEGER                      4     0 Yes  
Page_Scan_60Min                 SYSIBM    INTEGER                      4     0 Yes  
ARC_Size_MB                     SYSIBM    INTEGER                      4     0 Yes  
Net_Memory_Used                 SYSIBM    INTEGER                      4     0 Yes  
Net_Memory_Avail                SYSIBM    INTEGER                      4     0 Yes  
Net_Memory_Used_Pct             SYSIBM    DECIMAL                     31     1 Yes  
Net_Memory_Avail_Pct            SYSIBM    DECIMAL                     31     1 Yes  
Non_Comp_Memory                 SYSIBM    INTEGER                      4     0 Yes  
Comp_Memory                     SYSIBM    INTEGER                      4     0 Yes  
Decay_Rate                      SYSIBM    INTEGER                      4     0 Yes  
Repaging_Rate                   SYSIBM    INTEGER                      4     0 Yes  
Pages_Read_per_Sec              SYSIBM    INTEGER                      4     0 Yes  
Pages_Written_per_Sec           SYSIBM    INTEGER                      4     0 Yes  
Paging_Space_Free_Pct           SYSIBM    INTEGER                      4     0 Yes  
Paging_Space_Used_Pct           SYSIBM    INTEGER                      4     0 Yes  
Paging_Space_Read_per_Sec       SYSIBM    INTEGER                      4     0 Yes  
Paging_Space_Write_per_Sec      SYSIBM    INTEGER                      4     0 Yes  

  56 record(s) selected.

these 7 records are what will be visible to the user in the TEP GUI panel.


On the ITPA side this is what was configured.




--

Now, what if I change the ITPA to change the forecast granularity from Hourly to Daily ? will it change the TEP GUI measurement count ? to number of days.
Let's see.
Yes, the number of measurements = 2 - ( its; almost 2 days I started the monitoring - the first day - I had it on and off for a bit )



Note, that the ITPA task config changed to Daily.


This tells me that the ITPA configuration from Hourly, Daily, Weekly , Monthly, Quarterly,  will depend on the number of summarized data in the DB2 for UNIX OS Agent.

i.e
Unix_Memory                     ITMUSER         T     2013-06-26-12.19.15.589568
Unix_Memory_D                   ITMUSER         T     2013-06-26-12.20.50.073287 <===  for Daily. ( in this case we have 2 records -since its 2 days since I started it on/off )
Unix_Memory_DV                  ITMUSER         V     2013-06-26-12.20.53.727654
Unix_Memory_H                   ITMUSER         T     2013-06-26-12.20.45.292147  <==  For hourly ( in this case I have 7 entries, one for every 15 mins, and its been close to 2 hrs )
Unix_Memory_HV                  ITMUSER         V     2013-06-26-12.20.49.760437
Unix_Memory_W                   ITMUSER         T     2013-06-26-12.20.54.066615  <==  for weekly
Unix_Memory_WV                


Now, lets look at ITPA  Forecast and Status tables.
Memory Overall tables
Mem_Utilization_LT_Fcast        ITMUSER         T     2013-06-26-12.23.33.169192
Mem_Utilization_LT_Status       ITMUSER         T     2013-06-26-12.23.31.573179

Memory Forecast Summarized tables.
Mem_Utilization_LT_Fcast        ITMUSER         T     2013-06-26-12.23.33.169192
Mem_Utilization_LT_Fcast_D      ITMUSER         T     2013-06-26-12.35.23.324907
Mem_Utilization_LT_Fcast_DV     ITMUSER         V     2013-06-26-12.35.25.954956
Mem_Utilization_LT_Fcast_H    

Memory Status Summarized tables.
Mem_Utilization_LT_Status_D     ITMUSER         T     2013-06-26-12.35.40.951635
Mem_Utilization_LT_Status_DV    ITMUSER         V     2013-06-26-12.35.43.587620
Mem_Utilization_LT_Status_H     ITMUSER         T     2013-06-26-12.35.37.870105
Mem_Utilization_LT_Status_HV    ITMUSER         V     2013-06-26-12.35.40.716305
Mem_Utilization_LT_Status_M     ITMUSER         T     2013-06-26-12.35.46.

Tivoli Performance Analyzer -Some best practices.

Often I have come across an installation where the end user has not configured the Performance Analyzer, and hence is not functional.

Here I will discuss some points about validating if the Tivoli Performance Analyzer component of IBM is installed and configured and is operational.

This blog mainly describes about detecting that the PA Report and Domain Definitions is not installed.

Here are some symptoms:

First , during the configuration, the Manage TEMS might show the Performance Analyzer in the window, however will complain that the PA tables are not installed.

This usually signals the the end user has *NOT installed the "Performance Analyzer Domain and Report Support", however has only installed the Base ITM component where the Performance Analyzer infrastructure is installed .





So cancel the operation and let's look at some background on this.

[[ I have described the Tivoli 6.3.0 which is the last released version of ITM ]]

The Base ITM 6.3.0 for a platform for ITM installs the Performance Analyzer infrastructure, if selected during the installation.

Next,install the agent (s) application support that we are interested in doing the Performance Analysis. ( i.e the OS Agent, ITCAM, DB2, SystemP and Oracle ), since these are the agents that the Performance Analyzer supports.

Followed by the Performance Analyzer  'Report and Domain definitions' component.
This installs the final piece required for the Base ITPA component for full functionality.

 




Other symptoms are listed below.

2.  cinfo -t   ( redirect this output to an external file and view it)
There are two paragraphs to the output.
One is the "PRODUCT DESCRIPTION" and another is the 'APPLICATION SUPPORT DESCRIPTION'.
In the Product Description paragraph you will see that the 'pa' agent is installed.

In the APPLICATION SUPPORT paragraph, if the lines mentioned in red (i.e p3, p0 and others ) is missing - this is clear indication that the 'Report and Domain support" for the Performance Agent is not installed.

At this point I'd assume that you have installed the OS Agent and application support for them , or other agents ( like the ITCAM, DB2, Oracle, or SystemP) before installing the PA 'Report and Domain support' component.
When I mention 'application support - I mean the TEPS, TEMS application support.

This "Report and Domain Support for Performance Analyzer" component is critical for the Performance Analyzer agent for full functionality, and has to be installed.

So, if this is not installed - then stop PA, reinstall the 'Report and Domain support', and watch for these lines in the cinfo output. If the agents application support ( and/or ) agent is **not installed, then the 'PA Report and Domain installer will complain that it is not installed and if you wish to continue the installation. This might install the 'Report and Domain support' but might have other undesirable effects, which I'd recommend not to do..

 
*********** Tue Jun 18 16:18:01 IST 2013 ******************
User: root Groups: system bin sys security cron audit lp
Host name : taddm234         Installer Lvl:06.23.01.00
CandleHome: /opt/IBM/ITM623FP1
Version Format: VV.RM.FF.II (V: Version; R: Release; M: Modification; F: Fix; I: Interim Fix)
***********************************************************
...Product inventory

PC   PRODUCT DESC                                              PLAT    VER           BUILD           INSTALL DATE    

ax   IBM Tivoli Monitoring Shared Libraries                    aix526  06.23.01.00   d2050a          20130612 1622  
ax   IBM Tivoli Monitoring Shared Libraries                    aix533  06.23.01.00   d2050a          20130612 1442  
ax   IBM Tivoli Monitoring Shared Libraries                    aix536  06.23.01.00   d2050a          20130612 1418  
cq   Tivoli Enterprise Portal Server                           aix536  06.23.01.00   d2050a          20130612 1429  
cw   Tivoli Enterprise Portal Browser Client                   aix536  06.23.01.00   d2050a          20130612 1420  
gs   IBM GSKit Security Interface                              aix523  07.40.27.00   d2031a          -              
gs   IBM GSKit Security Interface                              aix526  07.40.27.00   d2031a          -              
hd   Warehouse Proxy                                           aix536  06.23.01.00   d2050a          20130612 1443  
iu   IBM HTTP Server                                           aix536  07.00.00.00   d2031a          20130612 1423  
iw   IBM Tivoli Enterprise Portal Server Extensions            aix536  07.00.19.00   d2031a          20130612 1426  
jr   Tivoli Enterprise-supplied JRE                            aix523  06.09.02.00   d2031a          -              
jr   Tivoli Enterprise-supplied JRE                            aix526  06.09.02.00   d2031a          -              
kf   IBM Eclipse Help Server                                   aix533  06.23.01.00   d2031a          20130612 1428  
ms   Tivoli Enterprise Monitoring Server                       aix536  06.23.01.00   d2050a          20130612 1419  
pa   Tivoli Performance Analyzer                               aix533  06.23.01.00   20551           20130612 1443  
sh   Tivoli Enterprise Monitoring SOAP Server                  aix536  06.23.01.00   d2050a          20130612 1419  
sy   Summarization and Pruning Agent                           aix536  06.23.01.00   d2047a          20130612 1418  
t1   File Transfer Enablement                                  aix536  07.30.00.00   20100000-0000   -              
ue   Tivoli Enterprise Services User Interface Extensions      aix536  06.23.01.00   d2050a          20130612 1419  
ui   Tivoli Enterprise Services User Interface                 aix526  06.23.01.00   d2050a          20130612 1622  
ui   Tivoli Enterprise Services User Interface                 aix533  06.23.01.00   d2050a          20130612 1442  
ui   Tivoli Enterprise Services User Interface                 aix536  06.23.01.00   d2050a          20130612 1418  
ux   Monitoring Agent for UNIX OS                              aix526  06.23.01.00   20541           20130612 1622  


PC   APPLICATION SUPPORT DESC                                  PLAT    APP VER       BUILD           INSTALL DATE    

a4   Monitoring Agent for i5/OS                                tms     06.23.01.00   20511           20130612 1443  
a4   Monitoring Agent for i5/OS                                tps     06.23.01.00   20511           20130612 1450  
a4   Monitoring Agent for i5/OS                                tpw     06.23.01.00   20511           20130612 1448  
hd   Warehouse Proxy                                           tms     06.23.01.00   d2050a          20130612 1443  
hd   Warehouse Proxy                                           tps     06.23.01.00   d2050a          20130612 1450  
hd   Warehouse Proxy                                           tpw     06.23.01.00   d2050a          20130612 1448  
it   TEC GUI Integration                                       tps     06.23.01.00   d2031a          20130612 1450  


p3   Performance Analyzer Domain for OS agent                  tms     06.23.01.00   20552           20140108 0206
p3   Performance Analyzer Domain for OS agent                  tpa     06.23.01.00   20552           20140108 0206
p3   Performance Analyzer Domain for OS agent                  tpd     06.23.01.00   20552           20140108 0205
p3   Performance Analyzer Domain for OS agent                  tps     06.23.01.00   20552           20140108 0205
p3   Performance Analyzer Domain for OS agent                  tpw     06.23.01.00   20552           20140108 0205
p4   Performance Analyzer Domain for Oracle                    tpa     06.23.01.00   20552           20140108 0206
p6   Performance Analyzer Domain for System p                  tpa     06.23.01.00   20552           20140108 0206
pa   Tivoli Performance Analyzer                               tms     06.23.01.00   20551           20140107 1055
pa   Tivoli Performance Analyzer                               tpd     06.23.01.00   20551           20140107 1057
pa   Tivoli Performance Analyzer                               tps     06.23.01.00   20551           20140107 1056
pa   Tivoli Performance Analyzer                               tpw     06.23.01.00   20551           20140107 1057
pi   Performance Analyzer Domain for ITCAM RT                  tpa     06.23.01.00   20552           20140108 0206

Clicking on the Performance Analyzer Configuration icon on the TEPS GUI and getting the below message is another indication that the " Report and Domain Definitions" for PA is not installed.





So,the best practice is to install the Base ITM and choose the ITPA components,  (i.e select the Performance Analyzer), followed by installing agent applicaiton support for the agents that we are interested in, followed by the the " Report and Domain Definitions for the Performance Analyzer as shown in one of the snapshots above.

This has to be followed by 
- Configuring the TEPS "itmcmd config -A cq" on Unix or 'Reconfigure TEPS' using the MTEMS and
- Configure the Performance Analyzer agent. 

=============================================================

The Performance Analyzer supports these following six agents 

p0      Performance Analyzer Domain for DB2
p3      Performance Analyzer Domain for OS agent
p4      Performance Analyzer Domain for Oracle
p6      Performance Analyzer Domain for System p
pi      Performance Analyzer Domain for ITCAM RT
pu      Performance Analyzer Domain for VMware

If these agents are to be supported - install the agents first, followed by

installing the Performance Analyzer Report and Domain component.

Check that the Application support paragraph in the " cinfo -t "   have these respective

paragraphs.

This ensures that you will see the correct naming convention for the agent 

in the TEPS GUI - Performance Analyzer navigation bar, and also when you bring up 

the Performance Analyzer Configuration Java panel, for configuring the tasks.

=============================================================

Best Practices Installation :Install ITM

Intall Agent ( like OS etc )

Install PA

Configure the TEPS ( CQ ) so that the respective domains are understood by the ITM.

Best Practices Debugging :

- Check if the ITM is installed. ( cinfo -t )

- Check if the ITPA Report and Domain component is installed ( i.e the PA,P3 , P3 etc show up in the 

Application Support paragraph.

- Enable tracing in the agent.cfg which will load more debug information in the 

kpacma.log .Change Info to Debug, Restart PA and watch for the kpacma.log debug messages.

AgentIdUniqueId__file=local.cfg
ConsolePassword__file=local.cfg
DisableVACM=true
EngineBoots__file=local.cfg
LogCount=3
LogFile=/opt/IBM/ITM/logs/kpacma.log
LogLevel=Debug  <<<<<<<<<<<<<<<<=======================
LogSize=10000000
NotificationQueueLimit=50
UdpPort=-1
 

If DB2 - then this line ( change it appropriately ) should show up 

     2014-04-02 04:17:08: Using jvm classpath /opt/IBM/ITM/li6263/pa/bin/kpaxjdbc.jar:/opt/ibm/db2/V9.7/java/db2jcc_license_cu.jar:/opt/ibm/db2/V9.7/java/db2jcc.jar