Search This Blog

Tuesday, 7 January 2014

Usage Tracking in OBIEE 11.1.1.7.0 (11g)

Why Usage Tracking:
Usage Tracking is used to monitor system and ad-hoc query performance and to provide input on usage trends for use in billing users and departments for resources. Usage tracking is particularly useful in determining user queries that are creating performance bottlenecks, based on query frequency and response time. When usage tracking is enabled, the Oracle BI Server collects usage tracking data for each query and writes statistics to a usage tracking log file or inserts them directly to a database table. For the purposes of this tutorial, you will use a database table, which is the recommended leading practice.

Here We will separate Usage Tracking Process to 4 Steps

I. Creating Uasge Tracking Table
II. Creating and Customizing rpd file
III. changing the Configuration in EM
IV. Testing the Usage Tacking in Answers

StepI: Creating Usage Tracking Table
If we latest OBIEE 11g installed in our machine, open sqlplus and connect DEV_BIPLATFORM schema.
write the below query:
select table_name from tabs where table_name like='S%';
The table in the name S_NQ_ACCT is related to usage tracking. so we donot have any manual work in the usage tracking table creation. So before setting up the usage tracking we couldn't have any rows in the table

StepII: Setting up the Repository File
1. Create 'New Database' by right clicking on the empty space in physical layer of the rpd  and name it as 'UsageTracking'
2. Right click on the physical layer object 'UsageTracking' ->New Object -> select 'Connection Pool and enter the detail like below screen 
Connection Pool Name: UsageTracking ConnectionPool
Data Source Name: (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=Bose-PC)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME=ORCL)))
OR
Data Source Name: //Bose-PC:1521/ORCL 
User Name: DEV_BIPLATFORM
Password: Admin123
Click 'OK' after you enter the password and you will be prompted to confirm the password. Type the same password.  
3. Import the 'S_NQ_ACCT' table from DEV_BIPLATFORM Schema to the 'UsageTracking'  database repository.
4. Double Click on the DEV_BIPLATFORM physical folder and change it 'UsageTracking Schema' So that It would like below screen
5. Now Come to BMM Layer and Create UsageTracking BMM Layer folder and Create for new logical tables in that BMM Layer like shown in the below picture

6. Drag the following three physical columns from Usage Tracking Schema>S_NQ_ACCT to the Measures logical table in the UsageTracking business model. For each column, right-click the logical column and select Rename, and then apply aggregation rule like shown in the table:

Physical Column
Rename
Aggregation Rule
QUERY_TEXT
Query Count
Count
ROW_COUNT
Row Count
Sum
TOTAL_TIME_SEC
Total Time Seconds
Sum
  
7. Drag the following three physical columns from UsageTracking Schema>S_NQ_ACCT to the Time logical table in the UsageTracking business model. Rename them as follows:

Physical Column
Rename
Key
START_DT
Start Date
 Yes
START_HOUR_MIN
Start Hour Minute

END_HOUR_MIN
End Hour Minute


8. Here is the example screen screen for how to create Key for Time Logical table
Under Keys Tab -> type 'Time_key' in the key name and select 'Start Date' in the columns.
9. Drag the following two physical columns from UsageTracking Schema>S_NQ_ACCT to the Topic logical table in the UsageTracking business model. Rename them as follows:
Physical Column Rename
QUERY_TEXT Logical SQL
SUBJECT_ AREA_NAME Subject Area
 Do not forget to to apply 'Logical SQL' as a key column for this logical table.

10. Drag the USER_NAME physical column from UsageTracking Schema>S_NQ_ACCT to the User logical table in the UsageTracking business mode. Rename it to User Name and apply this column as a key to this table.


Below is the complete BMM Layer Model Screen for UsageTracking:

11. Right click on the UsageTracking BMM Layer folder -> select 'Business Model Diagram' -> Whole Diagram and the create joins between the tables as shown in the below screen:
12. Just drag the UsageTracking folder to Presentation Layer of the repository.
Now Save the repository and check the consistency check. RPD works are done!!!

StepIII: Setting up the EM
 1. Open EM window using the link  http://localhost:7001/em by entering weblogic username and password
Expand WebLogicDomain  and the click 'bifoundation_domain' in the left pane. Now select 'System MBean Browser' in the WebLogic Domain in the right side pane like show in the picture
2. expand 'Application Defined MBeans' and the expand 'oracle.biee.admin' in that
3. Expand 'BIDomain' in oracle.biee.admin and click on second 'BIDomain' as show in the picture. Now select 'operation' tab from right side pane and then click 'lock'
Click 'Invoke'. Once we get the screen like below, click 'Return'
4. Now expand BIDomain.BIServer.ServerConfiguration under oracle.biee.admin from the left pane. Now select all the following option from the right side pane and apply the change using the following steps
                         UsageTrackingCentrallyManaged
                         UsageTrackingConnectionPool
                         UsageTrackingDirectInsert
                         UsageTrackingEnabled
                         UsageTrackingPhysicalTableName
Select UsageTrackingCentrallyManaged and then select value 'true' and apply. After successful apply, click Return to previous screen
Select UsageTrackingConnectionPool and type the value "UsageTracking".UsageTracking ConnectionPool" and then apply. After successful apply, click Return to previous screen

Select UsageTrackingPhysicalTableName and type the value "UsageTracking"."UsageTracking Schema"."S_NQ_ACCT" and then apply. After successful apply, click Return to previous screen
Select UsageTrackingDirectInsert and select the value 'true' and then apply. After successful apply, click Return to previous screen
Select UsageTrackingEnabled and select the value 'true' and then click apply. After successful apply, click Return to previous screen
So with the above screen all the configuration related to Usage Tracking is applied. Now  Come to BIDomain and select 'BIDomain' under orace.biee.admin to commit the changes. Select Operation tab and select 'simplecommit'
In simplecommit screen click 'Invoke'. After successful execution of simplecommit click retun to previous screen.
Now upload the updated repository in EM and restart the BI Services.

StepIV: Checking results with Answers using UsageTracking Subject Area
Now Browse some analysis from the existing dashboard or create some reports and create one report using "UsageTracking" subject for the details
select User Name from User, Logical SQL and Subject Area from Topic, Start Hour Minute from Time and Row Count from Measures table in the criteria section of creating new analysis. Now check with the results
Below Screen Shows the results for username, logical sql, query count, row count, total time seconds from the Usage Tracking subject Area.
Now If you are checking the table 'S_NQ_ACCT' in tabale, we could see the updated records.

Cheers!
Bose

Friday, 3 January 2014

All Oracle Certification Dumps

Hi All,

If you are trying to write any oracle related certifications and looking for dumps, Let me know. I know some peoples online who gives dumps in very low rate.

Cheers!
Bose

Thursday, 2 January 2014

OBIEE 11.1.1.7.0 Step by Step Installation

This post will guide us through the  step by step installation of OBIEE 11.1.1.7.0. Here I don't find any difference in RCU installation between in previous version with this version. Still if you want to know the RCU installation steps click here
Download the OBIEE 11g version from here or from oracle e-delivery site and extract all the four disk into a single folder and click setup.exe from the Disk1

Universal Installer window will start and will check for the initial set up and system requirement.
After the successful precheck the first step of our OBIEE 11.1.1.7.0 starts with the below window. Just Click 'Next'
Step2:
If you have oracle Support username and password then update then use that in this step or just select first option 'Skip Software updates' and click 'Next'
Step3:
Select the appropriate installation step here. I am going to install all the component of BI so selected here 'Enterprise Install' and then click 'Next'
Step4:
This step will just check operating system certification and physical memory. Just click 'Next' after the check passed through
Step5:
As It is a new installation, select the option 'Create New BI System' and type password for weblogic User.
Note: Save or remember the password because this is the password going to be used to access BI system, EM, Console and answers later on..
and then click 'Next'
Step6:
In this step we have to select the actual folder where we want to install BI 11g. So here I have created an folder in C:\ driver and selected here by browsing the home location in this window. Remaining boxes will be automatically filled once we selected the home location then click 'Next'
With the above window we will get warning like below screen. Just Click 'Yes and click 'Next' with the above screen
Step7:
In this step we would know what are the components going to be installed. If you are really going to user 'RTD' and Essbase Suite the leave it selected or Just uncheck with the below screen and click 'Next'
Step8:
In this step we have to select the database where we have installed our RCU. I have done in oracle database so selected the oracle database in database type

Connection String: dbservername:portnumber:servicename
BIPLATFORM Name: DEV_BIPLATFORM
BIPLATFORM Pwd: Admin123

Note: This username and password would be same which we have given when we installed RCU
Step9:
Same steps like the previous step but here with DEV_MDS username and password. After entering all the details just click 'Next'
Step10:
Just Select 'Auto Port Configuration' if you want to install with the default port numbers that oracle do the installation and then click 'Next'
Step11:
If we have oracle support email id we could mention with this step or just deselect the option click 'Yes' with the warning screen and click 'Next' with the below step

Step12:
With this step just click 'Install' so that the actual installation will be started with the below screen:

Step13:
Just watch the installation progress with this step
It take a while even the progress bar shows 100%. Post installation script might be take some time so be patient the steps will pass through.
Step14:
After successful installation the configuration steps will start. It takes a while to finish all the configuration so wait to finish and then just click 'Next' when the configuration shows 100%
Step15:
So actual installation and configuration are over with the above step. If you want to save the path details for middleware home, domain home and others click 'Save' with the below screen and save it in a file for reference. and the just click 'Finish' to complete the installation.
Now browse through the answers, EM and console and Play with BI.
Happy Blogging!
Cheers!
Bowe

Wednesday, 1 January 2014

OBIA with ODI

The recent version of Oracle BI Application (11.1.1.7.1) has been released with Oracle Data Integrator (ODI).  Here ODI replacing Informatica and Data warehouse Adminstration Console (DAC) and act as ETL tool and also as scheduler.

ODI is following the concept ELT (Extract, Transform, Load) instead of ETL concept that Informatica follows. ODI is having own Agent that will manage Loading, Scheduling jobs and by the way It is replacing DAC.

I have started Exploring this for one of our new implementation and will keep you posted in coming days!

Cheers!
Bose

Friday, 27 December 2013

ODI Interview Questions and Answers

What is Oracle Data Integrator (ODI)?
Oracle acquired SUNOPSIS with its ETL tool called "Sunopsis Data Integrator" and renamed to  Oracle Data Integrator (ODI) is an E-LT (Extract, Load and Transform) tool used for high-speed data movement between disparate systems.

The latest version, Oracle Data Integrator Enterprise Edition (ODI-EE 12c) brings together "Oracle Data Integrator" and "Oracle Warehouse Builder" as separate components of a single product with a single licence.

Explain what is ODI?why is it different from the other ETL tools.
ODI stands for Oracle Data Integrator. It is different from another ETL tool in a way that it uses E-LT approach as opposed to ETL approach. This approach eliminates the need of the exclusive Transformation Server between the Source and Target Data server. The power of the target data server can be used to transform the data. i.e. The target data server acts as staging area in addition to its role of target database. 

while loading the data in the target database (from staging area) the transformation logic is implemented. Also, the use of appropriate CKM (Check Knowldege Module) can be made while doing this to implement data quality requirement.

What is E-LT? Or What is the difference between ODI and other ETL Tools?
E-LT is an innovative approach to extracting, loading and Transforming data. Typically ETL application vendors have relied on costly heavyweight , mid-tier server to perform the transformations required when moving large volumes of data around the enterprise. 

ODI delivers unique next-generation, Extract Load and Transform (E-LT) technology that improves performance and reduces data integration costs, even across heterogeneous systems by pushing the processing required down to the typically large and powerful database servers already in place within the enterprise.

Components of Oracle Data Integrator?
"Oracle Data Integrator" comprises of:
- Oracle Data Integrator + Topology Manager + Designer + Operator + Agent
- Oracle Data Quality for Data Integrator
- Oracle Data Profiling

What systems can ODI extract and load data into?
ODI brings true heterogeneous connectivity out-of-the-box, it can connect natively to Oracle, Sybase, MS SQL Server, MySQL, LDAP, DB2, PostgreSQL, Netezza.

It can also connect to any data source supporting JDBC, its possible even to use the Oracle BI Server as a data source using the jdbc driver that ships with BI Publisher

What are Knowledge Modules?
Knowledge Modules form the basis of 'plug-ins' that allow ODI to generate the relevant execution code , across technologies , to perform tasks in one of six areas, the six types of knowledge module consist of:

  • Reverse-engineering knowledge modules are used for reading the table and other object metadata from source databases
  • Journalizing knowledge modules record the new and changed data within either a single table or view or a consistent set of tables or views
  • Loading knowledge modules are used for efficient extraction of data from source databases for loading into a staging area (database-specific bulk unload utilities can be used where available)
  • Check knowledge modules are used for detecting errors in source data
  • Integration knowledge modules are used for efficiently transforming data from staging area to the target tables, generating the optimized native SQL for the given database
  • Service knowledge modules provide the ability to expose data as Web services
ODI ships with many knowledge modules out of the box, these are also extendable, they can modified within the ODI Designer module.
Does my ODI infrastructure require an Oracle database?No, the ODI modular repositories (Master + and one of multiple Work repositories) can be installed on any database engine that supports ANSI ISO 89 syntax such as Oracle, Microsoft SQL Server, Sybase AS Enterprise, IBM DB2 UDB, IBM DB2/40.
Does ODI support web services?
Yes, ODI is 'SOA' enabled and its web services can be used in 3 ways:

  • The Oracle Data Integrator Public Web Service, that lets you execute a scenario (a published package) from a web service call
  • Data Services, which provide a web service over an ODI data store (i.e. a table, view or other data source registered in ODI)
  • The ODIInvokeWebService tool that you can add to a package to request a response from a web service

what is the ODI Console?
ODI console is a web based navigator to access the Designer, Operator and Topology components through browser. 

suppose I having 6 interfaces and running the interface 3 rd one failed how to run remaining interfaces?
If you are running Sequential load it will stop the other interfaces. so goto operator and right click on filed interface and click on restart. If you are running all the interfaces are parallel only one interface will fail and other interfaces will finish. 

what is load plans and types of load plans?
Load plan is a process to run or execute multiple scenarios as a Sequential or parallel or conditional based execution of your scenarios. And same we can call three types of load plans , Sequential, parallel and Condition based load plans. 

what is profile in ODI?
profile is a set of objective wise privileges. we can assign this profiles to the users. Users will get the privileges from profile

How to write the sub-queries in ODI?
Using Yellow interface and sub queries option we can create sub queries in ODI. or Using  VIEW we can go for sub queries Or Using ODI Procedure we can call direct database queries
in ODI.

How to remove the duplicate in ODI?
Use DISTINCT in IKM level. it will remove the duplicate rows while loading into target. 

Suppose having unique and duplicate but i want to load unique record one table and duplicates one table?
Create two interfaces or once procedure and use two queries one for Unique values and one for duplicate values. 
how to implement data validations?
Use Filters & Mapping Area AND Data Quality related to constraints use CKM Flowcontrol.

How to handle exceptions?
Exceptions In packages advanced tab and load plan exception tab we can handle exceptions.

In the package one interface got failed how to know which interface got failed if we no access to operator?
Make it mail alert or check into SNP_SESS_LOg tables for session log details.

How to implement the logic in procedures if the source side data deleted that will reflect the target side table?
User this query on Command on target Delete from Target_table where not exists (Select 'X' From Source_table Where Source_table.ID=Target_table.ID).

If the Source have total 15 records with 2 records are updated and 3 records are newly inserted at the target side we have to load the newly changed and inserted records
Use IKM Incremental Update Knowledge Module for Both Insert n Update operations.

Can we implement package in package?
Yes, we can call one package into other package.

How to load the data with one flat file and one RDBMS table using joins?
Drag and drop both File and table into source area and join as in Staging area.

If the source and target are oracle technology tell me the process to achieve this requirement(interfaces, KMS, Models)
Use LKM-SQL to SQL or LKM-SQL to Oracle , IKM Oracle Incremental update or Control append.
what we specify the in XML data server and parameters for to connect to xml file?
File name with location :F and Schema :S this two parameters

How to reverse engineer views(how to load the data from views)?
In Models Go to Reverse engineering tab and select Reverse engineering object as
VIEW.

Wednesday, 18 December 2013

Start/Stop OBIEE 11g Services in Linux

Starting Oracle BI 11g Services:

Start Admin Server
switch to the user who owns BI installation.
cd /u01/Oracle/Middleware/user_projects/domains/bifoundation_domain/bin
nohup ./startWebLogic.sh -Dweblogic.management.username=weblogic -Dweblogic.management.password=welcome1 &
tail -f nohup.out

start Node manager
cd /u01/Oracle/Middleware/wlserver_10.3/server/bin
nohup ./startNodeManager.sh > NOD.out &
tail -f NOD.out

Start managed Server
cd /u01/Oracle/Middleware/wlserver_10.3/common/bin
./commEnv.sh
cd /u01/Oracle/Middleware/user_projects/domains/bifoundation_domain/bin
./setDomainEnv.sh
nohup ./startManagedWebLogic.sh bi_server1 t3://servername:7001 > bis1_startup.log &
tail -f bis1_startup.log
nohup ./startManagedWebLogic.sh odi_server1 t3://servername:7001 > bis2_startup.log &
tail -f bis2_startup.log

start OPMN
cd /u01/Oracle/Middleware/instances/instance1/bin
./opmnctl startall
./opmnctl status

Stopping Oracle BI 11g Services

Stop OPMN
cd /u01/Oracle/Middleware/instances/instance1/bin
./opmnctl stopall
./opmnctl status

Stop Managed server
cd /u01/Oracle/Middleware/user_projects/domains/bifoundation_domain/bin
./stopManagedWebLogic.sh bi_server1 t3://servername:7001 weblogic welcome1
./stopManagedWebLogic.sh odi_server1 t3://servername:7001 weblogic welcome1

Stop Admin Server
cd /u01/Oracle/Middleware/user_projects/domains/bifoundation_domain/bin
sh stopWebLogic.sh

Cheers!
Bose

What is Oracle Database Link and How to create database link (DB Link)

 https://www.oracletutorial.com/oracle-administration/oracle-create-database-link/

Recent Posts