oracle data integrator installation guide

Business Intelligence Solution Providers http://www. learnhyperion.wordpress.com 1

Document:

Oracle Data Integrator 11g (11.1.1.3) Installation and Configuration Guide with WebLogic server

Description:

This document is prepared to show easy steps to installation and configuration of ODI.

History:

Version Description Change Author Publish Date

0.1 Initial Draft Gourav Atalkar 9-Oct-2010 0.1 Reviewed Amit Sharma 1-Nov-2010


Installation of Oracle Data Integrator

Title Page No.

1). Introduction to oracle data integrator 3

2). Software and Hardware requirements 7

3). Installation of oracle 10g Enterprise Edition 9

4). Creation of Repository 13

5). Installation of WebLogic Server 19

6). Installation of Oracle Data Integrator 25

7). Configuring and deploying ODI Console 33


Introduction to Oracle Data Integrator

A widely used data integration software product, Oracle Data Integrator provides a new declarative design approach to defining data transformation and integration processes, resulting in faster and simpler development and maintenance. Based on a unique E-LT architecture (Extract - Load Transform), Oracle Data Integrator not only guarantees the highest level of performance possible for the execution of data transformation and validation processes but is also the most cost-effective solution available today. Oracle Data Integrator provides a unified infrastructure to streamline data and application integration projects.

Here are the key reasons why companies choose Oracle Data Integrator for their data integration needs: Faster and simpler development and maintenance: The declarative rules driven approach to data integration greatly reduces the learning curve of the product and increases developer productivity while facilitating ongoing maintenance. This approach separates the definition of the processes from their actual implementation, and separates the declarative rules (the "what") from the data flows (the "how"). Data quality firewall: Oracle Data Integrator ensures that faulty data is automatically detected and recycled before insertion in the target application. This is performed without the need for programming, following the data integrity rules and constraints defined both on the target application and in Oracle Data Integrator. Better execution performance: traditional data integration software (ETL) is based on proprietary engines that perform data transformations row by row, thus limiting performance. By implementing an E-LT architecture, based on your existing RDBMS engines and SQL, you are capable of executing data transformations on the target server at a set-based level, giving you much higher performance. Simpler and more efficient architecture: the E-LT architecture removes the need for an ETL Server sitting between the sources and the target server. It utilizes the source and target servers to


perform complex transformations, most of which happen in batch mode when the server is not busy processing end-user queries. Platform Independence: Oracle Data Integrator supports all platforms, hardware and OSs with the same software. Data Connectivity: Oracle Data Integrator supports all RDBMSs including all leading Data Warehousing platforms such as Oracle, Exadata, Teradata, IBM DB2, Netezza, Sybase IQ and numerous other technologies such as flat files, ERPs, LDAP, XML. Cost-savings: the elimination of the ETL Server and ETL engine reduces both the initial hardware and software acquisition and maintenance costs. The reduced learning curve and increased developer productivity significantly reduce the overall labor costs of the project, as well as the cost of ongoing enhancements. Oracle Data Integrator Component Architecture: The Oracle Data Integrator platform integrates in the broader Fusion Middleware platform and becomes a key component of this stack. Oracle Data Integrator provides its run-time components as Java EE applications, enhanced to fully leverage the capabilities of the Oracle WebLogic Application Server. Oracle Data Integrator components include exclusive features for Enterprise-Scale Deployments, high availability, scalability, and hardened security.


Repositories: The central component of the architecture is the Oracle Data Integrator Repository. It stores configuration information about the IT infrastructure, metadata of all applications, projects, scenarios, and the execution logs. The Oracle Data Integrator Repository is composed of one Master Repository and several Work Repositories. Objects developed or configured through the user interfaces are stored in one of these repository types. There is usually only one master repository that stores the following information: 1) Security information including users, profiles and rights for the ODI platform 2) Topology information including technologies, server definitions, schemas, contexts, languages and so forth. 3) Versioned and archived objects. The work repository is the one that contains actual developed objects. Several work repositories may coexist in the same ODI installation (for example, to have separate environments or to match a particular versioning life cycle). A Work Repository stores information for: 1) Models, including schema definition, data stores structures and metadata, fields and columns definitions, data quality constraints, cross references, data lineage and so forth. 2) Projects, including business rules, packages, procedures, folders, Knowledge Modules, variables and so forth. 3) Scenario execution, including scenarios, scheduling information and logs. When the Work Repository contains only the execution information (typically for production purposes), it is then called an Execution Repository. ODI Studio and User Interfaces: Administrators, Developers and Operators use the Oracle Data Integrator Studio to access the repositories. ODI Studio provides four Navigators for managing the different aspects and steps of an ODI integration project:

1) Designer Navigator is used to design data integrity checks and to build transformations such as for example:

• Automatic reverse-engineering of existing applications or databases • Graphical development and maintenance of transformation and integration interfaces • Visualization of data flows in the interfaces • Automatic documentation generation • Customization of the generated code


2) Operator Navigator is the production management and monitoring tool. It is designed for IT production operators. Through Operator Navigator, you can manage your interface executions in the sessions, as well as the scenarios in production.

3) Topology Navigator is used to manage the data describing the information system's physical

and logical architecture. Through Topology Navigator you can manage the topology of your information system, the technologies and their datatypes, the data servers linked to these technologies and the schemas they contain, the contexts, the languages and the agents, as well as the repositories. The site, machine, and data server descriptions will enable Oracle Data Integrator to execute the same integration interfaces in different physical environments.

4) Security Navigator is the tool for managing the security information in Oracle Data

Integrator. Through Security Navigator you can create users and profiles and assign user rights for methods (edit, delete, etc) on generic objects (data server, datatypes, etc), and fine-tune these rights on the object instances (Server 1, Server 2, and so forth).

Run-Time Agent: At design time, developers generate scenarios from the business rules that they have designed. The code of these scenarios is then retrieved from the repository by the Run-Time Agent. This agent then connects to the data servers and orchestrates the code execution on these servers. It retrieves the return codes and messages for the execution, as well as additional logging information – such as the number of processed records, execution time and so forth - in the Repository. The Agent comes in two different flavors:

• The Java EE Agent can be deployed as a web application and benefit from the features of an application server.

• The Standalone Agent runs in a simple Java Machine and can be deployed where needed to perform the integration flows.

Oracle Data Integrator Console: Business users (as well as developers, administrators and operators), can have read access to the repository, perform topology configuration and production operations through a web based UI called Oracle Data Integrator Console. This web application can deployed in a Java EE application server such as Oracle WebLogic. To manage and monitor the Java EE and Standalone Agents as well as the ODI Console, Oracle Data Integrator provides a new plug-in that integrates in Oracle Fusion Middleware Control Console.

System Requirements


Ø Operating system: Windows, UNIX, Sun Solaris, HP-UX, IBM AIX, Red Hat Enterprise Linux on Intel-compatible x86

Ø RAM: Minimum: 512 MB

Ø Disk space: Minimum: 300 MB of free space to install the software and 1 GB of free space on the drive that contains the temporary directory used by ODI components.

Ø JDK (java development toolkit): Install jdk-6u18-windows-i586

Ø Repository Database: The Repository can be installed on any relational database engine supporting ANSI ISO 89 syntax, such as Oracle, Microsoft SQL Server, Sybase AS Enterprise, IBM DB2 UDB, IBM DB2/400, etc.

The storage space requirements for repositories are the following: • Master Repository: 30 Mb of storage space. • Work Repository: 40 Mb of storage space. Note that the storage space required may vary depending on the size of your models and projects, and on the volume of execution logs you keep in this repository.

Ø A TCP/IP network.

Ø Downloading the ODI Installer and Repository Creation Utility


http://www.oracle.com/technetwork/middleware/data-integrator/downloads/index.html

Ø Downloading the WebLogic Server Installer

http://www.oracle.com/technetwork/middleware/downloads/index-087510.html

Installation of Oracle 10g Database

http://www.oracle.com/technetwork/middleware/data-integrator/downloads/index.html



Step: 1) Run the installer of Oracle 10g Database.

Step: 2) Enter database password for system account.


Creation of Repository

Step:1) Now copy the rcu_home directory to c drive and then run the following command:

On Windows operating systems:

cd RCU_HOME\bin rcu.bat


Step: 2) Select the create radio button for creating new master and work repository into database.

Step:3) Enter your database type we are using oracle 10g that’s why we are specifying oracle database. Enter your system name in host name textbox, next is port name for oracle it is 1521 and service name is orcl . After that you need to specify user name and password for one schema which has DBA privileges. Click ‘Next’.


Step: 4) It will create all the related metadata into database.

Step: 5) Now select Oracle data integrator from the component list and give appropriate name to schema which contains master and work repository.


Step: 6) Enter password for schema which contains master and work repository.

Step: 7) Enter details for master repository and work repository.


Step: 8) This screen will show you the default table space name and temporary table space name for the master and work repository. Click ‘Next’ to proceed.


Step: 9) This screen shows the details of Repository. Click on create button for creating repository.

Step: 10) Repository is create now.


Installation of WebLogic Server

WebLogic Server is used to configure the Oracle data Integrator Console. Download it from following link: http://www.oracle.com/technetwork/middleware/downloads/index-087510.html and run the installer wls1033_oepe111150_win32 .

Step: 1) Click ‘Next’ to continue.



Step: 2) This installation wizard will ask you to select Middleware home directory, by default it will install into your default windows directory.

Step:3) If you want to receive the security updates from oracle enter your email address and your oracle support password otherwise bypass it.


Step: 4) Select the type of installation you want to perform. Select custom for advance option.

Step: 5) Select the components you want to install other then default components.


Step: 6) This screen will show you list of java virtual machine installation components.

Step: 7) Here you have to provide the directories where you want to install the weblogic server components.


Step: 8) This will install the windows service to make indicated functionality available after machine reboot. You can select ‘No’ if not required. Click ‘Next’.

Step: 9) Select the location for shortcut if you want to show oracle shortcut to all profile select All users it’s recommended. Click ‘Next’.


Step: 10) This screen shows the installation summary.


Installation of oracle Data Integrator

Step: 1) Run the installer from the Disk 1 directory of Oracle data Integrator unzipped folder.

Step: 2) Select all the components check box for installing all the components from the given list.


Step: 3) This screen will shows the prerequisite checks for oracle data integrator.

Step: 4) Specify the installation location for ODI by default it will installed into the weblogic server directory.


Step: 5) If you have previously created the repository you can configure the ODI else you can skip it.

Step: 6) Specify database type, Connection string, repository user name and password that you have specified previously during the time of repository creation. Click ‘Next’.


Step: 7) Enter the password for the user SUPERVISOR it is SUNOPSIS.

Step: 8) Select the work repository.


Step: 9) Specify details of agent name and port. Click ‘Next’.

Step: 10) This screen will shows the installation summary. Click ‘Install’ to continue.


Step: 11) This screen will shows the installation progress.

Step: 12) Click ‘Next’.


Step: 13) Click ‘Finish’.

Step: 13) Go to Startààààprogramsààààoracleààààoracle Data IntegratorààààODI Studio.

When you first time start the ODI Studio it will ask you for the root of JDK bin directory for java.exe.


This is the Oracle Data Integrator start Page


Configuring and Deploying the ODI Console

Oracle Data Integrator Console: The new Oracle Data Integrator Console replaces and unifies the former 10g Metadata Navigator and Lightweight Designer components. This web interface for production operations has been rewritten using the ADF-Faces Ajax Framework for a rich user experience. Using this console, production users can set up an environment, export and import the repositories, manage run-time operations, monitor the sessions, diagnose the errors, browse design-time artifacts and generate lineage reports. This web interface integrates seamlessly with Oracle Fusion Middleware Control Console and allows Fusion Middleware administrators to drill down into the details of any Oracle Data Integrator design-time and run-time object. Pre Requisite:

1) Oracle Data Integrator 11g (11.1.1) installed on client machine.

2) Master Repository and Work Repository created in oracle database.

3) WebLogic Server 11g R1 installed on same client machine.


Step:1) After the complete installation of odi and web logic server now go to the start àprogramsàoracle web logic àweb logic server 11g R1àtoolsàconfiguration wizard

Step: 2) You will get following screen select create a new weblogic domain. And press next.


Step: 3) Select the Following options as shown below.

Step: 4) Give a meaningful domain name.


Step: 5) Provide the Administrator User Name and Password ,required to login into domain account.

Step: 6) Select the required JDK from the options


Step: 7) Provide the details of the MASTER Repository account

Step: 8) Provide the details of the WORK Repository account


Step: 9) Click Next and test the accounts. If you have error in this step , its means the account information is wrong , Please go back and do the required changes and once the account are correct ,you will get a Test successful message.

Step: 10) Click the Following as we need to do few settings changes.


Step: 11) If required change the Listener address to the required IP address or hostname you want to domain to be and similarly the Port No. For this post the default is used.

Step: 12) Configure the Machine Name with Node Manager Listener address and Port.


Step: 13) Assign the Server; although by default the odi_server1 is assigned but I have assigned Adminserver too so that I can access the odiconsole from 7001 port itself.

Step: 14) Make sure you check the option oraclediagent and odiconsole under Application.


Step: 15) Check the JDBC Services and odiMasterRepository and odiWorkRepository

Step: 16) Confirm all the setting and options are correct and click on Create.


Step: 17) Finally, you will get a Domain created with the Admin Server URL. Check mark Start Admin Server.

Step:18) if you have not start the services of admin server then Go to start àprogramà weblogic serveràUser projectsàAdmin serveràstart admin server for weblogic server domain.


Step: 19) It will show the following start screen and the service for the admin server is started now.

Step: 20) Again Go to start àprogramà weblogic serveràUser projectsàAdmin serverà admin server console or your Web Browser and type in the following address –http://localhost:7001/console/login/LoginForm.jsp Change the local host and port to whatever is listed in the Admin Server URL above .

http://localhost:7001/console/login/LoginForm.jsp


Step: 21) Once logged in, Under Environment – > click on Servers.

Step: 22) You will able to see all the Server.


Step: 23 ) Click on Adminserver . You will be taken to a page as shown below, click Deployments and you will be able to see odiconsole, oraclediagent.

Step:24) Expand odiconsole and you will be able to see odiconsole under Modules. Click that and you will be taken to another page.

Step: 25) Go to Testing tab and expand odiconsole there finally we got our URL. Click the URL on default. http://localhost:7001/odiconsole

http://localhost:7001/odiconsole


Step: 26) Once logged in you will be able to see the Master and Work Repository.

Step: 27) Use the required SUPERVISOR account to login


Step: 28) Sample Master Repository Console Screen.

Step: 29) Sample Work Repository Console Screen.

oracle data integrator installation guide

Documents