Oracle Fusion Middleware Getting Started With Oracle Data Integrator
Oracle Fusion MiddlewareGetting Started with Oracle Data Integrator11g Release 1 (11.1.1)E12641-02April 2011
Oracle Fusion Middleware Getting Started with Oracle Data Integrator, 11g Release 1 (11.1.1)E12641-02Copyright 2011, Oracle and/or its affiliates. All rights reserved.Primary Author:Laura Hofman MiquelThis software and related documentation are provided under a license agreement containing restrictions onuse and disclosure and are protected by intellectual property laws. Except as expressly permitted in yourlicense agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license,transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverseengineering, disassembly, or decompilation of this software, unless required by law for interoperability, isprohibited.The information contained herein is subject to change without notice and is not warranted to be error-free. Ifyou find any errors, please report them to us in writing.If this software or related documentation is delivered to the U.S. Government or anyone licensing it onbehalf of the U.S. Government, the following notice is applicable:U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical datadelivered to U.S. Government customers are "commercial computer software" or "commercial technical data"pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. Assuch, the use, duplication, disclosure, modification, and adaptation shall be subject to the restrictions andlicense terms set forth in the applicable Government contract, and, to the extent applicable by the terms ofthe Government contract, the additional rights set forth in FAR 52.227-19, Commercial Computer SoftwareLicense (December 2007). Oracle USA, Inc., 500 Oracle Parkway, Redwood City, CA 94065.This software is developed for general use in a variety of information management applications. It is notdeveloped or intended for use in any inherently dangerous applications, including applications which maycreate a risk of personal injury. If you use this software in dangerous applications, then you shall beresponsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure the safe useof this software. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use ofthis software in dangerous applications.Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarksof their respective owners.This software and documentation may provide access to or information on content, products, and servicesfrom third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim allwarranties of any kind with respect to third-party content, products, and services. Oracle Corporation andits affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use ofthird-party content, products, or services.
ContentsPreface . viiAudience. viiDocumentation Accessibility . viiRelated Documents . viiiConventions . viii1 Oracle Data Integrator roduction to Oracle Data Integrator.The Business Problem .A Unique Solution .ODI Component Architecture.Repositories .ODI Studio and User Interfaces.Run-Time Agent.Oracle Data Integrator Console .Get Started with Oracle Data Integrator.1-11-11-11-21-31-41-41-51-52 Installing Oracle Data Integrator and the Demonstration .42.3Preparing to Install .Review System Requirements and Certification.Understand Oracle Fusion Middleware Support of 64-bit JDK.Create ODI Repositories .Installing Oracle Data Integrator .Downloading the Installer and the Demo Environment .Starting the Installer .Installation Types.Installation Instructions .Installing the Demonstration Environment .2-12-12-22-22-22-22-32-32-32-63 Working with the ETL Project3.13.23.2.13.2.23.2.3The Example Environment .The Data Models .Orders Application - HSQL.Parameters - FILE.Sales Administration - HSQL.3-13-23-23-33-3iii
3.3Integration Challenges . 3-44 Starting Oracle Data Integrator4.14.24.2.14.2.24.34.3.14.3.2Starting the Demonstration Environment .Starting Oracle Data Integrator Studio .Starting ODI Studio .Defining a new Getting Started Login .Introduction to Using the ODI Navigators .Designer Navigator .Operator Navigator .4-14-24-24-34-64-64-85 Implementing Data Quality Control5.1Introduction to Data Integrity Control . 5-15.2SRC CUSTOMER Control Example . 5-25.2.1Objective. 5-25.2.2Interpreting the Problem . 5-35.2.3Creating Constraints . 5-35.2.3.1Age Constraint . 5-35.2.3.2Reference Constraint . 5-45.2.4Run the Static Control . 5-65.2.5Follow the Execution of the Control in Operator Navigator. 5-75.2.6Interpreting the Results in Operator Navigator. 5-85.2.6.1Determining the Number of Invalid Records . 5-85.2.6.2Reviewing the Invalid Records. 5-96 Working with Integration Interfaces6.1Pop. TRG CUSTOMER Interface Example. 6-16.1.1Purpose and Integration Requirements. 6-16.1.2Interface Definition. 6-26.1.3Creating the Integration Interface . 6-36.1.3.1Insert a New Integration Interface . 6-46.1.3.2Define the Target Datastore . 6-56.1.3.3Define the Source Datastores . 6-66.1.3.4Define the Lookup Table . 6-86.1.3.5Define the Join between the Source Datastores. 6-136.1.3.6Define the Mappings. 6-136.1.3.7Define the Data Loading Strategies (LKM). 6-196.1.3.8Define the Data Integration Strategies (IKM). 6-206.1.3.9Define the Data Control Strategy . 6-206.2Pop. TRG SALES Interface Example . 6-216.2.1Purpose and Integration Requirements. 6-216.2.2Interface Definition. 6-226.2.3Creating the Integration Interface . 6-236.2.3.1Insert a New Integration Interface . 6-236.2.3.2Define the Target Datastore . 6-246.2.3.3Define the Source Datastores . 6-24iv
6.2.3.46.2.3.56.2.3.66.2.3.76.2.3.86.2.3.9Define Joins between the Source Datastores .Define the Order Filter.Define the Transformation Rules .Define the Data Loading Strategies (LKM).Define the Data Integration Strategies (IKM).Define the Data Control Strategy .6-246-246-256-276-286-287 Working with Packages7.1Introduction . 7-17.1.1Automating Data Integration Flows . 7-17.1.2Packages . 7-17.1.2.1Scenarios . 7-27.2Load Sales Administration Package Example . 7-27.2.1Purpose. 7-27.2.2Developments Provided with Oracle Data Integrator . 7-27.2.3Problem Analysis . 7-37.2.4Creating the Package. 7-47.2.4.1Create a New Package . 7-47.2.4.2Insert the Steps in the Package . 7-57.2.4.3Define the Sequence of Steps in the Package. 7-58 Executing Your Developments and Reviewing the Results8.1Executing the Load Sales Administration Package . 8-18.1.1Run the Package. 8-18.1.2Follow the Execution of the Package in Operator Navigator. 8-18.1.3Interpreting the Results of the Pop. TRG CUSTOMER Session Step. 8-28.1.3.1Determining the Number of Processed Records. 8-28.1.3.2Viewing the Resulting Data . 8-38.1.3.3Reviewing the Invalid Records and Incorrect Data. 8-38.1.3.4Correcting Invalid Data . 8-48.1.3.5Review the Processed Records . 8-68.2Executing the Pop. TRG SALES Interface . 8-68.2.1Execute the Integration Interface. 8-78.2.2Follow the Execution of the Interface in Operator Navigator. 8-78.2.3Interpreting the Results . 8-88.2.3.1Determining the Number of Processed Records. 8-88.2.3.2Viewing the Resulting Data . 8-108.2.3.3Reviewing the Invalid Records and Incorrect Data. 8-109 Deploying Integrated Applications9.19.29.39.3.19.4Introduction .Scenario Creation .Run the Scenario .Executing a Scenario from ODI Studio.Follow the Execution of the Scenario .9-19-19-29-29-3v
10 Going Further with Oracle Data Integrator10.110.210.3viSummary . 10-1What else can you do with Oracle Data Integrator? . 10-1Learn More. 10-2
PrefaceThis manual describes how to get started with Oracle Data Integrator. It providesgeneral background information and detailed examples to help you learn how to useOracle Data IntegratorThis preface contains the following topics:. Audience Documentation Accessibility Related Documents ConventionsAudienceThis document is intended for users interested in learning how to use Oracle DataIntegrator as a development tool for their integration processes.Documentation AccessibilityOur goal is to make Oracle products, services, and supporting documentationaccessible to all users, including users that are disabled. To that end, ourdocumentation includes features that make information available to users of assistivetechnology. This documentation is available in HTML format, and contains markup tofacilitate access by the disabled community. Accessibility standards will continue toevolve over time, and Oracle is actively engaged with other market-leadingtechnology vendors to address technical obstacles so that our documentation can beaccessible to all of our customers. For more information, visit the Oracle AccessibilityProgram Web site at http://www.oracle.com/accessibility/.Accessibility of Code Examples in DocumentationScreen readers may not always correctly read the code examples in this document. Theconventions for writing code require that closing braces should appear on anotherwise empty line; however, some screen readers may not always read a line of textthat consists solely of a bracket or brace.Accessibility of Links to External Web Sites in DocumentationThis documentation may contain links to Web sites of other companies ororganizations that Oracle does not own or control. Oracle neither evaluates nor makesany representations regarding the accessibility of these Web sites.vii
Access to Oracle SupportOracle customers have access to electronic support through My Oracle Support. Forinformation, visit http://www.oracle.com/support/contact.html or tml if you are hearingimpaired.Related DocumentsFor more information, see the following Oracle resources: Oracle Fusion Middleware Developer’s Guide for Oracle Data Integrator Oracle Fusion Middleware Installation Guide for Oracle Data Integrator Oracle Fusion Middleware Upgrade Guide for Oracle Data Integrator Oracle Fusion Middleware Connectivity and Modules Guide for Oracle Data Integrator Oracle Fusion Middleware Knowledge Module Developer's Guide for Oracle DataIntegratorOracle Data Integrator 11g Online HelpOracle Data Integrator 11g Release Notes, included with your Oracle Data Integrator 11ginstallation, and on Oracle Technology NetworkConventionsThe following text conventions are used in this document:viiiConventionMeaningboldfaceBoldface type indicates graphical user interface elements associatedwith an action, or terms defined in text or the glossary.italicItalic type indicates book titles, emphasis, or placeholder variables forwhich you supply particular values.monospaceMonospace type indicates commands within a paragraph, URLs, codein examples, text that appears on the screen, or text that you enter.
1Oracle Data Integrator Overview1This chapter provides an introduction to Oracle Data Integrator, the technicalarchitecture, and the contents of this Getting Started guide.This chapter includes the following sections: Section 1.1, "Introduction to Oracle Data Integrator" Section 1.2, "ODI Component Architecture" Section 1.3, "Get Started with Oracle Data Integrator"1.1 Introduction to Oracle Data IntegratorA widely used data integration software product, Oracle Data Integrator provides anew declarative design approach to defining data transformation and integrationprocesses, resulting in faster and simpler development and maintenance. Based on aunique E-LT architecture (Extract - Load Transform), Oracle Data Integrator not onlyguarantees the highest level of performance possible for the execution of datatransformation and validation processes but is also the most cost-effective solutionavailable today.Oracle Data Integrator provides a unified infrastructure to streamline data andapplication integration projects.1.1.1 The Business ProblemIn today's increasingly fast-paced business environment, organizations need to usemore specialized software applications; they also need to ensure the coexistence ofthese applications on heterogeneous hardware platforms and systems and guaranteethe ability to share data between applications and systems. Projects that implementthese integration requirements need to be delivered on-spec, on-time and on-budget.1.1.2 A Unique SolutionOracle Data Integrator employs a powerful declarative design approach to dataintegration, which separates the declarative rules from the implementation details.Oracle Data Integrator is also based on a unique E-LT (Extract - Load Transform)architecture which eliminates the need for a standalone ETL server and proprietaryengine, and instead leverages the inherent power of your RDBMS engines. Thiscombination provides the greatest productivity for both development andmaintenance, and the highest performance for the execution of data transformationand validation processes.Oracle Data Integrator Overview 1-1
ODI Component ArchitectureHere are the key reasons why companies choose Oracle Data Integrator for their dataintegration needs: Faster and simpler development and maintenance: The declarative rules drivenapproach to data integration greatly reduces the learning curve of the product andincreases developer productivity while facilitating ongoing maintenance. Thisapproach separates the definition of the processes from their actualimplementation, and separates the declarative rules (the "what") from the dataflows (the "how").Data quality firewall: Oracle Data Integrator ensures that faulty data isautomatically detected and recycled before insertion in the target application. Thisis performed without the need for programming, following the data integrity rulesand constraints defined both on the target application and in Oracle DataIntegrator.Better execution performance: traditional data integration software (ETL) is basedon proprietary engines that perform data transformations row by row, thuslimiting performance. By implementing an E-LT architecture, based on yourexisting RDBMS engines and SQL, you are capable of executing datatransformations on the target server at a set-based level, giving you much higherperformance.Simpler and more efficient architecture: the E-LT architecture removes the needfor an ETL Server sitting between the sources and the target server. It utilizes thesource and target servers to perform complex transformations, most of whichhappen in batch mode when the server is not busy processing end-user queries.Platform Independence: Oracle Data Integrator supports all platforms, hardwareand OSs with the same software.Data Connectivity: Oracle Data Integrator supports all RDBMSs including allleading Data Warehousing platforms such as Oracle, Exadata, Teradata, IBM DB2,Netezza, Sybase IQ and numerous other technologies such as flat files, ERPs,LDAP, XML.Cost-savings: the elimination of the ETL Server and ETL engine reduces both theinitial hardware and software acquisition and maintenance costs. The reducedlearning curve and increased developer productivity significantly reduce theoverall labor costs of the project, as well as the cost of ongoing enhancements.1.2 ODI Component ArchitectureThe Oracle Data Integrator platform integrates in the broader Fusion Middlewareplatform and becomes a key component of this stack. Oracle Data Integrator providesits run-time components as Java EE applications, enhanced to fully leverage thecapabilities of the Oracle WebLogic Application Server. Oracle Data Integratorcomponents include exclusive features for Enterprise-Scale Deployments, highavailability, scalability, and hardened security. Figure 1–1 shows the ODI componentarchitecture.1-2 Oracle Fusion Middleware Getting Started with Oracle Data Integrator
ODI Component ArchitectureFigure 1–1 Oracle Data Integrator Component Architecture1.2.1 RepositoriesThe central component of the architecture is the Oracle Data Integrator Repository. Itstores configuration information about the IT infrastructure, metadata of allapplications, projects, scenarios, and the execution logs. Many instances of therepository can coexist in the IT infrastructure, for example Development, QA, UserAcceptance, and Production. The architecture of the repository is designed to allowseveral separated environments that exchange metadata and scenarios (for example:Development, Test, Maintenance and Production environments). The repository alsoacts as a version control system where objects are archived and assigned a versionnumber.The Oracle Data Integrator Repository is composed of one Master Repository andseveral Work Repositories. Objects developed or configured through the user interfacesare stored in one of these repository types.There is usually only one master repository that stores the following information: Security information including users, profiles and rights for the ODI platformTopology information including technologies, server definitions, schemas,contexts, languages and so forth.Versioned and archived objects.The work repository is the one that contains actual developed objects. Several workrepositories may coexist in the same ODI installation (for example, to have separateenvironments or to match a particular versioning life cycle). A Work Repository storesinformation for: Models, including schema definition, datastores structures and metadata, fieldsand columns definitions, data quality constraints, cross references, data lineageand so forth.Projects, including business rules, packages, procedures, folders, KnowledgeModules, variables and so forth.Oracle Data Integrator Overview 1-3
ODI Component Architecture Scenario execution, including scenarios, scheduling information and logs.When the Work Repository contains only the execution information (typically forproduction purposes), it is then called an Execution Repository.1.2.2 ODI Studio and User InterfacesAdministrators, Developers and Operators use the Oracle Data Integrator Studio toaccess the repositories. This Fusion Client Platform (FCP) based UI is used foradministering the infrastructure (security and topology), reverse-engineering themetadata, developing projects, scheduling, operating and monitoring executions.ODI Studio provides four Navigators for managing the different aspects and steps ofan ODI integration project: Designer Navigator is used to design data integrity checks and to buildtransformations such as for example: Automatic reverse-engineering of existing applications or databasesGraphical development and maintenance of transformation and integrationinterfaces Visualization of data flows in the interfaces Automatic documentation generation Customization of the generated codeOperator Navigator is the production management and monitoring tool. It isdesigned for IT production operators. Through Operator Navigator, you canmanage your interface executions in the sessions, as well as the scenarios inproduction.Topology Navigator is used to manage the data describing the information system'sphysical and logical architecture. Through Topology Navigator you can managethe topology of your information system, the technologies and their datatypes, thedata servers linked to these technologies and the schemas they contain, thecontexts, the languages and the agents, as well as the repositories. The site,machine, and data server descriptions will enable Oracle Data Integrator toexecute the same integration interfaces in different physical environments.Security Navigator is the tool for managing the security information in Oracle DataIntegrator. Through Security Navigator you can create users and profiles andassign user rights for methods (edit, delete, etc) on generic objects (data server,datatypes, etc), and fine-tune these rights on the object instances (Server 1, Server2, and so forth).Oracle Data Integrator also provides a Java API for perform
Oracle Fusion Middleware Getting Started with Oracle Data Integrator 11g Release 1 (11.1.1) E12641-02 April 2011
1 Introduction to Oracle Fusion Middleware Disaster Recovery 1.1 Overview of Oracle Fusion Middleware Disaster Recovery 1-1 1.1.1 Problem Description and Common Solutions 1-1 1.1.2 Terminology 1-2 1.2 Setting Up Disaster Recovery for Oracle Fusion Middleware Components 1-5 1.2.1 Oracle Fusion Middleware Disaster Recovery Architecture Overview 1-5
7 Accessibility Features and Tips for Oracle Forms and Reports . that Oracle has developed for Oracle Fusion Middleware products and services. . Mode in Developing Services with Oracle Service Bus For information about enabling Fusion Middleware Control accessibility mode, see: .
new open source WebLogic Remote Console, enhancements to Kubernetes tooling and support, Oracle Java SE 8 and 11 certification, GraalVM EE certification, and improvements to Oracle Database integration. The next planned release of Oracle Fusion Middleware is Oracle Fusion Middleware 14.1.2,
Explains how to install and deinstall Oracle Business Intelligence products (including Oracle BI Enterprise Edition, Oracle BI Publisher, and Oracle Real-Time Decisions). Includes a description for each screen. Oracle Fusion Middleware Installation Guide for Oracle Business Intelligence, 11g Release 1 (11.1.1)
Oracle Fusion Middleware Getting Started with Oracle Data
Oracle e-Commerce Gateway, Oracle Business Intelligence System, Oracle Financial Analyzer, Oracle Reports, Oracle Strategic Enterprise Management, Oracle Financials, Oracle Internet Procurement, Oracle Supply Chain, Oracle Call Center, Oracle e-Commerce, Oracle Integration Products & Technologies, Oracle Marketing, Oracle Service,
complete implementation of Oracle Fusion HCM. References to related help accompany each of the steps. The help is available from Oracle Fusion Applications Help or Oracle Fusion Applications Technology Library, unless specified otherwise. You can find this document (ID: 1395863.1) on My Oracle Support, https://support.oracle.com.
Business Accounting Volume 1is the world’s best-selling textbook on bookkeeping and accounting. Now in its tenth edition, it has become the standard introductory text for accounting students and professionals alike. New to this edition: Over 120 brand new review questions for exam practice Coverage of International Accounting Standards 2005 Additional and updated worked examples for areas of .
