ODI Loading File Using Loaders

Loading File Using Loaders

When the interface contains a flat file as a source, you may want to use a strategy that leverages the most efficient loading utility available for the staging area technology, rather than the standard LKM File to SQL that uses the ODI built-in driver for files. Most RDBMSs have fast loading utilities to load flat files into tables, such as Oracle's SQL*Loader, Microsoft SQL Server bcp, Teradata FastLoad or MultiLoad.
Such LKM will load the source file into the staging area, and all transformations will take place in the staging area afterwards.
A typical LKM using a loading utility will include the following sequence of steps:

1. Drop and create the loading table in the staging area
   
2. Generate the script required by the loading utility to load the file to the loading table.
   
3. Execute the appropriate operating system command to start the load and check its return code.
   
4. Possibly analyze any log files produced by the utility for error handling.
   
5. Drop the loading table once the integration phase has completed.