Skip to content

iLoader#

An error occurs when uploading a DOS format data file to iloader.#

Overview#

To upload a DOS format data file from Unix/Linux server to the iloader, you need to convert the file using an editing program or dos2unix.

If the iloader is executed without conversion, the following error may occur.

ERR-9102B : Token value length overflow.

In DOS format files, Row Termination Code is composed of CR (Carriage Return) + LF (Line Feed).

When the iloader parses the data file, it recognizes %n(LF) as a row terminator. So when uploading a data file in DOS format, a parsing error might occur.

When opening a DOS format file with vi in Linux/Unix, ^M is attached to the line or looks like the following:

"SYS_T.dat" [DOS] 225L, 33822C

How to remove#

On Windows#

  • In Windows, it can be converted using an editing program.
  • Ex) In UltraEdit, select File -> Convert -> 'DOS -> UNIX' and save

On Linux/UNIX#

Convert to UNIX type file using dos2unix.#
  • The dos2unix command converts DOS/MAC files to UNIX format.

    Example

    $ dos2unix SYS_T.dat
    dos2unix: converting file SYS_T.dat to UNIX format ...
    

    File type comparison before and after dos2unix execution

    $ file SYS_T.dat
    SYS_T.dat: ISO-8859 text, with very long lines, with CRLF line terminators  # DOS format file
    
    $ dos2unix SYS_T.dat
    dos2unix: converting file SYS_T.dat to UNIX format ...
    
    $ file SYS_T.dat
    SYS_T.dat: ISO-8859 text, with very long lines                             # UNIX format file
    
Remove ^M using sed#
  • Use sed to remove ^M as an iloader data file.
  • ^M must be entered as Ctrl+v+m.

    Example

    $ sed 's/^M//g' SYS_T.dat > SYS_T.dat.1
    

Starting from Altibase 5.5.1 ...#

From Altibase 5.5.1, it is possible to upload without file conversion/modification by using %r%n, which means CR+LF as a record separator.

Example

$ file SYS_T.txt
SYS_T.txt: ISO-8859 text, with CRLF, LF line terminators

$ iloader -s 127.0.0.1 -u sys -p manager in -f SYS_T.fmt -d SYS_T.txt -log SYS_T.log -bad SYS_T.bad -t "|" -r "%r%n"
-----------------------------------------------------------------
     Altibase Data Load/Download utility.
     Release Version 5.5.1.4.10
     Copyright 2000, ALTIBASE Corporation or its subsidiaries.
     All Rights Reserved.
-----------------------------------------------------------------
ISQL_CONNECTION : TCP
DATA_NLS_USE: MS949
UPLOAD : 13.5710 msec

     Load Count  : 2(T)