SSIS Control Flow task fails to load all text from flat file

  • Hi Guys,

    I have a flat file which is loaded into the database on a daily basis. The file contains rows of strings which I load into a table, specifically to a column of length 8000.

    The string has a length of 690, but the format is like 'xxxxxx xx xx..'

    and so on, where 'xxxx' represents data. So there are spaces, etc present in the middle.

    Previously I used SQL 2000 DTS to load the files in, and it was just a Column Transformation with the Col001 from the text file loading straight to my table column. After the load, if I select len(col) it gives me 750 for all rows.

    Once I started to migrate this to SSIS, I allocated the Control Flow Task and specified the flat file source and the oledb destination, and gave the output column a type of String and output column width of 8000. But when I run the data flow task it copies only 181 or 231 characters out of the 750 required.

    I feel it stops where it finds the SPACES and skips the rest.

    I specified row delimiters or CR, and LF. I checked the file under UltraEdit and there were no special characters in the file that would cause the problem.

    Any suggestions how I can get it to load the full data?

    Thanks

  • Hi,

    Have you checked the flat file connection configuration for your column. Edit your flat file connection and then look under the Advanced table at the column definitions. Check that your column has an appripriate OutputColumnWidth setting.

    Also within the metadata of each dataflow pipeline by double clicking each of the connector arrows in the dataflow.

    Regards

    Daniel

  • I checked everything.

    What I think may be causing the problem, is that in certain places, there are NULL characters instead of SPACES which may be causing the unnecessary truncation.

Viewing 3 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic. Login to reply