SSIS Data flow to AS400/DB2 looses records

  • We insert data into DB2 tables on an AS400. The transfer happens over the WAN. The source server is SQL Server 2008 R2 Enterprise edition

    SSIS reports all records were uploaded successfully but when we do an actual record count on the DB2 table we find records missing.

    The records are seemingly random and we experience this record loss on random tables.

    We then reinsert the missing records using the same SSIS package with no failure.

    The strangest thing about this scenario is that the records 'disappear' randomly whilst SSIS reports a green light with the correct record counts. Furthermore, we upload the record set today with no data loss and tomorrow the same record set looses records (seemingly randomly).

    For example we transfer 100 records to the AS400/DB2. SSIS reports success and all green with 100 records inserted. We do a record count on the DB2 table only to find 95 records for example. Tomorrow we transfer the exact same batch with no data loss.

    We use the Microsoft OLEDB DB2 drivers with the FastLoad option set.

    Does anybody know what could cause this or how to get around the problem?

  • Since you are doing it over the WAN, it is possible that the records are getting lost between the SQL Server and the DB2 server? It sounds like it's happening randomly, so not something specifically going on within SQL (especially since SSIS is reporting the correct number of records transferred).

    --------
    For SQL Tips, check out my blog: http://lantztechknowledge.blogspot.com/[/url]
    You can also follow my twitter account to get daily updates: @BLantz2455

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply