May 8, 2009 at 2:31 am
Hi,
i have extracted the data to .txt file from server by using BCP. This data need to be loaded into another server with help of SSIS, and i have seen that the .txt file data is not sorted. The extracted file is source to my ssis job.i have to send the total data by doing merge join which need the data to be sorted out. But the data in the .txt file is not sorted and also the capacity is around 10GB and getting strucked due to memory issue in the ssis. pls help me how to sort data (either in ssis or in .txt file) before sending it to merge join.
Note:
1. The column datatype that need to be sort is UNIQUE_IDENTIFIER
2. I dont have any staging area where i can load extracted data into table and continue ssis process.
May 8, 2009 at 5:42 am
Why can't you extract straight from the database using SSIS? this would allow you to use a sorted query for your data source..
May 8, 2009 at 7:34 am
No i can not do like that...we need to extract data into file only...
May 8, 2009 at 7:50 am
ambajirao (5/8/2009)
No i can not do like that...we need to extract data into file only...
what is the reason ? i am just curious at it seems that it is making it more difficult.
To do this entirely in SSIS you can use the sort task, but with a 10gb file it may take some time/memory to sort the data..
Viewing 4 posts - 1 through 3 (of 3 total)
You must be logged in to reply to this topic. Login to reply