October 8, 2009 at 10:14 am
Good Day All,
I am wondering if someone can help me with a SSIS package obstacle I have run into. I am trying to transfer data from a production server to a reporting server. I am dealing with all OLE db. I can successfully transfer the data by truncating the data from the destination db and re-populating the data from the source. I do this on a nightly basis. The issue is that it takes about 1.5 hours to complete this. I am wondering if anyone can tell me if there is a way to only return one day's worth of data.
For example, if I truncate the destination db tonight (job runs at 11 PM) and re-populate the data using the source data, the last "created date" will be 10/08/2009. Is there a way for me to only transfer the data from 10/09/2009 tomorrow night at 11 PM and continue this process going forward?
Any help is much appreciated.
Thanks,
Matt
October 8, 2009 at 11:58 am
You can do this by getting the max date from your data and putting it into a variable, then use the variable in the SELECT statement at the source OLEDB statement.
I have a another question for you.. In the OLEDB destination to you have "Table or View - Fast Load" selected for the access mode? If not, change that, it almost always makes a HUGE difference.. It is also a REALLY common mistake..
CEWII
October 8, 2009 at 12:02 pm
Thanks. I'll try selecting the max date. And I'll change the data access mode to table or view fast load.
Viewing 3 posts - 1 through 2 (of 2 total)
You must be logged in to reply to this topic. Login to reply