How to Import Newly Created Records?

  • 36Views
  • Last Post 4 weeks ago
0
votes
Glen Hackler posted this 4 weeks ago

Dear Support,

I have scheduled 5PM every day and its running successfully. But, The problem is each and every time, whole rocrds inserting into the target server. But, I want to insert newly created record only from the Source server.  How to do that?

 

Thanks.

Attached Files

0
votes
Nataliia Nikulina posted this 4 weeks ago

Hello Glen,

 

Thank you for contacting Skyvia Support team.

 

You can use the following workaround if you want to import only recent data from relational databases.  

Add columns for storing timestamps of creation time and/or last modification time to the database table you want to import data from. The date and time in these columns must be in UTC. Also, you need to create triggers that assign the current timestamp to these columns whenever a row is inserted or modified. Then you can use source data filters and add filters on these columns that use the LAST_RUN relative constant. Thus, you can import only records with creation or modification date and time more than the date and time of the previous package run. This relative constant is equal to the timestamp of the previous package run, and, if a package has not been run yet, to the date and time of its creation.

You can follow the link to know more about the import of only added or changed data:

 https://docs.skyvia.com/data-integration/import/importing-only-recently-added-or-changed-data-from-cloud-sources.html    

Please let us know if you need any further assistance.

 

Best regards,

Nataliia,

Customer Support Engineer

Close