Copying only new items

  • 14Views
  • Last Post 3 weeks ago
0
votes
Chris Eaheart posted this 3 weeks ago

I am new to Skyvia, but I have set up a job that I will run this weekend, and I want to understand how the tool works.  If I have a daily schedule, will the tool copy records that have not been updated at the Source to the Destination system, or will it only copy new and updated records?

My Source is Salesforce, and my destination is Dynamics 365 - one way.

Order By: Standard | Newest | Votes
0
votes
Mariia Zaharova posted this 3 weeks ago

If I have a daily schedule, will the tool copy records that have not been updated at the Source to the Destination system, or will it only copy new and updated records?

My Source is Salesforce, and my destination is Dynamics 365 - one way.

Import package will send all the records from Source to Target each package run. However, you can specify filters for data being imported or use state filters:  https://skyvia.com/resources/docs/index.html?importing_recently_added.htm

 

If you encounter any issues with this or have any further questions, feel free to contact us. We will be glad to answer all your further questions.

 

0
votes
Chris Eaheart posted this 3 weeks ago

I saw an option called "Upsert" and read the documentation - would this not work for this scenario?  

I really think your tool needs a "Delta" option that inserts or updates ONLY if the source record is newer - otherwise it skips.  Should be a pretty simple compare operation.

0
votes
Mariia Zaharova posted this 3 weeks ago

The UPSERT operation updates a record if it exists or inserts a new record. This allows you to avoid inserting duplicate data. However, it does not process only new or updated source data, it processes all the records in case if no filters are specified in the task.

As we have mentioned in our previous reply, you can specify filters for data being imported (such as LastModifiedDate > = YESTERDAY) or use state filters (Updated, Inserted) :  https://skyvia.com/resources/docs/index.html?importing_recently_added.htm

 

For example, you can easily create a package, that adds all the new Salesforce leads to Dynamics CRM leads, etc. After this you can schedule it to execute every several minutes, and leads will be automatically added for all the new Salesforce leads, etc.

This functionality allows you to create trigger-action-like integrations or simply load all the new records and updates from one source to another automatically. However, it is not a full-featured replacement for data synchronization, because an Import package cannot perform actions for recently deleted records.

If you encounter any issues with this or have any further questions, feel free to contact us.

Close