Avoid repeated records fetch for same package

  • 21Views
  • Last Post 01 March 2019
  • Topic Is Solved
0
votes
Sakthi Finance Ltd. posted this 26 February 2019

Hi Team,

 

I using Skyvia for data transfer from My-SQL to Salesforce.com and vice versa. But I am facing some issue over here. Please find my below questions.

I need to fetch record details from My-SQL. Because of that I need to schedule the package. 

Note: The same package can be schedule for multiple times.

Example: Package1: Schedule @ 10.00 am from My-SQL.

Package1: Schedule @ 10:05 am from My-SQL.

Package1: Schedule @ 10.10 am from My-SQL

Question 1: Can we fetch the records based on the schedule job time?

Example: 1st time:  When we run @10.00 am, it will pick up some records.

2nd time: When we run @ 10.05am, it should pick up the records which has createdBy 10.05am before. So that I can pickup only newly created/updated records.

3rd time: When we run @10.10am, it should pick up only the records which has createdBy 10.10am before and 10.05 after. So that I can pickup only newly created/updated records. Likewise it should continue.

 

Please suggest. How we need to do in this scenario?

 

Note: This question is mainly to avoid repeated fetch of the same records multiple times.

 

My contact details as below.

EmailID: shruti.hasilkar@kvpcorp.com

Phone Number: +91 8073126025.

 

Thanks in advance.

 

Shruti Hasilkar.

Order By: Standard | Newest | Votes
0
votes
Mariia Zaharova posted this 27 February 2019

Hi Shruti!

Please refer to the Workaround for Relational Databases section here.

 

Does this help?

 

Best regards,

Mariia

0
votes
Sakthi Finance Ltd. posted this 27 February 2019

Hi Mariia,

 

Thanks for solution. 

 

But I having a doubt here. Is LAST_RUN contains both success and failure time after completion of the package? or only success time after completion of the package.

 

Please suggest.

 

Thanks & Regards,

Shruti Hasilkar.

1
votes
Mariia Zaharova posted this 28 February 2019

Hi Shruti,

But I having a doubt here. Is LAST_RUN contains both success and failure time after completion of the package? 

Only for success states and failed states with record-level errors.

 

There can be two kind of package fails:

1. Record-level error. A  failed row is added to the list of failed records. Skyvia logs all the package runs and their results. You can find more information about this hereThe LAST_RUN parameter is updated in this case.

2. Package-level error. An error in the sync connection also is considered a package level error. In this case the package execution stops. The LAST_RUN parameter is not updated.

 

Best regards,

Mariia

 

  • Supported by
  • Sakthi Finance Ltd.
0
votes
Sakthi Finance Ltd. posted this 28 February 2019

Hi Mariia,

 

I have created one pull package in the Skyvia. And LastmaodifiiedBy column (data type = timestamp) is present in the MySQL. 

Source = MySQL and Target = SFDC

Entry criteria is Last_modifiied_by > LAST_RUN.

 

when I pull the record @1st time (package got executed successfully), 1 record got update into SFDC. But when I pull @2nd time, same record got pull.

 

Please suggest for this issue. How we can avoid repeated pull of processed (success) records?

 

Thanks in advance.

 

Regards,

Shruti Hasilkar.

1
votes
Mariia Zaharova posted this 28 February 2019

Please check that your Last_modifiied_by column stores values in UTC. This is the main requirement for this solution.

Looking forward to your reply.

  • Supported by
  • Sakthi Finance Ltd.
0
votes
Sakthi Finance Ltd. posted this 01 March 2019

Hi Mariia,

Thank you so much. It is working properly.

 

Thanks for the guidance. You can close the ticket.

 

Regards,

Shruti Hasilkar

Close