Avoid repeated records fetch for same package

  • 17Views
  • Last Post 3 weeks ago
  • Topic Is Solved
0
votes
Sakthi Finance Ltd. posted this 3 weeks ago

Hi Team,

 

I using Skyvia for data transfer from My-SQL to Salesforce.com and vice versa. But I am facing some issue over here. Please find my below questions.

I need to fetch record details from My-SQL. Because of that I need to schedule the package. 

Note: The same package can be schedule for multiple times.

Example: Package1: Schedule @ 10.00 am from My-SQL.

Package1: Schedule @ 10:05 am from My-SQL.

Package1: Schedule @ 10.10 am from My-SQL

Question 1: Can we fetch the records based on the schedule job time?

Example: 1st time:  When we run @10.00 am, it will pick up some records.

2nd time: When we run @ 10.05am, it should pick up the records which has createdBy 10.05am before. So that I can pickup only newly created/updated records.

3rd time: When we run @10.10am, it should pick up only the records which has createdBy 10.10am before and 10.05 after. So that I can pickup only newly created/updated records. Likewise it should continue.

 

Please suggest. How we need to do in this scenario?

 

Note: This question is mainly to avoid repeated fetch of the same records multiple times.

 

My contact details as below.

EmailID: shruti.hasilkar@kvpcorp.com

Phone Number: +91 8073126025.

 

Thanks in advance.

 

Shruti Hasilkar.

Order By: Standard | Newest | Votes
0
votes
Mariia Zaharova posted this 3 weeks ago

Hi Shruti!

Please refer to the Workaround for Relational Databases section here.

 

Does this help?

 

Best regards,

Mariia

0
votes
Sakthi Finance Ltd. posted this 3 weeks ago

Hi Mariia,

 

Thanks for solution. 

 

But I having a doubt here. Is LAST_RUN contains both success and failure time after completion of the package? or only success time after completion of the package.

 

Please suggest.

 

Thanks & Regards,

Shruti Hasilkar.

1
votes
Mariia Zaharova posted this 3 weeks ago

Hi Shruti,

But I having a doubt here. Is LAST_RUN contains both success and failure time after completion of the package? 

Only for success states and failed states with record-level errors.

 

There can be two kind of package fails:

1. Record-level error. A  failed row is added to the list of failed records. Skyvia logs all the package runs and their results. You can find more information about this hereThe LAST_RUN parameter is updated in this case.

2. Package-level error. An error in the sync connection also is considered a package level error. In this case the package execution stops. The LAST_RUN parameter is not updated.

 

Best regards,

Mariia

 

  • Supported by
  • Sakthi Finance Ltd.
0
votes
Sakthi Finance Ltd. posted this 3 weeks ago

Hi Mariia,

 

I have created one pull package in the Skyvia. And LastmaodifiiedBy column (data type = timestamp) is present in the MySQL. 

Source = MySQL and Target = SFDC

Entry criteria is Last_modifiied_by > LAST_RUN.

 

when I pull the record @1st time (package got executed successfully), 1 record got update into SFDC. But when I pull @2nd time, same record got pull.

 

Please suggest for this issue. How we can avoid repeated pull of processed (success) records?

 

Thanks in advance.

 

Regards,

Shruti Hasilkar.

1
votes
Mariia Zaharova posted this 3 weeks ago

Please check that your Last_modifiied_by column stores values in UTC. This is the main requirement for this solution.

Looking forward to your reply.

  • Supported by
  • Sakthi Finance Ltd.
0
votes
Sakthi Finance Ltd. posted this 3 weeks ago

Hi Mariia,

Thank you so much. It is working properly.

 

Thanks for the guidance. You can close the ticket.

 

Regards,

Shruti Hasilkar

Close