HubSpot 2 MS SqlServer : Replication duration

  • 53Views
  • Last Post 2 weeks ago
0
votes
David MEY posted this 22 October 2021

Hi,

I've created  a package to replicate HubSpot to my own MS SqlServer database.

My hubspot database is small

The job started 21 hours ago and is still running.

What does it mean ? Is it possible to know when the replication finish ? 

I wonder if I need to schedule the job every day...  

Thank you in advance for your answer.

Regards,

 

Order By: Standard | Newest | Votes
0
votes
Olena Romanchuk posted this 25 October 2021

Hello David, 

The package has stuck on SQL server side, trying to insert more than 1 million records.
We also can see that the package had several fails with transport error.
There are many objects in the package, many of them are processed in paralel.
It looks like SQL server is overloaded by many paralel requests. 
We recommend you to divide the package into parts and run them successively.

Best regards,

Olena

Technical Support Engineer



0
votes
David MEY posted this 3 weeks ago

Hello,

my job is running since 10/26.

My Sql Servver database is updated, but I need repeatedly to recreate it every day.  

My hubspot database is small. So the replication shoud end under 24 hours  and restart next day...

Can you help me please ?

Thank you in advance.

Best regards,

 

 

 

 

0
votes
David MEY posted this 3 weeks ago

0
votes
David MEY posted this 3 weeks ago

0
votes
Olena Romanchuk posted this 3 weeks ago

Hello David, 

We have cancelled the stuck run on our side. 
Please clear the metadata cache in your Hubspot connection. 
We kindly recommend you to try to divide the package into parts for better performance. 
Please inform us how it goes. 

We look forward to your reply. 

Best regards,
Olena
Technical Support Engineer

0
votes
David MEY posted this 3 weeks ago

Hello,

this time the job ended correctly when I run it manualy. I didn't need to divide the package. It spent only 1h22.

But I can't schedule It anymore. Each time I change and save new parameters, they don't replace those from 10/24.

 

Can you help me please ?

Thank you in advance.

Best regards,

David

0
votes
David MEY posted this 3 weeks ago

Hello,

I've removed the schedule and created a new one, but the same old parameters are not replaced. 

Regards

0
votes
David MEY posted this 3 weeks ago

And now, I can't run manualy my package anymore. What is this limit of records ?

0
votes
David MEY posted this 3 weeks ago

Hello,

I've changed the plan (trial will end 12/03) . So I've increased the limit of records.


But I still cannot modify the scheduled job...

Any idea ?

Thank you in advance.

Regards,

 

 

 

0
votes
Olena Romanchuk posted this 2 weeks ago

Hello David,

We are sorry for the delay with reply.

As we can see, currrently the package runs according to the set parameters.

The Starting on parameter determines since when the schedule itself is considered “active”. However, that doesn’t necessarily determine the first package run and it does not affect the consequent runs.
You have activated your schedule on 24/10, then after the initial replication the record limit was reached. In this case the packages cannot be launched both manually and automatically until the records counter is reset. 
When you activated your trial, the record limit was reset, thus your schedule is working as expected.

Please refer to https://docs.skyvia.com/data-integration/scheduling-packages-for-automatic-execution.html for more details.
Should you have any questions, please feel free to ask. 


Best regards,

Olena

Technical Support Engineer

0
votes
David MEY posted this 2 weeks ago

Hello, 

its seems to work better !

So, let's talk about pricing :

* I have to replicate about 150k rows once per week (Schedule once a week) => 600k per Month

* Is it the Data Integration STANDARD option ?

Thank you in advance.

Best regards,

 

0
votes
Olena Romanchuk posted this 2 weeks ago

Hello David, 

My colleagues from Sales team will contact  you today regarding pricing. 

Should you have any questions, please do not hesitate to contact us.

Best regards,

Olena

 

Technical Support Engineer

Close