I am experiencing an intermittent error in my Replication/Synchronization integrations from Dynamics 365 to Snowflake. The integration works fine sometimes, but frequently fails with the following message:
"There is not enough space on the disk."
Technical Details:
Source: Dynamics 365 (Incremental Updates).
Target: Snowflake.
Bulk Load Staging: I am using Amazon S3 for "File Storage for Bulk".
Agent: I am NOT using Skyvia Agent (cloud-to-cloud).
Investigation already performed:
Snowflake Space: Not an issue, as Snowflake storage is elastic.
S3 Configuration: The connection is active and works intermittently.
Behavior: Since it happens randomly, I suspect that temporary CSV files generated for the bulk load are not being properly cleared from the S3 working directory after failed runs, or there is a limitation on the Skyvia side during the file generation process before uploading to S3.
Request:
Could you please check if there is a storage limit being hit on the internal Skyvia runtime disk while preparing the CSV files for S3, or if there is a known issue with file cleanup in S3 for this specific connector?
Here an example:
Integration: P01 - PCK06 - Dynamics para LZ (csh_sladeatendimento)
RUN ID: 306635812