📊 Skyvia Data Flow Logs Explained: The Reason Errors and Successes Aren't Shown by Default
In Data Flow, tracking execution success or failure can be challenging due to the nature of row processing. Rows that fail in one component may succeed in another, complicating error detection. By default, Skyvia logs do not provide detailed error or success information, which can lead to confusion.
To enhance visibility, please implement the following components in your Data Flow:
- Row Count Component: It counts the records passing through specific points in your Data Flow. It helps track the number of rows processed successfully or failed at each step. Please refer to this article for more details on Row Count.
- Log Component: It is designed to record specific information during the execution. You can configure it to log essential details like errors, names, row statuses, or even specific data values, which is crucial for deeper analysis.
How to Add Components:
- Row Count: Drag and drop the Row Count component at key points of your Data Flow to count processed records.
- Log: Insert a Target Log Component to capture additional details like errors or IDs.
For example:
By setting up these components, you can effectively monitor each step, simplifying troubleshooting and tracking.
Feel free to explore this in more detail in our documentation. Here is the article that dives deeper into the topic.
Related Articles
🔒Skyvia IPs for Whitelist
Skyvia will access your server from one of the following IP addresses: 40.118.246.204 13.86.253.112 52.190.252.0 To ensure proper functionality of your connections, all of these IP addresses must be whitelisted.
Mapping Multi-Select Fields
When working with Import, Synchronization, or Data Flow integrations and needing to map multi-select fields with different values between the source and target, you can use Expression Mapping. Expression mapping allows using simple and complex ...
BigCommerce: "The value of the column Categories has incorrect JSON format" error
When working with the Categories field in the Product object within the BigCommerce API, it's important to understand how to format and import data correctly to ensure a successful import. In the BigCommerce API, the Categories field in the Product ...
What is a record?
The record is an element of the database. It is composed of fields and contains all the data about one particular person, company, or item in a database. Records appear as rows in database tables.
A Quick Guide to Importing and Updating Audience Members in Mailchimp
If your integration involves importing data into Mailchimp Audiences, this information might be helpful. To start, let’s take a quick look at how the UPSERT operation works: If the Id is specified, the integration attempts an Update operation even if ...