📊 Skyvia Data Flow Logs Explained: The Reason Errors and Successes Aren't Shown by Default
In Data Flow, tracking execution success or failure can be challenging due to the nature of row processing. Rows that fail in one component may succeed in another, complicating error detection. By default, Skyvia logs do not provide detailed error or success information, which can lead to confusion.
To enhance visibility, please implement the following components in your Data Flow:
- Row Count Component: It counts the records passing through specific points in your Data Flow. It helps track the number of rows processed successfully or failed at each step. Please refer to this article for more details on Row Count.
- Log Component: It is designed to record specific information during the execution. You can configure it to log essential details like errors, names, row statuses, or even specific data values, which is crucial for deeper analysis.
How to Add Components:
- Row Count: Drag and drop the Row Count component at key points of your Data Flow to count processed records.
- Log: Insert a Target Log Component to capture additional details like errors or IDs.
For example:
By setting up these components, you can effectively monitor each step, simplifying troubleshooting and tracking.
Feel free to explore this in more detail in our documentation. Here is the article that dives deeper into the topic.
Related Articles
Integration Failure Types in Skyvia Data Integration
When using Skyvia Data Integration product, you may encounter two distinct types of integration failures: 1. Record-Level Errors These occur when one or more individual records fail to process during an integration task. For example, in operations ...Skyvia Query: Easily Verify Data in Your Connection!
Please follow the steps below to query your data in Skyvia Query: Open Query Editor – Log in to Skyvia and navigate to + Create New → Query. Create or Select a Connection – Select an existing connection or establish a new one for your data source. ...Understanding Records in Skyvia Data Integration
1.1 Understanding Records in Skyvia Data Integration A record in Data Integration represents a single row in a database table. Every integration process—Import, Replication, Export, Synchronization, etc —handles individual records. Records also serve ...Data Integration: You have reached the limit of records
The error "You have reached the limit of records" usually occurs when the number of records exceeds the limit specified in your current Data Integration product plan. To resolve this issue, you have a few options: Upgrade your plan to increase the ...Account and Workspace Roles in Skyvia
In Skyvia, we distinguish between account and workspace roles for seamless teamwork: 1. Account Roles The account admin, also known as the account owner, has full control over the account. They can manage subscriptions to Skyvia products, modify ...