📊 Skyvia Data Flow Logs Explained: The Reason Errors and Successes Aren't Shown by Default

📊 Skyvia Data Flow Logs Explained: The Reason Errors and Successes Aren't Shown by Default

In Data Flow, tracking execution success or failure can be challenging due to the nature of row processing. Rows that fail in one component may succeed in another, complicating error detection. By default, Skyvia logs do not provide detailed error or success information, which can lead to confusion.


To enhance visibility, please implement the following components in your Data Flow:

  1. Row Count Component: It counts the records passing through specific points in your Data Flow. It helps track the number of rows processed successfully or failed at each step. Please refer to this article for more details on Row Count.
  2. Log Component: It is designed to record specific information during the execution. You can configure it to log essential details like errors, names, row statuses, or even specific data values, which is crucial for deeper analysis.
How to Add Components:

  • Row Count: Drag and drop the Row Count component at key points of your Data Flow to count processed records.
  • Log: Insert a Target Log Component to capture additional details like errors or IDs.

For example:



By setting up these components, you can effectively monitor each step, simplifying troubleshooting and tracking.
Feel free to explore this in more detail in our documentation. Here is the article that dives deeper into the topic.

    • Related Articles

    • Understanding Records in Skyvia Data Integration

      1.1 Understanding Records in Skyvia Data Integration A record in Data Integration represents a single row in a database table. Every integration process—Import, Replication, Export, Synchronization, etc —handles individual records. Records also serve ...

    • 🔒Skyvia IPs for Whitelist

      Skyvia will access your server from one of the following IP addresses: 40.118.246.204 13.86.253.112 52.190.252.0 To ensure proper functionality of your connections, all of these IP addresses must be whitelisted.

    • Mapping Multi-Select Fields

      When working with Import, Synchronization, or Data Flow integrations and needing to map multi-select fields with different values between the source and target, you can use Expression Mapping. Expression mapping allows using simple and complex ...

    • BigCommerce: "The value of the column Categories has incorrect JSON format" error

      When working with the Categories field in the Product object within the BigCommerce API, it's important to understand how to format and import data correctly to ensure a successful import. In the BigCommerce API, the Categories field in the Product ...

    • Replication creates extra tables in the database

      In some cases, as a result of Replication, in addition to the main tables (for example, dbo.Account ), empty additional tables are created in the database with names of the following types: dbo.Account_2ade4447_5e11_4308_9e81_5eab62d9ed52 ...