📊 Skyvia Data Flow Logs Explained: The Reason Errors and Successes Aren't Shown by Default

📊 Skyvia Data Flow Logs Explained: The Reason Errors and Successes Aren't Shown by Default

In Data Flow, tracking execution success or failure can be challenging due to the nature of row processing. Rows that fail in one component may succeed in another, complicating error detection. By default, Skyvia logs do not provide detailed error or success information, which can lead to confusion.


To enhance visibility, please implement the following components in your Data Flow:

  1. Row Count Component: It counts the records passing through specific points in your Data Flow. It helps track the number of rows processed successfully or failed at each step. Please refer to this article for more details on Row Count.
  2. Log Component: It is designed to record specific information during the execution. You can configure it to log essential details like errors, names, row statuses, or even specific data values, which is crucial for deeper analysis.
How to Add Components:

  • Row Count: Drag and drop the Row Count component at key points of your Data Flow to count processed records.
  • Log: Insert a Target Log Component to capture additional details like errors or IDs.

For example:



By setting up these components, you can effectively monitor each step, simplifying troubleshooting and tracking.
Feel free to explore this in more detail in our documentation. Here is the article that dives deeper into the topic.

    • Related Articles

    • Understanding Records in Skyvia Data Integration

      1.1 Understanding Records in Skyvia Data Integration A record in Data Integration represents a single row in a database table. Every integration process—Import, Replication, Export, Synchronization, etc —handles individual records. Records also serve ...

    • Account and Workspace Roles in Skyvia

      In Skyvia, we distinguish between account and workspace roles for seamless teamwork: 1. Account Roles The account admin, also known as the account owner, has full control over the account. They can manage subscriptions to Skyvia products, modify ...

    • 🔒Skyvia IPs for Whitelist

      Skyvia will access your server from one of the following IP addresses: 40.118.246.204 13.86.253.112 52.190.252.0 To ensure proper functionality of your connections, all of these IP addresses must be whitelisted.

    • BigCommerce: "The value of the column Categories has incorrect JSON format" error

      When working with the Categories field in the Product object within the BigCommerce API, it's important to understand how to format and import data correctly to ensure a successful import. In the BigCommerce API, the Categories field in the Product ...

    • Mapping Multi-Select Fields

      When working with Import, Synchronization, or Data Flow integrations and needing to map multi-select fields with different values between the source and target, you can use Expression Mapping. Expression mapping allows using simple and complex ...