Overview

In Data Flow, tracking execution success or failure can be challenging due to the nature of row processing. Rows that fail in one component may succeed in another, complicating error detection. By default, Skyvia logs do not provide detailed error or success information, which can lead to confusion.

To enhance visibility, implement the following components in your Data Flow:

Components for Enhanced Logging

1. Row Count Component counts the records passing through specific points in your Data Flow. It helps track the number of rows processed successfully or failed at each step. For more details, see the Row Count documentation.
2. Log Component records specific information during execution. You can configure it to log essential details like errors, names, row statuses, or specific data values, which is crucial for deeper analysis.

How to Add Components

• Row Count: Drag and drop the Row Count component at key points of your Data Flow to count processed records.
• Log: Insert a Target Log Component to capture additional details like errors or IDs.

For example:

By setting up these components, you can effectively monitor each step, simplifying troubleshooting and tracking.

Useful Links

• Data Flow Results and Logging documentation
• Row Count Component documentation