Salesforce data Replication to Amazon Redshift.
I've created a standard incremental replication package. The initial load failed. The reason is the [Name] varchar(80) column. Redshift's varchar size is in bytes, not characters. But the [Name] column in Salesforce can contain not only single-byte characters. Therefore I got the error: "String length exceeds DDL length”.
I edited column length for the [Name] column (from 80 to 320) in the incremental replication package. And the initial load works properly. I checked the DDL for this table and the [Name] column is varchar(320) as expected.
But the following incremental load failed (once a day). I queried STL_LOAD_ERRORS to find out information about the error. And I see the same error: "String length exceeds DDL length”. The query is “COPY [table name] plus guid …”, colname is “name”, type is “varchar” and col_length is 80. But I expected varchar(320). So a temporary table is created to load data. But the incremental load doesn’t pick up the change of the column length. And the default value varchar 80 is used instead of varchar(320).
Are there any ways to work around it?