At the moment if you check the 'Compress Target' option in an export task the resulting file is a zip. Unfortunately, this isn't very helpful if you plan on doing anything programmatically with the data, such as loading it into Redshift or using Spark, as zip files can't be split over multiple nodes. Adding support for gzip would solve this problem, but I realise others may prefer to use zip.
Provide an option to select the compression type in exports
- Last Post 2 weeks ago
Ben Long posted this 2 weeks ago
posted 2 weeks ago