File Masking

  • 14Views
  • Last Post 5 weeks ago
  • Topic Is Solved
0
votes
Brandon Smith posted this 5 weeks ago

I receive a csv every day at 1:45am EST into an S3 bucket. I am trying to set up a schedule for that to run daily. I have the S3 bucket linked and can manually run the import by selecting a file within the S3 bucket. 

My daily file name is newusers_(Previous Date)_production.csv - I am using this file mask to find the daily file newusers_{yyyy-MM-dd}_production.csv

The issue is that when the job runs (for example) on 9/18 its looking for a file with 2019_09_18 and the file name is from the previous date so the file name is 2019_09_17. 

Is there a way to write the file mask to look for the current date minus 1? Like {yyyy-MM-dd-1}? I dont want to have to have my dev team refactor this naming convention for something that seems like it would be so easy to fix here. 

0
votes
Mariia Zaharova posted this 5 weeks ago

Hi! You can try to achieve this by changing Timezone in the File mask settings, so that it corresponds to yesterday at the time of start package. For example:

In our case, we are UTC+3 and package is scheduled to run Today (September 19) at 09:00 (UTC+3). With such a setting, Skyvia will look for the test_2019-09-18.csv file.

 

Please tell us if this helps.

 

Best regards,

Mariia

Close