Hi I want to add a filter condition while reading files through file iterator component. My requirement is to get files with size > 0.Currently the file itertor is reading all the files with some pattern defined in regex filter. Looking for immediate help

Matillion ETL
1

Hi I want to add a filter condition while reading files through file iterator component. My requirement is to get files with size > 0.Currently the file itertor is reading all the files with some pattern defined in regex filter. Looking for immediate help

2

You can a custom code to identify the files with size > 0 in a Python or Bash component, and then append them to a list variable. You can then submit the list variable to your File Iterator component