Accessing multiple S3 buckets from a single environment

Matillion ETL
1

I want to transfer the files from one s3 bucket to another bucket using data transfer component of Matillion. Although, I have configured the buckets in the environment, only one of the bucket can be accessible at a time. Please let me know how to access  multiple buckets from a single environement.

2

Hello @salma.kammur-cw​

And thank you for your post, The data transfer component is able to transfer from one s3 bucket to another. The component will be using the environment credentials for access to both locations.

Therefore those environment credentials need to be authorized for reading from the source and writing to the target.

If that cannot be achieved then you could transfer to an intermediary location e.g. GCP or Azure blob. Then change environment credentials.

I hope that helps, please feel free to reach out if you need any further help with that.

Kind regards, Joe

3

HI Joe,

I have configured in the environment the credentials of the S3 buckets,but its allowing only one bucket per environment to access the s3 locations.

Thanks,
Salma.