# Hello Team,

I have requirement to create a pipeline which ingests data(Batch/cdc) from Salesforce to Snowflake with S3 as a staging area. 
The pipeline should be dynamically able to create folders in S3 and store files for each load(batch/cdc)

**URL:** <https://matillioncommunity.discourse.group/t/hello-team-i-have-requirement-to-create-a-pipeline-which-ingests-data-batch-cdc-from-salesforce-to-snowflake-with-s3-as-a-staging-area-the-pipeline-should-be-dynamically-able-to-create-folders-in-s3-and-store-files-for-each-load-batch-cdc/1927>\
**Category:** Matillion ETL\
**Created:** [October 25, 2022, 12:04am UTC](https://matillioncommunity.discourse.group/t/hello-team-i-have-requirement-to-create-a-pipeline-which-ingests-data-batch-cdc-from-salesforce-to-snowflake-with-s3-as-a-staging-area-the-pipeline-should-be-dynamically-able-to-create-folders-in-s3-and-store-files-for-each-load-batch-cdc/1927 "2022-10-25T00:04:28Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![sreevidhyas](https://avatars.discourse-cdn.com/v4/letter/s/858c86/32.png) [@sreevidhyas](https://matillioncommunity.discourse.group/u/sreevidhyas)\
**Post date:** [October 25, 2022, 12:04am UTC](https://matillioncommunity.discourse.group/t/hello-team-i-have-requirement-to-create-a-pipeline-which-ingests-data-batch-cdc-from-salesforce-to-snowflake-with-s3-as-a-staging-area-the-pipeline-should-be-dynamically-able-to-create-folders-in-s3-and-store-files-for-each-load-batch-cdc/1927/1 "2022-10-25T00:04:28Z")

</div>

Question:

1. Which is the best option to implement this use-case? Matillion Data Loader /ETL ?
2. If Matillion ETL is leveraged, is there an option to do batch load of all the tables in a single job?
3. How to dynamically create folders and store objects in S3 post every load

---

<div class="post-metadata">

**Author:** ![ChikaMatillionCommunityMgr](https://avatars.discourse-cdn.com/v4/letter/c/c5a1d2/32.png) [@ChikaMatillionCommunityMgr](https://matillioncommunity.discourse.group/u/ChikaMatillionCommunityMgr)\
**Post date:** [January 23, 2023, 5:05pm UTC](https://matillioncommunity.discourse.group/t/hello-team-i-have-requirement-to-create-a-pipeline-which-ingests-data-batch-cdc-from-salesforce-to-snowflake-with-s3-as-a-staging-area-the-pipeline-should-be-dynamically-able-to-create-folders-in-s3-and-store-files-for-each-load-batch-cdc/1927/2 "2023-01-23T17:05:13Z")

</div>

Hi [@sreevidhyas](https://matillioncommunity.discourse.group/u/sreevidhyas)​

Pardon the delayed response and to answer your questions:

1. Both Matillion Data Loader and ETL could do that

2. Yes, using variables (see: [**https://documentation.matillion.com/docs/2968378#using-variables**](https://documentation.matillion.com/docs/2968378#using-variables))

3. Use a variable in the "stage" name of the Salesforce Query component (see: [**https://documentation.matillion.com/docs/2389995**](https://documentation.matillion.com/docs/2389995))

Thank you,

Chika
