How do I add a "pull_date" column to an API pull results before loading the data to a table?

Matillion ETL
1

For versioning purposes, I would like to append API data to a snowflake table with a date column that shows the date the data was pulled from the API. Is there a simple way to do this using Matillion components? Currently, my best solution is to write it all in python then use Matillion to schedule/run the python script.

 

Thanks,

Devin

2

Hi @devinl2​

Thanks for your post, I just came across it and wanted to get an answer on this for you, there are two ways in which this can be achieved.

You can either create a table storing the current time and then retrieve this and do a join into the load or you can add a calculator component and do this within the transformation of the data.

I hope that makes sense, if you need anything else, please let me know.

Kind regards, Joe