We have loaded D365F&O data to Azure data lake and now using Matillion we need to load those data to SnowFlake, now the issue is data lake have separate file for column name(which is in JSON file) and another file for data(in CSV format)

vaibhavi.pandya · August 26, 2022, 9:34am

We have loaded D365F&O data to Azure data lake and now using Matillion we need to load those data to SnowFlake, now the issue is data lake have separate file for column name(which is in JSON file) and another file for data(in CSV format), I need help how can I fetch Metadata(column names JSON format) and data(CSV format) together? Or how can i load JSON file as a table structure through Matillion? Looking forward to hear some good idea around it, Thank you in advance.

Topic		Replies	Views
Data Ingestion: Load Dynamic Files from S3 to Snowflake Matillion ETL	1	1	January 29, 2021
I am trying to get data from api which returns the data in csv format. How can I load this data using Matillion into snowflake since API query component cannot be used. What are the best possible options and solution to the option Matillion ETL	10	4	September 9, 2021
Hi everyone I am new to matillion etl tool can u suggest how to learn or grow on on Matillion ETL	6	0	May 5, 2021
Hello All, In Matlllion ETL we have Database Query component, Which stages the data, onto S3 Storage, So overthere i could see that it doesnt have any file format(csv)etc ? If so How does it Load into Snowflake ! Can anyone throw some light on this? Matillion ETL	2	2	February 1, 2022
Dynamically generate column list from incoming source file Matillion ETL	21	2	March 31, 2022

We have loaded D365F&O data to Azure data lake and now using Matillion we need to load those data to SnowFlake, now the issue is data lake have separate file for column name(which is in JSON file) and another file for data(in CSV format)

Related topics