Need assistance in figuring the core difference in the sample and actual table results viewed.
Owning an environment in Matillion, got differences that source back to the sample vs real run of the results.
Hi @farid.srouji and thanks so much for the question.
The following actions typically happen when running a single data-loading component.
- Execute the query/api-command with the source
- Push the returned data into files in a staging area (SF-stage/s3/blob)
- Issue a COPY command to Snowflake/Redshift to load from staging
- Delete the staged files
When you sample, the 1st step is run and a limited result is shown.There is also a limit where the data-source supports it.
Let me know if that helps or if you have any further questions - Claire
1 Like
Thank you very much for your reply
1 Like