Are very large files (e.g., 100 GB) recommended to load in Snowflake?

Master Snowflake Data Engineer Exam. Study with flashcards and multiple choice questions, each question includes hints and explanations. Prepare for your success!

Multiple Choice

Are very large files (e.g., 100 GB) recommended to load in Snowflake?

Explanation:
Loading very large files is feasible in Snowflake, but without proper error handling the load can be halted by a single bad row or file. The ON_ERROR setting controls what happens when the COPY INTO operation encounters errors. By configuring ON_ERROR to CONTINUE (skip problematic rows) or SKIP_FILE (skip a file with errors), you allow the load to proceed and ingest as much valid data as possible, which is essential when dealing with huge datasets. The other options don’t address how errors affect a large load, and auto-scale pertains to compute resources rather than error handling.

Loading very large files is feasible in Snowflake, but without proper error handling the load can be halted by a single bad row or file. The ON_ERROR setting controls what happens when the COPY INTO operation encounters errors. By configuring ON_ERROR to CONTINUE (skip problematic rows) or SKIP_FILE (skip a file with errors), you allow the load to proceed and ingest as much valid data as possible, which is essential when dealing with huge datasets. The other options don’t address how errors affect a large load, and auto-scale pertains to compute resources rather than error handling.

Subscribe

Get the latest from Passetra

You can unsubscribe at any time. Read our privacy policy