Certified Data Engineer Associate Practice Test practice questions, page 6 of 12, with answer review and explanations.
Question 26
A Delta Live Table pipeline includes two datasets defined using STREAMING LIVE TABLE. Three datasets are defined against Delta Lake table sources using LIVE TABLE. The table is configured to run in Production mode using the Continuous Pipeline Mode. Assuming previously unprocessed data exists and all definitions are valid, what is the expected outcome after clicking Start to update the pipeline?
All datasets will be updated at set intervals until the pipeline is shut down. The compute resources will persist to allow for additional testing.
All datasets will be updated once and the pipeline will persist without any processing. The compute resources will persist but go unused.
All datasets will be updated at set intervals until the pipeline is shut down. The compute resources will be deployed for the update and terminated when the pipeline is stopped.
All datasets will be updated once and the pipeline will shut down. The compute resources will be terminated.
All datasets will be updated once and the pipeline will shut down. The compute resources will persist to allow for additional testing.
Question 27
In order for Structured Streaming to reliably track the exact progress of the processing so that it can handle any kind of failure by restarting and/or reprocessing, which of the following two approaches is used by Spark to record the offset range of the data being processed in each trigger?
Checkpointing and Write-ahead Logs
Structured Streaming cannot record the offset range of the data being processed in each trigger.
Replayable Sources and Idempotent Sinks
Write-ahead Logs and Idempotent Sinks
Checkpointing and Idempotent Sinks
Question 28
Which of the following describes the relationship between Gold tables and Silver tables?
Gold tables are more likely to contain aggregations than Silver tables.
Gold tables are more likely to contain valuable data than Silver tables.
Gold tables are more likely to contain a less refined view of data than Silver tables.
Gold tables are more likely to contain more data than Silver tables.
Gold tables are more likely to contain truthful data than Silver tables.
Question 29
Which of the following describes the relationship between Bronze tables and raw data?
Bronze tables contain less data than raw data files.
Bronze tables contain more truthful data than raw data.
Bronze tables contain aggregates while raw data is unaggregated.
Bronze tables contain a less refined view of data than raw data.
Bronze tables contain raw data with a schema applied.
Question 30
Which of the following tools is used by Auto Loader process data incrementally?