Certified Data Engineer Professional Practice Test

Certified Data Engineer Professional Practice Test practice questions, page 13 of 14, with answer review and explanations.

Question 61

A member of the data engineering team has submitted a short notebook that they wish to schedule as part of a larger data pipeline. Assume that the commands provided below produce the logically correct results when run as presented. Which command should be removed from the notebook before scheduling it as a job?

  1. Cmd 2
  2. Cmd 3
  3. Cmd 4
  4. Cmd 5
  5. Cmd 6

Question 62

The business reporting team requires that data for their dashboards be updated every hour. The total processing time for the pipeline that extracts transforms, and loads the data for their pipeline runs in 10 minutes. Assuming normal operating conditions, which configuration will meet their service-level agreement requirements with the lowest cost?

  1. Manually trigger a job anytime the business reporting team refreshes their dashboards
  2. Schedule a job to execute the pipeline once an hour on a new job cluster
  3. Schedule a Structured Streaming job with a trigger interval of 60 minutes
  4. Schedule a job to execute the pipeline once an hour on a dedicated interactive cluster
  5. Configure a job that executes every time new data lands in a given directory

Question 63

A Databricks SQL dashboard has been configured to monitor the total number of records present in a collection of Delta Lake tables using the following query pattern: SELECT COUNT (*) FROM table - Which of the following describes how results are generated each time the dashboard is updated?

  1. The total count of rows is calculated by scanning all data files
  2. The total count of rows will be returned from cached results unless REFRESH is run
  3. The total count of records is calculated from the Delta transaction logs
  4. The total count of records is calculated from the parquet file metadata
  5. The total count of records is calculated from the Hive metastore

Question 64

A Delta Lake table was created with the below query: Consider the following query: DROP TABLE prod.sales_by_store - If this statement is executed by a workspace admin, which result will occur?

  1. Nothing will occur until a COMMIT command is executed.
  2. The table will be removed from the catalog but the data will remain in storage.
  3. The table will be removed from the catalog and the data will be deleted.
  4. An error will occur because Delta Lake prevents the deletion of production data.
  5. Data will be marked as deleted but still recoverable with Time Travel.

Question 65

Two of the most common data locations on Databricks are the DBFS root storage and external object storage mounted with dbutils.fs.mount(). Which of the following statements is correct?

  1. DBFS is a file system protocol that allows users to interact with files stored in object storage using syntax and guarantees similar to Unix file systems.
  2. By default, both the DBFS root and mounted data sources are only accessible to workspace administrators.
  3. The DBFS root is the most secure location to store data, because mounted storage volumes must have full public read and write permissions.
  4. Neither the DBFS root nor mounted storage can be accessed when using %sh in a Databricks notebook.
  5. The DBFS root stores files in ephemeral block volumes attached to the driver, while mounted directories will always persist saved data to external storage between sessions.