Certified Data Engineer Professional Practice Test

Certified Data Engineer Professional Practice Test practice questions, page 11 of 14, with answer review and explanations.

Question 51

Where in the Spark UI can one diagnose a performance problem induced by not leveraging predicate push-down?

  1. In the Executor’s log file, by grepping for "predicate push-down"
  2. In the Stage’s Detail screen, in the Completed Stages table, by noting the size of data read from the Input column
  3. In the Storage Detail screen, by noting which RDDs are not stored on disk
  4. In the Delta Lake transaction log. by noting the column statistics
  5. In the Query Detail screen, by interpreting the Physical Plan

Question 52

Review the following error traceback: Which statement describes the error being raised?

  1. The code executed was PySpark but was executed in a Scala notebook.
  2. There is no column in the table named heartrateheartrateheartrate
  3. There is a type error because a column object cannot be multiplied.
  4. There is a type error because a DataFrame object cannot be multiplied.
  5. There is a syntax error because the heartrate column is not correctly identified as a column.

Question 53

Which distribution does Databricks support for installing custom Python code packages?

  1. sbt
  2. CRANC. npm
  3. Wheels
  4. jars

Question 54

Which Python variable contains a list of directories to be searched when trying to locate required modules?

  1. importlib.resource_path
  2. sys.path
  3. os.path
  4. pypi.path
  5. pylib.source

Question 55

Incorporating unit tests into a PySpark application requires upfront attention to the design of your jobs, or a potentially significant refactoring of existing code. Which statement describes a main benefit that offset this additional effort?

  1. Improves the quality of your data
  2. Validates a complete use case of your application
  3. Troubleshooting is easier since all steps are isolated and tested individually
  4. Yields faster deployment and execution times
  5. Ensures that all steps interact correctly to achieve the desired end result