When monitoring a complex workload, being able to see the query plan is critical to understanding what the workload is doing. Where can the visualization of the query plan be found?

• A. In the Query Profiler, under the Stages tab
• B. In the Spark UI, under the SQL/DataFrame tab
• C. In the Spart UI, under the Jobs tab
• D. In the Query Profiler, under Query Source

Each configuration below is identical to the extent that each cluster has 400 GB total of RAM 160 total cores and only one Executor per VM.
Given an extremely long-running job for which completion must be guaranteed, which cluster configuration will be able to guarantee completion of the job in light of one or more VM failures?

• A. - Total VMs: 2
  - 200 GB per Executor
  - 80 Cores / Executor
• B. - Total VMs: 4
  - 100 GB per Executor
  - 40 Cores / Executor
• C. - Total VMs: 16
  - 25 GB per Executor
  - 10 Cores / Executor
• D. - Total VMs: 1
  - 400 GB per Executor
  - 160 Cores/Executor
• E. - Total VMs: 8
  - 50 GB per Executor
  - 20 Cores / Executor

A data engineer needs to create an application that will collect information about the latest job run including the repair history. How should the data engineer format the request?

• A. Call/api/2.1/jobs/runs/list with the run_id and include_history parameters
• B. Call/api/2.1/jobs/runs/list with the job_id and include_history parameters
• C. Call/api/2.1/jobs/runs/get with the job_id and include_history parameters
• D. Call/api/2.1/jobs/runs/get with the run_id and include_history parameters

A junior member of the data engineering team is exploring the language interoperability of Databricks notebooks. The intended outcome of the below code is to register a view of all sales that occurred in countries on the continent of Africa that appear in the geo_lookup table.
Before executing the code, running SHOW TABLES on the current database indicates the database contains only two tables: geo_lookup and sales.

Which statement correctly describes the outcome of executing these command cells in order in an interactive notebook?

• A. Cmd 1 will succeed and Cmd 2 will fail, countries at will be a Python variable containing a list of strings.
• B. Both commands will succeed. Executing show tables will show that countries at and sales at have been registered as views.
• C. Cmd 1 will succeed. Cmd 2 will search all accessible databases for a table or view named countries af: if this entity exists, Cmd 2 will succeed.
• D. Both commands will fail. No new variables, tables, or views will be created.
• E. Cmd 1 will succeed and Cmd 2 will fail, countries at will be a Python variable representing a PySpark DataFrame.

The downstream consumers of a Delta Lake table have been complaining about data quality issues impacting performance in their applications. Specifically, they have complained that invalid latitude and longitude values in the activity_details table have been breaking their ability to use other geolocation processes.
A junior engineer has written the following code to add CHECK constraints to the Delta Lake table:

A senior engineer has confirmed the above logic is correct and the valid ranges for latitude and longitude are provided, but the code fails when executed.
Which statement explains the cause of this failure?

• A. The activity details table already contains records; CHECK constraints can only be added prior to inserting values into a table.
• B. The activity details table already exists; CHECK constraints can only be added during initial table creation.
• C. The current table schema does not contain the field valid coordinates; schema evolution will need to be enabled before altering the table to add a constraint.
• D. Because another team uses this table to support a frequently running application, two-phase locking is preventing the operation from committing.
• E. The activity details table already contains records that violate the constraints; all existing data must pass CHECK constraints in order to add them to an existing table.