Databricks Certified Data Engineer Professional 問題集 : Databricks-Certified-Data-Engineer-Professional

A data engineer is implementing a job to download multiple PDF files from a third-party provided REST API endpoint by specifying different report types. The REST API is time-consuming and encounters intermittent errors, so the engineer wants to track each download activity to know when it fails and to retry partially, while providing scalable throughput. The engineer needs to download ten report types, and the list can be changed over time. How should the data engineer achieve this?

• A. Use a foreach task with a list of report types as its inputs.
• B. Define ten Notebook tasks to clearly track which report download failed.
• C. Use a Delta Lake table to track each report download status as 10 rows, and use it as a source table to execute the download function as a Pandas UDF.
• D. Define a list variable within a Notebook to loop through the report types to download them, and print the download results. Execute it as a Notebook tasks.

The data engineer team has been tasked with configured connections to an external database that does not have a supported native connector with Databricks. The external database already has data security configured by group membership. These groups map directly to user group already created in Databricks that represent various teams within the company. A new login credential has been created for each group in the external database. The Databricks Utilities Secrets module will be used to make these credentials available to Databricks users. Assuming that all the credentials are configured correctly on the external database and group membership is properly configured on Databricks, which statement describes how teams can be granted the minimum necessary access to using these credentials?

• A. No additional configuration is necessary as long as all users are configured as administrators in the workspace where secrets have been added.
• B. "Manage" permission should be set on a secret scope containing only those credentials that will be used by a given team.
• C. "Read'' permissions should be set on a secret key mapped to those credentials that will be used by a given team.
• D. "Read" permissions should be set on a secret scope containing only those credentials that will be used by a given team.

A data engineer has configured their Databricks Asset Bundle with multiple targets in databricks.yml and deployed it to the production workspace. Now, to validate the deployment, they need to invoke a job named my_project_job specifically within the prod target context.
Assuming the job is already deployed, they need to trigger its execution while ensuring the target- specific configuration is respected. Which command will trigger the job execution?

• A. databricks run my_project_job -t prod
• B. databricks execute my_project_job -e prod
• C. databricks job run my_project_job --env prod
• D. databricks bundle run my_project_job -t prod

A Delta Lake table representing metadata about content posts from users has the following schema:
user_id LONG, post_text STRING, post_id STRING, longitude FLOAT,
latitude FLOAT, post_time TIMESTAMP, date DATE
This table is partitioned by the date column. A query is run with the following filter:
longitude < 20 & longitude > -20
Which statement describes how data will be filtered?

• A. The Delta Engine will use row-level statistics in the transaction log to identify the flies that meet the filter criteria.
• B. Statistics in the Delta Log will be used to identify partitions that might Include files in the filtered range.
• C. The Delta Engine will scan the parquet file footers to identify each row that meets the filter criteria.
• D. No file skipping will occur because the optimizer does not know the relationship between the partition column and the longitude.
• E. Statistics in the Delta Log will be used to identify data files that might include records in the filtered range.

A data engineering team has a time-consuming data ingestion job with three data sources. Each notebook takes about one hour to load new data. One day, the job fails because a notebook update introduced a new required configuration parameter. The team must quickly fix the issue and load the latest data from the failing source. Which action should the team take?

• A. Repair the run with the new parameter, and update the task by adding the missing task parameter.
• B. Update the task by adding the missing task parameter, and manually run the job.
• C. Repair the run with the new parameter.
• D. Share the analysis with the failing notebook owner so that they can fix it quickly.