Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
a week ago
I am trying to complete the "Get Started with Data Engineering" course, but I have been running into an issue.
I have gotten to this step in "Build a Declarative Pipeline with Spark Declarative Pipelines":
Demo: Create and Run the Pipeline
Now you'll configure an ETL Pipeline in the Databricks UI that uses this notebook as its source.
Follow these steps:
- In the left sidebar, click Jobs & Pipelines (right-click → open in a new tab so you can refer back to these instructions)
- Click Create and select ETL Pipeline
- Give your pipeline a name (e.g., yourname-sdp-bronze-silver-gold)
- Under Source code, click Browse and navigate to this notebook:
- Find your project folder → select 08 - Build a Declarative Pipeline with Spark Declarative Pipelines
- Under Destination, set:
- Catalog: dbacademy
- Schema: get_started_de
- Under Compute, confirm Serverless is selected
- Click Create
The problem is that the UI doesn't match the steps. Clicking "Create" automatically creates an empty pipeline, which is fine, but there doesn't seem to be anywhere to select source code.
Is there a workaround for this?