Can we try using a combination of dbutils.notebook.exit() and temporary views? there is a drawback that dbutils.notebook.exit() can only return a single string.
import json
from pyspark.sql import SparkSession
# Create a temporary view
data = sp...
Delta Live Tables (DLT): ref: https://docs.databricks.com/en/delta-live-tables/expectations.html
Expectations: DLT allows you to define data quality constraints on datasets using expectations. These expectations can be applied to queries using Python...
Currently, there is no direct option to download a Databricks dashboard as a PDF from the UI. The references you see in the documentation about exporting a dashboard typically pertain to exporting it as a JSON file, which is why you are seeing a JSON...
Yes, you must enable predictive optimization at the account level. Once enabled, predictive optimization will be applied by default to all catalogs, schemas, and tables within the account. To prevent predictive optimization from being applied to spec...
