Hello there, I am trying to start a serverless databricks SQL cluster in GCP. I am following this databricks doc: https://docs.gcp.databricks.com/en/admin/sql/serverless.html I have checked th...
hello there. I am experiencing a problem using the Databricks Extension with Visual Studio Code, and I wonder if anyone else has experienced this. First, I have installed the databricks cli, a...
If I do this %sql create or replace temporary view myview as select * from silver.<schema>.<table>; SHOW VIEWS; select * from myview; It works. But if I do the same on a Share...
Hi there everyone, We are trying to get hands on Databricks Lakehouse for a prospective client's project. Our Major aim for the project is to Compare Datalakehosue on Databricks and Bigquery Datawa...
Hi, I have a DLT pipeline that applies changes from a source table (cdctest_cdc_enriched) to a target table (cdctest), by the following code: dlt.apply_changes( target = "cdctest", ...
Hello, we have Databricks Python workbooks accessing Delta tables. These workbooks are scheduled/invoked by Azure Data Factory. How can I enable Photon on the linked services that are used to call Da...
Hi , I have a Databricks job that results in a dashboard post run , I'm able to download the dashboard as HTML from the view job runs page , but I want to automate the process , so I tried using the...
...atabricks-connect for a better developer experience. I download a file from the public internet and I want to store it in an external Unity Catalog Volume (hosted on S3). I would like to u...
I need to execute a .py file in Databricks from a notebook (with arguments which for simplicity i exclude here). For this i am using: %sh script.py script.py: from pyspark import SparkContext
def...