Databricks

gbrueckl · 03-03-2022

We are currently setting up CI/CD for our Databricks workspace using Databricks Repos following the approach described in the offical docs: https://docs.databricks.com/repos.html#best-practices-for-integrating-databricks-repos-with-cicd-workflowsObvi...

gbrueckl · 10-14-2021

Is it somehow possible to create an SQL external function using Python code?the examples only show how to use JARshttps://docs.databricks.com/spark/latest/spark-sql/language-manual/sql-ref-syntax-ddl-create-function.htmlsomething like:CREATE TEMPORAR...

gbrueckl · 09-16-2021

I have a notebook which has a parameter defined as dbutils.widgets.multiselect("my_param", "ALL", ["ALL", "A", "B", "C")and I would like to pass this parameter when calling the notebook via dbutils.notebook.run()However, I tried passing it as an pyth...

gbrueckl · 09-10-2021

We need to run VACCUM on one of our biggest tables to free the storage. According to our analysis using VACUUM bigtable DRY RUN this affects 30M+ files that need to be deleted.If we run the final VACUUM, the file-listing takes up to 2h (which is OK) ...

gbrueckl · 12-16-2022

if you want to read your Delta Lake table directly from the storage without the need of having a Databricks cluster up and running you can also use the official connector Power BI connector for Delta Lake https://github.com/delta-io/connectors/tree/m...

gbrueckl · 11-02-2022

for our VSCode extension? no, not yet, but thats something we have on our list to add in the near future!

gbrueckl · 11-02-2022

For those of you who are interested, we created an extension for VSCode to work with Databricks which allows you to manage your Databricks workspace (DBFS, Clusters, Secrets, Repos, ...) and also run notebooks interactively against your Databricks Cl...

gbrueckl · 03-10-2022

Hi @Kaniz Fatma ,sure, I just scrolled through all pages there and found a total of < 10 comments (non from Microsoft or Databricks) , a bunch of "ideas" that are already implemented but never got updated and a lot of ideas from Microsoft itself mak...

gbrueckl · 03-09-2022

Thanks, Atanu, please read my previous comments about the state of the page where this link directs youdoes not look like that page got updated in the last 2 years

Databricks

User Stats

User Activity

Setup Git Integration via REST API

CREATE FUNCTION from Python file

dbutils.notebook.run with multiselect parameter

Slow performance of VACUUM on Azure Data Lake Store Gen2

Re: Can I query my Delta tables with PowerBI?

Re: Hello, everyone. I want to ask if there is a way to connect Databricks cluster with SSH interpreter in your IDE? I know about databricks connect but I want to execute the entire code in the cluster.

Re: Hello, everyone. I want to ask if there is a way to connect Databricks cluster with SSH interpreter in your IDE? I know about databricks connect but I want to execute the entire code in the cluster.

Re: Setup Git Integration via REST API

Re: Setup Git Integration via REST API