Databricks Community

AnaMocanu · 02-20-2025

Hey all,We've got a bunch of business objects we created as delta live tables. these are important as that's what business users will use in dashboards, genie rooms etc. We're trying to enrich the metadata for those but the option is greyed out and I...

AnaMocanu · 12-16-2024

Hey everyone,So I managed to create a Streamlit app on Databricks, works fine deployed in the cloud.However, when I try to run it locally, it complains about "assert os.getenv('DATABRICKS_WAREHOUSE_ID'), "DATABRICKS_WAREHOUSE_ID must be set in app.ya...

AnaMocanu · 08-19-2024

Hi there,I'm having a difficult time understanding the compute side of our jobs under the hood, and I checked the documentation but don't have clear answers so far, so hopefully someone will provide some clarity.I set up pools to use for our overnigh...

AnaMocanu · 04-22-2024

I managed to extract the Google Analytics data via lakehouse federation and the Big Query connection but the events table values are in a weird JSON format{"v":[{"v":{"f":[{"v":"ga_session_number"},{"v":{"f":[{"v":null},{"v":"2"},{"v":null},{"v":null...

AnaMocanu

thanks for that @pdiamond - the underscore didn't work for me, but trying again with the parameter set up it seems that it works now! I can see the key "sql-warehouse" under App resources. Yours must be set up "sql_warehouse" instead.Glad we both sor...

AnaMocanu

Unfortunately not  the other way to avoid it is to not use serverless as the warehouse name won't change then.

AnaMocanu · 12-16-2024

Hi @Alberto_Umana Thanks for your reply!DATABRICKS_WAREHOUSE_ID is set up in yaml file like this:env:- name: "DATABRICKS_WAREHOUSE_ID"valueFrom: "sql-warehouse" When the app is running on Databricks, I can see a Service principal in app resources tha...

AnaMocanu · 04-23-2024

Thank you @daniel_sahal I decided to go with parsing the data from the json format, as I don't need too many columns and the elements in the list that I need will stay the same.For example, when you're picking the first element in the listdf = df.wit...

Databricks Community

User Stats

User Activity

How do you add comment metadata to delta live tables?

Streamlit app on Databricks doesn't recognise the DATABRICKS_WAREHOUSE_ID in the yaml file

Compute pools max capacity and ideal compute settings

Best way to parse Google Analytics data in Databricks notebook

Re: Streamlit app on Databricks doesn't recognise the DATABRICKS_WAREHOUSE_ID in the yaml file

Re: Streamlit app on Databricks doesn't recognise the DATABRICKS_WAREHOUSE_ID in the yaml file

Re: Streamlit app on Databricks doesn't recognise the DATABRICKS_WAREHOUSE_ID in the yaml file

Re: Best way to parse Google Analytics data in Databricks notebook