When is Databricks going to publish the 13.x runtimes on Dockerhub?We are using custom containers, but we need to upgrade to Pandas >= 2.0,.. and for that we need to upgrade Spark to >=3.4, and for that we need to upgrade our custom containers to the...
I have 4 months of data and I partitioned it on Year and Month column, so my parquet partition looks like Data is present inside each monthly partition folder in parquet format.Then I loaded data for July and also modified some values in August. Afte...
Hi Team, Need some advice on setting up a single workspace or multiple workspaces.Please read below for the problem statement - There is an ADLS account says ADLS1 which has a root folder say root1This root1 folder has multiple sub foldersteam1team2...
Hi @Loki Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your que...
how to stream data to powerbi?
Hi @krausedata We haven't heard from you since the last response from @karthik_p​, and I was checking back to see if his suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be helpful to others. Al...
When can I get fine grain access control in databricks
I wanted this for some time and found that its implemented now. Thanks - https://learn.microsoft.com/en-us/azure/databricks/data-governance/table-acls/object-privileges
I have attended data ai summit 2023 and it was cool.Although i cant find my discount 75% for any certification.Any thoughts how can i get my voucher?
I'm surprised this is not easily available, I checked this page for example: https://docs.databricks.com/release-notes/runtime/releases.html
@fijoy use %pip list in notebook and it should show libraries installed
I have a notebook (notebook A) that needs to run on a specific cluster.I now want to programmatically trigger notebook A from another notebook (notebook B), which also needs to run on a specific cluster (different from the cluster for notebook A).How...
@fijoy go with workflow job creation and create multiple task and assign different job clusters and trigger notebooks
Yesterday I created a account in community but today i am unable to login i tried to rest but when i click or reset email link it goes in hang state. screenshot is attached.for Login i am using this url Login - Databricks Community Edition
adding @Anonymous and @Retired_mod for visibility to help with your request
What is the best way to explain to non-technical customers the difference between a data warehouse and a data lakehouse?
Hi @SigmaTSE ,Data warehouse is like an organized pantry with labeled jars of ingredients.Data lakehouse is like a magical fridge where you can store all kinds of ingredients without worrying about labels, allowing for more flexibility and creativity...
Hi Team,I have attended Data + AI Summit 2023! You event and have given and passed the databricks accredited lakehouse platform fundamentals certification.Could you please provide me the voucher. So that I could take another certification.Please find...
In designing architecture for deploying machine learning models in production, what are the tradeoffs between a central Model Registry vs. per-Workspace Model Registries?
Anyone else using structured streaming at the summit?
Anyone have a solution for no code on Databricks that goes from business user to engineer?
#databrickscommunity
