cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Subratpanigrahi
by New Contributor II
  • 915 Views
  • 1 replies
  • 0 kudos

Unity catalog unable to identify Managed Identity

Hello all,We have encountered a problem while running a notebook on a unity catalog cluster by using Azure data factory managed identity. When we add the managed identity directly to the unity catalog table it’s working but if we add the managed iden...

  • 915 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @Subratpanigrahi, Let’s delve into the issue you’re facing with Unity Catalog and Azure Data Factory managed identities. Managed Identities in Unity Catalog: Unity Catalog can be configured to use an Azure-managed identity to access storage co...

  • 0 kudos
_raman_
by New Contributor II
  • 777 Views
  • 1 replies
  • 2 kudos

ERROR WHILE CREATING CLUTER IN COMMUNITY VERSION

From past two hours i am trying to create a cluster but it is getting failed after trying of 15-20 minutes.the red sign is coming after the cluster name which says that : Bootstrap Timeout:Node daemon ping timeout in 780000 ms for instance i-05ff43bc...

  • 777 Views
  • 1 replies
  • 2 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 2 kudos

Hi @_raman_, I understand that you’re facing issues while creating a cluster, and you’re encountering a Bootstrap Timeout error with the message: Node daemon ping timeout in 780000 ms for instance i-05ff43bc1d12412b5 @ 10.172.216.96. Please check ...

  • 2 kudos
manuel_john
by New Contributor II
  • 501 Views
  • 1 replies
  • 0 kudos

Bootstrap Timeout

Bootstrap Timeout:Node daemon ping timeout in 780000 ms for instance i-04258dad0f5aff74e @ 10.172.249.26. Please check network connectivity between the data plane and the control plane. I'm getting this error when trying to start my CE cluster. Does ...

  • 501 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @manuel_john, First, ensure that there is proper network connectivity between the data plane (where your cluster runs) and the control plane (where Databricks manages the cluster). Check if there are any firewall rules or network restrictions that...

  • 0 kudos
Ahk
by New Contributor
  • 530 Views
  • 1 replies
  • 0 kudos

Uanble to connect to a cluster on Databricks community version

I've been trying out the Databricks Community Edition, Every time I try to connect to a cluster I'm getting one of the following 2 errorsBootstrap Timeout:Node daemon ping timeout in 780000 ms for instance i-04d14165ecb322e53 @ 10.172.223.53. Please ...

  • 530 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 0 kudos

Hi @Ahk This is mostly internal error with databricks, this will resolve within a day

  • 0 kudos
Sid1805
by New Contributor II
  • 1196 Views
  • 3 replies
  • 0 kudos

Azure Databricks SQL Execution API Authentication

Hi Team,If a cloud application wants to read some data from Databricks we realize that Azure Databricks can expose its Tables via REST API.For its authentication what is the most recommended method - I see we can have PAT token tagged to a Service Pr...

  • 1196 Views
  • 3 replies
  • 0 kudos
Latest Reply
Ramakrishnan83
New Contributor III
  • 0 kudos

Hi @Sid1805 ,I am in the same situation as you. I am looking for guidance how to setup the authentication for REST API to connect with Databricks SQL. I started with PAT and used  the user id as "token" and pwd as PAT Token to connect with Databricks...

  • 0 kudos
2 More Replies
juanchochuy
by New Contributor
  • 2095 Views
  • 2 replies
  • 0 kudos

How Connect Powerbi with sql endpoint with no public access only private?

 we are making configuration adjustments in the workspaces to disable public access. My concern is whether this will impact the Power BI dashboards that currently consume data from our workspace's SQL Data Warehouse. 

Community Platform Discussions
Endpoint SQL
PowerBI
Public Access
  • 2095 Views
  • 2 replies
  • 0 kudos
Latest Reply
gmiguel
Contributor
  • 0 kudos

If you're using Azure Databricks, you can create a vnet data gateway on Azure.https://learn.microsoft.com/en-us/data-integration/vnet/create-data-gatewayshttps://learn.microsoft.com/en-us/data-integration/vnet/high-availability-load-balancingYou need...

  • 0 kudos
1 More Replies
KVK
by New Contributor II
  • 544 Views
  • 1 replies
  • 0 kudos

Unable to reset my Community edition password

I created a new Databricks community account a few days ago. Unfortunately, I seem to have forgotten the password associated with it. Despite trying the "forgot password" option multiple times on the login page, I haven't received any emails to reset...

  • 544 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @KVK, Please look at this link related to the Community - Edition, which might solve your problem.   I appreciate your interest in sharing your Community-Edition query with us.   If you have any more questions or concerns, please don't hesitate to...

  • 0 kudos
DavidKxx
by Contributor
  • 1183 Views
  • 1 replies
  • 0 kudos

Resolved! pandas .style is ugly in Databricks

Why does something like      df.style.hide_index()     turn out so ugly in Databricks?  That command should show the dataframe pretty like always, but simply with the index column concealed.  Instead, here's an image of what happens instead (displayi...

Screenshot 2024-03-11 111410.png
  • 1183 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @DavidKxx, You can use df.to_html(index=False) to generate an HTML representation of the DataFrame without the index column.Databricks notebooks have their own rendering and display mechanisms. Sometimes, the rendering of Pandas DataFrames within ...

  • 0 kudos
Ruby8376
by Valued Contributor
  • 719 Views
  • 2 replies
  • 1 kudos

Function/system id for tableau databricks connector

currently, we are using PAT token for authentication purposes to generate tableau reports form data in databricks delta tables using databricks tableau connector. Would somebody know if system/function ID can be used from Tableau to  Databricks inste...

  • 719 Views
  • 2 replies
  • 1 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 1 kudos

Hi @Ruby8376, Please refer to the official documentation: Connect Tableau to Azure Databricks1.Connect Tableau to Databricks2.

  • 1 kudos
1 More Replies
Shravanshibu
by New Contributor III
  • 1029 Views
  • 1 replies
  • 0 kudos

No able to move a file to volume

I am trying to move a file from repo local directory to volumes, but I am getting directory not found issue. Can some one guide me.tried using dbfs (dbfs/:Volumes/folder/ , /dbfs/Volumes/folder/) and without dbfs (/Volumes/folder/). None worked.@Kani...

Shravanshibu_0-1710141545813.png
Community Platform Discussions
unitycatalog
Volumes
  • 1029 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @Shravanshibu , When using Databricks File System (DBFS), ensure you use the correct syntax for specifying the path to a volume: If you’re using the absolute path, it should be: /dbfs/Volumes/folder/your_file.txt.If you’re using a relative path, i...

  • 0 kudos
Ruby8376
by Valued Contributor
  • 1552 Views
  • 3 replies
  • 1 kudos

Resolved! Can data be unified based on client profile (unified profile) in databricks?

Hi All,my question is in regard to how data in salesforce data cloud gets unified based on client profiles. Can similar action be done on data in databricks. i believe unity catalog just provides unified layer for security and governance. is there a ...

  • 1552 Views
  • 3 replies
  • 1 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 1 kudos

You want to identify actual persons based on one or more profiles (based on e-mail address etc).  That is something that is not available out-of-the box in Databricks.  The 'unified' in Databricks means you have a single platform for several data top...

  • 1 kudos
2 More Replies
vkuznetsov
by New Contributor III
  • 2730 Views
  • 5 replies
  • 5 kudos

Problem sharing a streaming table created in Delta Live Table via Delta Sharing

Hi all,I hope you could help me to figure out what I am missing.I'm trying to do a simple thing. To read the data from the data ingestion zone (csv files saved to Azure Storage Account) using the Delta Live Tables pipeline and share the resulting tab...

vkuznetsov_0-1689259588838.png 2023_07_13_16_48_52_Data_Explorer.png
  • 2730 Views
  • 5 replies
  • 5 kudos
Latest Reply
jdog
New Contributor II
  • 5 kudos

I'm curious if Databricks plans to address this.  We use delta live streaming tables extensively and also planned on using delta sharing to get our data from our production unity catalog (different region).  Duplicating the data as a workaround is no...

  • 5 kudos
4 More Replies
Madalian
by New Contributor III
  • 1678 Views
  • 2 replies
  • 0 kudos

How to create Delta live tables in Silver layer

How to create Delta live tables in Silver layerHi DB Experts,Having basic questions :I am working on Madalian Architecture (B, S, G) Layers.on B i am getting Delta files (Parq) format. with log folders. One folder for one table, multiple files are ge...

  • 1678 Views
  • 2 replies
  • 0 kudos
Latest Reply
Madalian
New Contributor III
  • 0 kudos

Dear Kaniz,Thank you for addressing question :I am getting following error if i follow above: pyspark.errors.exceptions.captured.IllegalArgumentException: Reading from a Delta table is not supported with this syntax. If you would like to consume data...

  • 0 kudos
1 More Replies
santiagortiiz
by New Contributor III
  • 1856 Views
  • 2 replies
  • 0 kudos

I was charged by a free trial

Hello databricks community, I took a databricks course to prepare for certification exam and requested a 14-days free trial on february 13 at 4:51 PM. So, February 27 at 4:51 pm must be the end of the free trial, but it ended 1 day before. Additional...

  • 1856 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Thank you for posting your concern on Community! To expedite your request, please list your concerns on our ticketing portal. Our support staff would be able to act faster on the resolution (our standard resolution time is 24-48 hours).

  • 0 kudos
1 More Replies
Sujitha
by Community Manager
  • 6963 Views
  • 8 replies
  • 27 kudos

Big news: Our Community is now 100,000 members strong with over 50,000 posts🚀

Thanks to every one of you, the Databricks Community has reached an incredible milestone: 100,000 members and over 50,000 posts! Your dedication, expertise and passion have made this possible. Whether you're a seasoned data professional, a coding en...

Header Image 2.png
  • 6963 Views
  • 8 replies
  • 27 kudos
Latest Reply
AshR
New Contributor III
  • 27 kudos

Wonderful!

  • 27 kudos
7 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors