cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Paolo
by New Contributor
  • 723 Views
  • 0 replies
  • 0 kudos

Bug - task retry fails to load cluster dependencies

Hi,I'm currently facing an issue with task retries on a structured streaming set to have unlimited retries. Our job crashes frequently due to out of memory problems, so we set the task retry limit to -1  (unlimited) as a workaround. This is also the ...

Community Platform Discussions
Bug
Cluster initialization
Dependency
structured streaming
  • 723 Views
  • 0 replies
  • 0 kudos
federram
by New Contributor
  • 912 Views
  • 0 replies
  • 0 kudos

onbet66vn

Sau khi truy cập vào đường link chính thức của nhà cái Onbet66. Người chơi sẽ nhấn vào nút đăng ký ở góc phải màn hình để bắt đầu cung cấp nhiều thông tin cá nhân để đảm bảo việc mở tài khoản miễn phí được nhanh chóngonbet app

  • 912 Views
  • 0 replies
  • 0 kudos
nikhil018
by New Contributor II
  • 622 Views
  • 0 replies
  • 1 kudos

Databricks Exam got suspended

Hi,I attended Databricks certified associate developer for apache spark 3.0- scala on 09 July 2023(today). At 7.35pm suddenly got a notice stating that due to eye movement away from exam your exam got suspended.I had completed the exam and was at the...

  • 622 Views
  • 0 replies
  • 1 kudos
kll
by New Contributor III
  • 493 Views
  • 0 replies
  • 0 kudos

Mosaic's grid_boundary method returns inconsistent geometries

I am applying mosaic's `grid_boundary` method on a spark DataFrame containing a set of `h3_hex_ids`. The geometries returned are not consistent. i.e they could be either `lat, long` or `long, lat`.Here's a sample data```import pyspark.sql.functions a...

Community Platform Discussions
data engineering
mosaic
  • 493 Views
  • 0 replies
  • 0 kudos
creev
by New Contributor III
  • 1965 Views
  • 2 replies
  • 0 kudos

Resolved! Library and Driver issues following Databricks outage on 05.07.2023 (Azure)

Hi All,Yesterday (05.07.2023) databricks experienced a near total outage in the West and North Europe regions. It took the full working day, but they posted an update in the late afternoonstating that a workaround has been put in place and service is...

Community Platform Discussions
azure
Databricks
driver
library
Outage
  • 1965 Views
  • 2 replies
  • 0 kudos
Latest Reply
creev
New Contributor III
  • 0 kudos

Dear All, I have resolved the issue by re-installing all libraries and drivers. The reason the drivers were causing me iussues was because my runtime version was updated, and I had no idea. This is probably ehat caused all the issues in the first pla...

  • 0 kudos
1 More Replies
Learner123
by New Contributor
  • 1015 Views
  • 1 replies
  • 1 kudos

Resolved! Find out the cluster hung state in azure databricks

Hi, I Have to capture the info when cluster is in hung state for example any cluster is running from last 2 hrs. But it doesn't show any progress. Where can I get  hung details.

  • 1015 Views
  • 1 replies
  • 1 kudos
Latest Reply
Prabakar
Esteemed Contributor III
  • 1 kudos

You can look at the sparkUI of the cluster to get what is happening on the cluster.Debugging with the Apache Spark UI - Azure Databricks | Microsoft Learn 

  • 1 kudos
RobinK
by Contributor
  • 531 Views
  • 0 replies
  • 0 kudos

Resources for Data+AI Summit Talks

Hi,where do I find the resource mentioned in the latest talks of the Data+AI Summit 2023? In the videos the speaker mention, that there are resources avaible for example in the talk "Best Practices for Setting Up Databricks SQL at Enterprise Scale" (...

  • 531 Views
  • 0 replies
  • 0 kudos
BriceBuso
by Contributor II
  • 1706 Views
  • 3 replies
  • 5 kudos

Resolved! Databricks - Server/Clusters issues

Hello, Do some other users have some issues with Databricks today (Clusters, connection, server)?I'm experiencing slowness and failure when running notebooks. My Databricks is on Azure West Europe in Premium.  

  • 1706 Views
  • 3 replies
  • 5 kudos
Latest Reply
Vinay_M_R
Valued Contributor II
  • 5 kudos

Hi team,Users may experience slow rendering of notebooks, clusters, and other Databricks user interfaces. Our engineering team is engaged and our status page is updated.https://status.azuredatabricks.net/Some preliminary explanation on Azure website ...

  • 5 kudos
2 More Replies
nikhiljatiwal
by New Contributor II
  • 915 Views
  • 1 replies
  • 1 kudos

Resolved! Not able to login to to Partner Acedamy

Hi,I have created my account using my email address on https://community.databricks.com,  and my credentials work on https://community.databricks.com.But, when I try login using the same credentials on partner-academy.databricks.com, my login fails. ...

  • 915 Views
  • 1 replies
  • 1 kudos
Latest Reply
Vartika
Moderator
  • 1 kudos

Hi @nikhiljatiwal,Thank you for reaching out!Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training and our team will get back to you shortly. 

  • 1 kudos
Anonymous
by Not applicable
  • 556 Views
  • 0 replies
  • 1 kudos

Generation AI - would love to know your thoughts

Hello, Community members! I hope this message finds you well. I wanted to reach out and inquire about your experience with DAIS and how you are absorbing all the valuable information it provides. Additionally, I would love to hear what aspects of Gen...

  • 556 Views
  • 0 replies
  • 1 kudos
AbhiJ
by New Contributor III
  • 2654 Views
  • 3 replies
  • 1 kudos

How to refresh materialized view (Delta Live Table) without running a pipeline every time.

Hello, My requirement is to created a materialized view (Live table) from a downstream table. The down stream table gets refreshed frequently and hence the materialized view needs to be recalculated. I don't want the pipe line to be in continuous mod...

  • 2654 Views
  • 3 replies
  • 1 kudos
Latest Reply
AbhiJ
New Contributor III
  • 1 kudos

Hi @Chengcheng I am fine with manual refresh also and have tried "Refresh Table <TableName>" command but it doesn't refreshes the table with new data.The Full refresh command "REFRESH TABLE <tableName> FULL; is giving below error inside notebook.REFR...

  • 1 kudos
2 More Replies
dplante
by Contributor II
  • 2471 Views
  • 5 replies
  • 2 kudos

Resolved! Please share your favorite talks from the Databricks Data+AI Summit 2023 :)

I thought this would be a good place to share your favorite talks from the Databricks Data+AI Summit 2023 Heck feel free to share your favorite talk from a different conference or previous summit Today's talk 'Delta-rs, Apache Arrow, Polars, WASM: Is...

  • 2471 Views
  • 5 replies
  • 2 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 2 kudos

Rust ftw!

  • 2 kudos
4 More Replies
tjkentSI
by New Contributor
  • 497 Views
  • 0 replies
  • 0 kudos

Workflow permissions

I am having an issue where my permissions aren't being passed to workflows. I can use the same cluster to access files in an S3 repo but if I try to do spark-submit or a jar task on workflows I am unable to reach my buckets. I am trying to use Unity ...

  • 497 Views
  • 0 replies
  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors