cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Avinash_Bevara
by New Contributor III
  • 3084 Views
  • 6 replies
  • 0 kudos

Resolved! Databricks Certified Data Engineer Associate (Version 3) Exam suspended

  Hi Team, My data bricks exam got suspended on 19th July 2023 and it is still in the suspended state. I have raised a support request using the below link https://help.databricks.com/s/contact-us?ReqType=training and my request Id is #00347940  I wo...

  • 3084 Views
  • 6 replies
  • 0 kudos
Latest Reply
APadmanabhan
Databricks Employee
  • 0 kudos

Hi again, I have notified the team that handles these requests, and they will get back to you.I appreciate your patience.

  • 0 kudos
5 More Replies
ehpogue
by New Contributor III
  • 1733 Views
  • 0 replies
  • 0 kudos

Group by using a filter/parameter in SQL dashboard?

Hey all,I'm trying to build a SQL dashboard where the consumer can select a date range, but then can also select whether they want to see the results grouped by day/week/month over that timeframe. I think this is possible for a notebook dashboard by ...

Community Platform Discussions
dashboard
filters
parameters
sql
widgets
  • 1733 Views
  • 0 replies
  • 0 kudos
deficiant_codge
by Contributor II
  • 13735 Views
  • 5 replies
  • 8 kudos

How to run a different python version then the default one on databricks cluster

Hi All, I recently have a use case where i need to run something on the databricks cluster and the bare requirement is that python version shoulde be 3.8 and DBR version should be 11+. I am confused on how to handle this. Is there anyway in which we ...

  • 13735 Views
  • 5 replies
  • 8 kudos
Latest Reply
Anonymous
Not applicable
  • 8 kudos

Hi @deficiant_codge  Hope everything is going great. Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...

  • 8 kudos
4 More Replies
Benedetta
by New Contributor III
  • 2787 Views
  • 0 replies
  • 0 kudos

SQL Merge not adding new columns to delta table

SQL Merge not adding new columns to delta table error is: cannot resolve Target AuditUpdateDate in UPDATE clause given columns in Sourcethis config is set: spark.conf.set("spark.databricks.delta.schema.autoMerge.enabled",True)We're using DBR 12.2 LTS...

Benedetta_0-1689344912359.png
  • 2787 Views
  • 0 replies
  • 0 kudos
kll
by New Contributor III
  • 2238 Views
  • 4 replies
  • 1 kudos

SparkException: Job aborted due to stage failure when attempting to run grid_pointascellid

I am attempting to apply Mosaic's `grid_pointascellid` method on a spark dataframe with `lat`, `lon` columns.```import pyspark.sql.functions as F# Create a Spark DataFrame with a lat and lon columndf = spark.createDataFrame([("point1", 10.0, 20.0),("...

  • 2238 Views
  • 4 replies
  • 1 kudos
Latest Reply
Tharun-Kumar
Databricks Employee
  • 1 kudos

@kll This error appears because the function grid_pointascellid expects a Double type column and a Decimal column type was provided as input.To overcome this, before you apply the grid_pointascellid, I would recommend casting the columns lat and lon....

  • 1 kudos
3 More Replies
gilo12
by New Contributor III
  • 1911 Views
  • 2 replies
  • 2 kudos

Bug - Cannot create table The associated location is not empty and also not a Delta table.

I am getting the error:Cannot create table ('`hive_metastore`.`MY_SCHEMA`.`MY_TABLE`'). The associated location ('dbfs:/user/hive/warehouse/my_schema.db/my_table') is not empty and also not a Delta table.When running drop table 'hive_metastore`.`MY_S...

  • 1911 Views
  • 2 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hi @gilo12  Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your ...

  • 2 kudos
1 More Replies
joao_vnb
by New Contributor III
  • 7811 Views
  • 3 replies
  • 0 kudos

Give permissions to add comments on data explorer

Hi everyone!I'm facing this issue on databricks workspace.I do have permissions to add comments on data explorer, but some members of my team don't have those permissions.Where can I configure this and give them permission? 

joao_vnb_1-1689087557966.png
  • 7811 Views
  • 3 replies
  • 0 kudos
Latest Reply
Prabakar
Databricks Employee
  • 0 kudos

To grant the permissions on the same page that you have shared, click the permissions tab, and select grant.then from the dropdown list select the user or group and give the respective permissions. 

  • 0 kudos
2 More Replies
databricks2k6
by New Contributor II
  • 1537 Views
  • 2 replies
  • 0 kudos

community edition

community edition is available?I tried to login but it is redirecting me differnt pages.

  • 1537 Views
  • 2 replies
  • 0 kudos
Latest Reply
databricks2k6
New Contributor II
  • 0 kudos

Hi ,Please note that community and  is completely fiffernt objectives but you are refering community for disscussion foroum.Unlike the Databricks Free Trial, Community Edition doesn’t require that you have your own cloud account or supply cloud compu...

  • 0 kudos
1 More Replies
ManishaSethi
by New Contributor
  • 1367 Views
  • 2 replies
  • 0 kudos

Generative AI Badge not received ID: E-1K6NE1

Passed the test with 90%. , nothing gets reflected under badge section at databricks portal or credentials.databricks.com.Request support in getting the badge.

  • 1367 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @ManishaSethi , Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...

  • 0 kudos
1 More Replies
Paolo
by New Contributor
  • 923 Views
  • 0 replies
  • 0 kudos

Bug - task retry fails to load cluster dependencies

Hi,I'm currently facing an issue with task retries on a structured streaming set to have unlimited retries. Our job crashes frequently due to out of memory problems, so we set the task retry limit to -1  (unlimited) as a workaround. This is also the ...

Community Platform Discussions
Bug
Cluster initialization
Dependency
structured streaming
  • 923 Views
  • 0 replies
  • 0 kudos
nikhil018
by New Contributor II
  • 747 Views
  • 0 replies
  • 1 kudos

Databricks Exam got suspended

Hi,I attended Databricks certified associate developer for apache spark 3.0- scala on 09 July 2023(today). At 7.35pm suddenly got a notice stating that due to eye movement away from exam your exam got suspended.I had completed the exam and was at the...

  • 747 Views
  • 0 replies
  • 1 kudos
kll
by New Contributor III
  • 645 Views
  • 0 replies
  • 0 kudos

Mosaic's grid_boundary method returns inconsistent geometries

I am applying mosaic's `grid_boundary` method on a spark DataFrame containing a set of `h3_hex_ids`. The geometries returned are not consistent. i.e they could be either `lat, long` or `long, lat`.Here's a sample data```import pyspark.sql.functions a...

Community Platform Discussions
data engineering
mosaic
  • 645 Views
  • 0 replies
  • 0 kudos
creev
by New Contributor III
  • 2335 Views
  • 2 replies
  • 0 kudos

Resolved! Library and Driver issues following Databricks outage on 05.07.2023 (Azure)

Hi All,Yesterday (05.07.2023) databricks experienced a near total outage in the West and North Europe regions. It took the full working day, but they posted an update in the late afternoonstating that a workaround has been put in place and service is...

Community Platform Discussions
azure
Databricks
driver
library
Outage
  • 2335 Views
  • 2 replies
  • 0 kudos
Latest Reply
creev
New Contributor III
  • 0 kudos

Dear All, I have resolved the issue by re-installing all libraries and drivers. The reason the drivers were causing me iussues was because my runtime version was updated, and I had no idea. This is probably ehat caused all the issues in the first pla...

  • 0 kudos
1 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors