cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Pika
by New Contributor II
  • 70 Views
  • 2 replies
  • 1 kudos

Databricks Certified Data Engineer Associate - Suspended

Hello Team,My Databricks exam was scheduled for 4:00 pm IST on 21st July. I was giving my exam peacefully and was focused on the screen all the time. I was done with almost all question and the moment I started reviewing few questions which were mark...

  • 70 Views
  • 2 replies
  • 1 kudos
Latest Reply
Pika
New Contributor II
  • 1 kudos

@Kaniz_Fatma  it's been more than 48 hours now and I have not received any communication regarding this .Kindly help me in rescheduling the exam as it is very important to finish soon.

  • 1 kudos
1 More Replies
Rajaniesh
by New Contributor III
  • 13118 Views
  • 6 replies
  • 0 kudos

Error "Root storage credential for metastore does not exist"While creating the Databricks Volume in

Hi, I tried to create the databricks volume in unity catalog but it threw this error:Root storage credential for metastore XXXXXX does not exist. Please contact your Databricks representative or consider updating the metastore with a valid storage cr...

  • 13118 Views
  • 6 replies
  • 0 kudos
Latest Reply
KrzysztofPrzyso
New Contributor III
  • 0 kudos

I had a similar issue, that was resolved by assigning storage credential to the metastore using REST API call.- make sure that you are metastore or account admin- make sure that the storage credential is correctly configured, its access corrector ide...

  • 0 kudos
5 More Replies
Juanitoc10
by New Contributor
  • 81 Views
  • 0 replies
  • 0 kudos

DBFS problem

Hi All, When trying to get to my DBFS in Databricks comunity edition I get the next errorI have already disabled and Enabled de DBFS file browser but it did not help

imagen.png
  • 81 Views
  • 0 replies
  • 0 kudos
danmlopsmaz
by New Contributor II
  • 131 Views
  • 2 replies
  • 1 kudos

Issue with VSCode Extension and Databricks Cluster Using Docker Image

I've encountered a significant issue while using the VSCode extension for Databricks, particularly when working with a cluster configured with a Docker image. Here's a detailed description of the problem:Problem DescriptionWhen attempting to upload a...

danmlopsmaz_0-1721482196211.png danmlopsmaz_1-1721482508346.png
  • 131 Views
  • 2 replies
  • 1 kudos
Latest Reply
danmlopsmaz
New Contributor II
  • 1 kudos

Hi @Kaniz_Fatma thanks for a such quick response.Actually, I am using the Dockerfile from the Databricks runtime example here: https://github.com/databricks/containers/blob/master/ubuntu/minimal/Dockerfile . The configuration with the VSCode extensio...

  • 1 kudos
1 More Replies
Marina_Shishkin
by New Contributor
  • 430 Views
  • 2 replies
  • 1 kudos

Databricks data engineer associate exam Suspended

@Cert-Team  @Certificate @Cert-Bricks Hi Team,Please help me, I have just been suspended from my above exam. At first I was told I was looking around too much even though I was genuinely looking at the screen only. I had completed all questions and w...

  • 430 Views
  • 2 replies
  • 1 kudos
Latest Reply
Marina_Shishkin
New Contributor
  • 1 kudos

I did also submit a ticket, request was #00505926

  • 1 kudos
1 More Replies
payalbhatia
by New Contributor
  • 187 Views
  • 1 replies
  • 0 kudos

Shuffle Partitions

What if I have lot of empty shuffled partitions due to data skewness Secondly , if the shuffle partition size is 128 MB and if the size of the key's partition is 700 MB 

  • 187 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @payalbhatia,  Empty Shuffled Partitions Due to Data Skewness Introduce a random “salt” value to the keys to distribute the data more evenly across partitions.Implement a custom partitioner that distributes the data more evenly based on your speci...

  • 0 kudos
sambgp
by New Contributor
  • 136 Views
  • 2 replies
  • 0 kudos

RDD Issue in Unity Catalog

 ################################################ New Code as per UC ################################################ def parse_json(df, *cols, clean=True        res = df    for i in cols:           if clean:            res = (                res.wit...

  • 136 Views
  • 2 replies
  • 0 kudos
Latest Reply
Rishabh_Tiwari
Community Manager
  • 0 kudos

Hi @sambgp , Thank you for reaching out to our community! We're here to help you.  To ensure we provide you with the best support, could you please take a moment to review the response and choose the one that best answers your question? Your feedback...

  • 0 kudos
1 More Replies
Krishna2110
by New Contributor II
  • 151 Views
  • 4 replies
  • 1 kudos

Databricks All Delta Tables Data Read

If we want to read all the data of the databricks tables at single time how can we able to do it.

  • 151 Views
  • 4 replies
  • 1 kudos
Latest Reply
Slash
New Contributor II
  • 1 kudos

Hi @Krishna2110 ,Here it is, it should work now tables = spark.sql("SHOW TABLES IN ewt_edp_prod.crm_raw").collect() for row in tables: table_name = f"ewt_edp_prod.{row[0]}.{row[1]}" try: df = spark.table(table_name) count = df...

  • 1 kudos
3 More Replies
Dp15
by Contributor
  • 129 Views
  • 2 replies
  • 2 kudos

Resolved! Convert Date String to Date type Returning null

Hi,I am using Databricks SQL and I am converting a integer field which is of format ('20240719' or 'yyyyMMdd'),now I am able to convert it to date type using to_date(forecastedHorizonPeriodDate,'yyyyMMdd')I then tried to change the format of this dat...

  • 129 Views
  • 2 replies
  • 2 kudos
Latest Reply
Dp15
Contributor
  • 2 kudos

Hey @Slash Thank you for your answer

  • 2 kudos
1 More Replies
virendra1212
by New Contributor
  • 71 Views
  • 1 replies
  • 0 kudos

Login issue

Hi,Getting below error message.We were not able to find a Community Edition workspace with this email. Please login to non-community-edition workspaces you may have access to.

  • 71 Views
  • 1 replies
  • 0 kudos
Latest Reply
Slash
New Contributor II
  • 0 kudos

Hi @virendra1212 ,Take a look at below thread. Maybe some of the suggestions will help in your case.Community Edition Login Issues Below is a list of ... - Page 4 - Databricks Community - 26926You signed up before May 14, 2022 -Please confirm that th...

  • 0 kudos
comopag108
by New Contributor
  • 77 Views
  • 0 replies
  • 0 kudos

Lung Transplant In India | Cost | Hospital

Lung transplant in India may be a perplexing procedure so, people might ring 9711411424 to clarify their queries and gain more information about the whole concept like the success rate which may be classified as around 82-85%. Depending upon the cond...

  • 77 Views
  • 0 replies
  • 0 kudos
Junda
by New Contributor
  • 142 Views
  • 3 replies
  • 4 kudos

The way to visualize logging of Spark Job graphically

Is there any way to visualize logging such as execution runtime or memory usage of Spark Job graphically just like the image below by utilizing Databricks Partner Connect for free?Also, I'd appreciate to know any other ways to visualize the logging o...

  • 142 Views
  • 3 replies
  • 4 kudos
Latest Reply
Slash
New Contributor II
  • 4 kudos

Pleasure to help

  • 4 kudos
2 More Replies
Leon_K
by New Contributor II
  • 1386 Views
  • 2 replies
  • 0 kudos

How to Add value to Comment Column in Databricks Catalog View for Foreign table (Azure SQL)

Hi.Struggling to add description by script to the comment column within the catalog view in Databricks, particularly for foreign/external tables sourced from Azure SQL.I have no issue doing that for delta tables. Also for information schema columns f...

  • 1386 Views
  • 2 replies
  • 0 kudos
Latest Reply
Leon_K
New Contributor II
  • 0 kudos

@Kaniz_Fatma Sorry, I did read this way back but forgot to reply.Thanks for information.And all those steps I found as well and for "3. Programmatic Approach (For Azure SQL)" if you are adding to sql any description that way I don't think it will app...

  • 0 kudos
1 More Replies
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Top Kudoed Authors