cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Rajaniesh
by New Contributor III
  • 28290 Views
  • 6 replies
  • 0 kudos

Error "Root storage credential for metastore does not exist"While creating the Databricks Volume in

Hi, I tried to create the databricks volume in unity catalog but it threw this error:Root storage credential for metastore XXXXXX does not exist. Please contact your Databricks representative or consider updating the metastore with a valid storage cr...

  • 28290 Views
  • 6 replies
  • 0 kudos
Latest Reply
KrzysztofPrzyso
New Contributor III
  • 0 kudos

I had a similar issue, that was resolved by assigning storage credential to the metastore using REST API call.- make sure that you are metastore or account admin- make sure that the storage credential is correctly configured, its access corrector ide...

  • 0 kudos
5 More Replies
Juanitoc10
by New Contributor II
  • 972 Views
  • 0 replies
  • 0 kudos

DBFS problem

Hi All, When trying to get to my DBFS in Databricks comunity edition I get the next errorI have already disabled and Enabled de DBFS file browser but it did not help

imagen.png
  • 972 Views
  • 0 replies
  • 0 kudos
danmlopsmaz
by New Contributor III
  • 2525 Views
  • 1 replies
  • 0 kudos

Issue with VSCode Extension and Databricks Cluster Using Docker Image

I've encountered a significant issue while using the VSCode extension for Databricks, particularly when working with a cluster configured with a Docker image. Here's a detailed description of the problem:Problem DescriptionWhen attempting to upload a...

danmlopsmaz_0-1721482196211.png danmlopsmaz_1-1721482508346.png
  • 2525 Views
  • 1 replies
  • 0 kudos
Latest Reply
danmlopsmaz
New Contributor III
  • 0 kudos

Hi @Retired_mod thanks for a such quick response.Actually, I am using the Dockerfile from the Databricks runtime example here: https://github.com/databricks/containers/blob/master/ubuntu/minimal/Dockerfile . The configuration with the VSCode extensio...

  • 0 kudos
sambgp
by New Contributor
  • 2168 Views
  • 2 replies
  • 0 kudos

RDD Issue in Unity Catalog

 ################################################ New Code as per UC ################################################ def parse_json(df, *cols, clean=True        res = df    for i in cols:           if clean:            res = (                res.wit...

  • 2168 Views
  • 2 replies
  • 0 kudos
Latest Reply
RishabhTiwari07
Databricks Employee
  • 0 kudos

Hi @sambgp , Thank you for reaching out to our community! We're here to help you.  To ensure we provide you with the best support, could you please take a moment to review the response and choose the one that best answers your question? Your feedback...

  • 0 kudos
1 More Replies
Krishna2110
by New Contributor II
  • 2587 Views
  • 4 replies
  • 2 kudos

Databricks All Delta Tables Data Read

If we want to read all the data of the databricks tables at single time how can we able to do it.

  • 2587 Views
  • 4 replies
  • 2 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 2 kudos

Hi @Krishna2110 ,Here it is, it should work now tables = spark.sql("SHOW TABLES IN ewt_edp_prod.crm_raw").collect() for row in tables: table_name = f"ewt_edp_prod.{row[0]}.{row[1]}" try: df = spark.table(table_name) count = df...

  • 2 kudos
3 More Replies
Dp15
by Contributor
  • 6133 Views
  • 2 replies
  • 2 kudos

Resolved! Convert Date String to Date type Returning null

Hi,I am using Databricks SQL and I am converting a integer field which is of format ('20240719' or 'yyyyMMdd'),now I am able to convert it to date type using to_date(forecastedHorizonPeriodDate,'yyyyMMdd')I then tried to change the format of this dat...

  • 6133 Views
  • 2 replies
  • 2 kudos
Latest Reply
Dp15
Contributor
  • 2 kudos

Hey @szymon_dybczak Thank you for your answer

  • 2 kudos
1 More Replies
virendra1212
by New Contributor
  • 4447 Views
  • 1 replies
  • 0 kudos

Login issue

Hi,Getting below error message.We were not able to find a Community Edition workspace with this email. Please login to non-community-edition workspaces you may have access to.

  • 4447 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @virendra1212 ,Take a look at below thread. Maybe some of the suggestions will help in your case.Community Edition Login Issues Below is a list of ... - Page 4 - Databricks Community - 26926You signed up before May 14, 2022 -Please confirm that th...

  • 0 kudos
payalbhatia
by New Contributor II
  • 902 Views
  • 0 replies
  • 0 kudos

Shuffle Partitions

What if I have lot of empty shuffled partitions due to data skewness Secondly , if the shuffle partition size is 128 MB and if the size of the key's partition is 700 MB 

  • 902 Views
  • 0 replies
  • 0 kudos
Junda
by New Contributor III
  • 2201 Views
  • 3 replies
  • 4 kudos

The way to visualize logging of Spark Job graphically

Is there any way to visualize logging such as execution runtime or memory usage of Spark Job graphically just like the image below by utilizing Databricks Partner Connect for free?Also, I'd appreciate to know any other ways to visualize the logging o...

  • 2201 Views
  • 3 replies
  • 4 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 4 kudos

Pleasure to help

  • 4 kudos
2 More Replies
Leon_K
by New Contributor II
  • 5139 Views
  • 1 replies
  • 0 kudos

How to Add value to Comment Column in Databricks Catalog View for Foreign table (Azure SQL)

Hi.Struggling to add description by script to the comment column within the catalog view in Databricks, particularly for foreign/external tables sourced from Azure SQL.I have no issue doing that for delta tables. Also for information schema columns f...

  • 5139 Views
  • 1 replies
  • 0 kudos
Latest Reply
Leon_K
New Contributor II
  • 0 kudos

@Retired_mod Sorry, I did read this way back but forgot to reply.Thanks for information.And all those steps I found as well and for "3. Programmatic Approach (For Azure SQL)" if you are adding to sql any description that way I don't think it will app...

  • 0 kudos
samlexrod
by New Contributor III
  • 3710 Views
  • 2 replies
  • 0 kudos

Resolved! DLT Online Table with VNnet Enable on Blob Storage Get 403 Issue

I am trying to create an online table in a Unity catalog. However, I get a GET, 403 error.  DataPlaneException: Failed to start the DLT service on cluster . Please check the stack trace below or driver logs for more details. com.databricks.pipelines....

  • 3710 Views
  • 2 replies
  • 0 kudos
Latest Reply
samlexrod
New Contributor III
  • 0 kudos

I figured it out. It was because of the Network Connectivity Configurations. I did not have one setup with a private endpoint connection to the ADLS Gen2.  I followed the instructions here: https://learn.microsoft.com/en-us/azure/databricks/security/...

  • 0 kudos
1 More Replies
Arch_dbxlearner
by New Contributor III
  • 12253 Views
  • 8 replies
  • 3 kudos

What are the different ways to pull the log data from Splunk to Databricks?

Hi,I have recently started Splunk Integration with Databricks. Basically I am trying to ingest the data from Splunk to Databricks. I have gone through the documentation regarding Splunk Integration. There are some basic information about the integrat...

  • 12253 Views
  • 8 replies
  • 3 kudos
Latest Reply
SainnathReddy_M
New Contributor II
  • 3 kudos

Hi @Arch_dbxlearner Did you done integration with splunk if yes can you please help 

  • 3 kudos
7 More Replies
programmatix
by New Contributor II
  • 883 Views
  • 1 replies
  • 1 kudos

"No API found for 'POST /workspace-files" error while trying to upload a JAR

Hi,I'm using CE and trying to upload a JAR library of about 45MB into my workspace so I can use it from Pyspark, but getting error "No API found for 'POST /workspace-files".  Any thoughts?  

programmatix_0-1721397408902.png
  • 883 Views
  • 1 replies
  • 1 kudos
Latest Reply
programmatix
New Contributor II
  • 1 kudos

N.b. in the console output I have this: 

  • 1 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels