cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

ArvindDige
by New Contributor II
  • 714 Views
  • 0 replies
  • 0 kudos

Init_script in workspace

How can use init script stored in workspace which copies jar from storage account and put it inside /databricks/jars location. As said in init_script migration document, where your init scripts are “self-contained,” i.e., DO NOT reference other files...

  • 714 Views
  • 0 replies
  • 0 kudos
DMJ
by New Contributor
  • 913 Views
  • 0 replies
  • 0 kudos

com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: java.io.IOException:

I have been getting this error for the past few days while trying to create a table using parquet or csv options. The error is :IOException: s3a://AKIAJBRYNXGHORDHZB4A:a0BzE1bSegfydr3%2FGE3LSPM6uIV5A4hOUfpH8aFF@databricks-corp-training/common/online_...

  • 913 Views
  • 0 replies
  • 0 kudos
Ma2
by New Contributor III
  • 761 Views
  • 1 replies
  • 2 kudos

Havent receive databricks associate certification

HiI passed my Databricks data engineer associate exam on 28 jun 2024. I haven't recieved my Certification  even after 62 hours.Is any body facing the same issue?Tried to contacted databricks bt no response yet.Kindly help

  • 761 Views
  • 1 replies
  • 2 kudos
Latest Reply
pgoel10
New Contributor II
  • 2 kudos

Same for me as well, I took exam on 29th Jun and still didn't receive the Certificate.

  • 2 kudos
Shriyash
by New Contributor II
  • 1166 Views
  • 3 replies
  • 2 kudos

Error while writing dataframe to csv file.

Hi Folks, Need help to resolve an error. I'm getting a below error while writing a dataframe into a csv file and exporting that file.Error:py4j.protocol.Py4JJavaError: An error occurred while calling o53.save.: java.lang.UnsatisfiedLinkError: 'boolea...

  • 1166 Views
  • 3 replies
  • 2 kudos
Latest Reply
Witold
Honored Contributor
  • 2 kudos

Do I see it correctly that you're actually not using Databricks, but Spark, locally installed, instead? Your issue can have many different causes, like an incompatible Java version. In this case, I can only refer to the official docs.

  • 2 kudos
2 More Replies
sanjay
by Valued Contributor II
  • 716 Views
  • 1 replies
  • 0 kudos

Error while running Job sparkSession is null while trying to executeCollectResult

Hi,I have started getting following error while running jobs in databrick. It started failing since last few days. Recently I have migrated to unity catalogue, no other change was made recently. I am running on DBR 13.3 LTS. com.google.common.util.co...

  • 716 Views
  • 1 replies
  • 0 kudos
Latest Reply
Witold
Honored Contributor
  • 0 kudos

Although it won't be the root cause of your issue, one thing worth mentioning is that `.trigger(once=True)` is obsolete by now and was replaced by `availableNow=True`

  • 0 kudos
IvanK
by New Contributor III
  • 1483 Views
  • 3 replies
  • 1 kudos

ADF - Fails to run job in workspace in another subscription

 We are trying to run a Databricks job from ADF, but we keep getting the following error:Operation on target Run dbt job failed: {"error_code":"PERMISSION_DENIED","message":"User <adf-mi-prod-id> does not have Manage Run or Owner or Admin permissions...

  • 1483 Views
  • 3 replies
  • 1 kudos
Latest Reply
riquedan
New Contributor II
  • 1 kudos

I am seeing the error message above whenever job 123 is triggered by ADF, but I can't find any instances of this job running in Databricks. 

  • 1 kudos
2 More Replies
Praveen587
by New Contributor III
  • 1159 Views
  • 1 replies
  • 2 kudos

Unable to login to databricks community edition

Hi Team, I was not able to login to Databricks community edition It’s working fine for me yesterday when I used but today while logging in it’s directing to same login page after entering user name and password . Can someone please look into this iss...

  • 1159 Views
  • 1 replies
  • 2 kudos
Latest Reply
paltang
New Contributor II
  • 2 kudos

 Hi I have the same problem. I used CE for logging MLFlow experiments and now can't login into my account. Can you please look into it @Sujitha @Retired_mod?  

  • 2 kudos
parakh17
by New Contributor
  • 516 Views
  • 1 replies
  • 0 kudos

Hi I am trying to change datatype of DOB column from stringtype to DateType but getting issue

Hi I am trying to change datatype of DOB column from String type to DateType but getting issue"SparkUpgradeException: [] You may get a different result due to the upgrading to Spark >= 3.0: Caused by: DateTimeParseException: Text '7/8/1972' could not...

Screenshot 2024-06-30 at 6.50.42 PM.png Screenshot 2024-06-30 at 6.50.57 PM.png Screenshot 2024-06-30 at 6.51.01 PM.png
  • 516 Views
  • 1 replies
  • 0 kudos
Latest Reply
Witold
Honored Contributor
  • 0 kudos

It's because the format you're using it wrong. Use `'M/d/yyyy'` instead.

  • 0 kudos
SridharADB
by New Contributor II
  • 1483 Views
  • 2 replies
  • 1 kudos

Resolved! Cluster Termination Issue

Hi, I am new to ADB and started recently using this community edition. I created a cluster and it is terminating immediately when i use to connect.What I am missing or what i need do? kindly help me. 

SridharADB_0-1719551064801.png
  • 1483 Views
  • 2 replies
  • 1 kudos
Latest Reply
SridharADB
New Contributor II
  • 1 kudos

Hi Walter_C, thanks for your response. Your assumption is correct. Now I tried to create new Cluster whenever I start practice. Then no issues. 

  • 1 kudos
1 More Replies
BrandonCroom_
by New Contributor II
  • 657 Views
  • 1 replies
  • 1 kudos

Winston-Salem/Greensboro, NC User Group

Hi All! I'm looking to start at Databricks Usergroup in the Greensboro/Winston-Salem, NC area. Wanted to gauge interest to find others who would like to join.

  • 657 Views
  • 1 replies
  • 1 kudos
Latest Reply
CBrandon
New Contributor II
  • 1 kudos

Thank you for setting this up, Brandon!

  • 1 kudos
Jaron
by New Contributor III
  • 2379 Views
  • 4 replies
  • 0 kudos

Where the "Driver logs" are stored by default, and How much default space to store it.

Recently, when I was using databricks for deep learning I ran into an issue, i.e., after a certain amount of time of execution the cluster would break and restart. The logs are as below:The Event logs displayed "Metastore is down; Driver is up but is...

  • 2379 Views
  • 4 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

Hello Jaron, is it not possible for you to redirect the login to an ABFSS or S3 bucket?

  • 0 kudos
3 More Replies
sara-aliza
by New Contributor
  • 1007 Views
  • 0 replies
  • 0 kudos

Pystan3 with databricks runtime 13.3

I am getting a read-only error when running pystan3 build() in a UDF.I think the issue is related to the location that the code is being run from, which is read-only. I am looking to set a custom cache location inside the UDF. Based on this link  I a...

  • 1007 Views
  • 0 replies
  • 0 kudos
151640
by New Contributor III
  • 1418 Views
  • 1 replies
  • 0 kudos

Databricks JDBC driver attempting to pass access token (JWT) from an external IDP (OKTA)

Configured a Databricks workspace for SSO to an IDP (OKTA).Databricks JDBC driver 02.06.38.1068Attempting to connect to Databricks using a URL similar to following where access token is obtained from the IDP (OKTA). Using tool such as SQLSquirrel wit...

  • 1418 Views
  • 1 replies
  • 0 kudos
Latest Reply
151640
New Contributor III
  • 0 kudos

Yes, latest version 02.06.38.1068Would like to know if other persons have successfully passed access tokens from an external IDP via the driver.

  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors