cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
Engage in vibrant discussions covering diverse learning topics within the Databricks Community. Explore learning resources, share insights, and collaborate with peers to enhance your skills in data engineering, machine learning, and more.
cancel
Showing results for 
Search instead for 
Did you mean: 

Browse the Community

Certifications

Join dynamic discussions on Databricks certifications within the Community. Exchange insights, tips,...

853 Posts

Training offerings

Explore discussions on Databricks training programs and offerings within the Community. Get insights...

192 Posts

Get Started Discussions

Start your journey with Databricks by joining discussions on getting started guides, tutorials, and ...

2680 Posts

Activity in Community Discussions

jadhav_vikas
by > New Contributor II
  • 193 Views
  • 5 replies
  • 2 kudos

#data bricks snowflake dialect

Hello,I’m encountering an issue while converting SQL code to the Lake bridge Snowflake dialect. It seems that DML and DDL statements may not be supported in the Snowflake dialect within Lake bridge.Could you please confirm whether DML and DDL stateme...

  • 193 Views
  • 5 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

@jadhav_vikas , I did some digging through internal docs and I have some hints/suggestions. Short answer Databricks Lakehouse Federation (often referred to as “Lakehouse Bridge”) provides read‑only access to Snowflake; DML and DDL are not supported ...

  • 2 kudos
4 More Replies
Sam11
by > Visitor
  • 21 Views
  • 2 replies
  • 0 kudos

Didn't Receive Databricks Gen AI Certificate

Hi Team,I've successfully passed the Databricks Gen AI Engineer Associate Certified exam, but I still have not received the certificate.Databricks Certified Data Engineer Associate on 9th November 2025.Result: PASSCongratulations! You've passed the e...

  • 21 Views
  • 2 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Hey @Sam11 , please open a ticket and the certification team will address the issue. https://help.databricks.com/s/contact-us?ReqType=training   Cheers, Louis.

  • 0 kudos
1 More Replies
Bhanu_Anandesi
by > New Contributor III
  • 2491 Views
  • 4 replies
  • 1 kudos

Resolved! Not received my certificate after passing Data Engineer Associate exam.

I've successfully passed Databricks Data Engineer Associate Certified exam but still have not received the certificate.Hello Bhanupriya,You have completed the assessment, Databricks Certified Data Engineer Associate on 31 July 2024.Result: PASS Congr...

  • 2491 Views
  • 4 replies
  • 1 kudos
Latest Reply
Sam11
Visitor
  • 1 kudos

Hi,I would like to know if this issue was resolved asap. 

  • 1 kudos
3 More Replies
zibi
by > New Contributor
  • 88 Views
  • 3 replies
  • 0 kudos

Resolved! API call fails to initiate create Service Principal secret

Hi,I've constructed an AWS lambda function which is used to auto rotate my Service Principal Secret in the Databricks account. Authentication is setup with OAuth2, the api call for the token generation is successful but when executing the api call to...

  • 88 Views
  • 3 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

Your error message, "Invalid service principal id," typically indicates a mismatch or formatting problem with the service principal's unique identifier in your API request. Although you checked the client_id, this value is not always the one needed f...

  • 0 kudos
2 More Replies
kennyhsieh
by > New Contributor II
  • 730 Views
  • 1 replies
  • 1 kudos

Databricks Taiwan User Community

Would be great have a group for databricks Taiwan community.

  • 730 Views
  • 1 replies
  • 1 kudos
Latest Reply
wutxdata
Databricks Employee
  • 1 kudos

Hey @kennyhsieh , hope it's not too late to reply to the post! A "Databricks User Group Taiwan" has recently been formed on LinkedIn.

  • 1 kudos
spd_dat
by > New Contributor III
  • 3516 Views
  • 2 replies
  • 0 kudos

Can AWS workspaces share subnets?

The docs state:"You can choose to share one subnet across multiple workspaces or both subnets across workspaces."as well as:"You can reuse existing security groups rather than create new ones."and on this page:"If you plan to share a VPC and subnets ...

  • 3516 Views
  • 2 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

AWS WorkSpaces can be configured with subnets that can be shared within an AWS account or across AWS accounts using resource sharing mechanisms, but this depends on the specific AWS service and context. For Databricks workspaces on AWS, documentation...

  • 0 kudos
1 More Replies
Abishrp
by > Contributor
  • 477 Views
  • 1 replies
  • 0 kudos

Contract or Free trial discounts in System table

Hi,I am unable to find the contracted pricing or free trial data for Databricks DBU in system table. Can I get the discounted pricing based on All Purpose, Job Compute etc..

  • 477 Views
  • 1 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

Discounted pricing for Databricks DBU is available when you commit to usage for 1 or 3 years—a model called Databricks Commit Units (DBCUs). Discounts can reach up to 37% off pay-as-you-go rates depending on your commitment.​ DBU Discounted Rates by ...

  • 0 kudos
mancosta
by > New Contributor
  • 2857 Views
  • 1 replies
  • 0 kudos

Joblib with optuna and SB3

Hi everyone,I am training some reinforcement learning models and I am trying to automate the hyperparameter search using optuna. I saw in the documentation that you can use joblib with spark as a backend to train in paralel. I got that working with t...

  • 2857 Views
  • 1 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

Stable Baselines 3 (SB3) models can be optimized with Optuna for hyperparameter search, but parallelizing these searches using Joblib with Spark as the backend—like the classic scikit-learn example—commonly encounters issues. The root problem is that...

  • 0 kudos
December
by > New Contributor II
  • 3036 Views
  • 1 replies
  • 0 kudos

NiFi on EKS Fails to Connect to Databricks via JDBC – "Connection reset" Error

I'm using Apache Nifi (running on AWS EKS) to connect to Databricks (with compute on EC2) via JDBC. My JDBC URL is as follows: jdbc:databricks://server_hostname:443/default;transportMode=http;ssl=1;httpPath=my_httppath;AuthMech=3;UID=token;PWD=my_tok...

December_1-1741684901117.png
Get Started Discussions
Connection
JDBC
  • 3036 Views
  • 1 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

A "Connection reset" error in NiFi when connecting to Databricks via JDBC, despite successful telnet and working connectivity from DBeaver, usually points to subtle protocol or compatibility issues rather than network-level blocks.​ Common Causes JD...

  • 0 kudos
HuyNguyen
by > New Contributor
  • 3285 Views
  • 1 replies
  • 0 kudos

.py script execution failed but succeeded when run in Python notebook

Background:My code executing without problem if run in a python notebook. However, the same code fails when execute from a .py script in the workspace. Seems like the 2 execution methods don't have identical version of the packagesError message: Attr...

  • 3285 Views
  • 1 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

The error "AttributeError: 'DeltaMergeBuilder' object has no attribute 'withSchemaEvolution'" when running the same code from a .py script but not in a Python notebook is likely caused by a mismatch in the Delta Lake or Databricks Runtime versions or...

  • 0 kudos
shiv_DB25
by > New Contributor II
  • 3700 Views
  • 2 replies
  • 0 kudos

Getting error while installing applicationinsights

Library installation attempted on the driver node of cluster 0210-115502-3lo6gkwd and failed. Pip could not find a version that satisfies the requirement for the library. Please check your library version and dependencies. Error code: ERROR_NO_MATCHI...

  • 3700 Views
  • 2 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

The error indicates that Databricks could not install the applicationinsights or azure-identity libraries because pip could not find a matching distribution, and network connection attempts to the PyPI repository were repeatedly reset. This is common...

  • 0 kudos
1 More Replies
Superstar_Singh
by > Visitor
  • 67 Views
  • 1 replies
  • 0 kudos

Databricks Roadmap 13/11/2025

Can you provide me with a link to the recording that happened today:Databricks Product Roadmap Webinar, Thursday, November 13, 2025, 9:00 AM–10:00 AM GMT

  • 67 Views
  • 1 replies
  • 0 kudos
Latest Reply
KaushalVachhani
Databricks Employee
  • 0 kudos

@Superstar_Singh , Is this the one you are asking about? https://www.databricks.com/resources/webinar/productroadmapwebinar

  • 0 kudos
DataBeli
by > New Contributor
  • 62 Views
  • 2 replies
  • 0 kudos

Not able to create pubic link for databricks web app

I have created a web app in databricks.the rule for hackathon says the ink to working demo shall be provided for judges. The databricks webapp  or any other databricks artificate can not be made publicly accessible as per my knowledge. Also we can no...

DataBeli_0-1762863320258.png
  • 62 Views
  • 2 replies
  • 0 kudos
Latest Reply
SP_6721
Honored Contributor
  • 0 kudos

Hi @DataBeli ,From what I understand, in the Free Edition, Databricks Apps can only be shared with authenticated Databricks users. As public or anonymous access isn’t supported, you can try adding the judges’ email addresses to your workspace and the...

  • 0 kudos
1 More Replies
Suheb
by > New Contributor II
  • 39 Views
  • 4 replies
  • 1 kudos

When working with large data sets in Databricks, what are best practices to avoid memory out-of-memo

How can I optimize Databricks to handle large datasets without running into memory or performance problems?

  • 39 Views
  • 4 replies
  • 1 kudos
Latest Reply
tarunnagar
New Contributor III
  • 1 kudos

Hey! Great question — I’ve run into this issue quite a few times while working with large datasets in Databricks, and out-of-memory errors can be a real headache. One of the biggest things that helps is making sure your cluster configuration matches ...

  • 1 kudos
3 More Replies
jay-cunningham
by > New Contributor
  • 3200 Views
  • 1 replies
  • 0 kudos

Is there a way to prevent databricks-connect from installing a global IPython Spark startup script?

I'm currently using databricks-connect through VS Code on MacOS. However, this seems to install (and re-install upon deletion) an IPython startup script which initializes a SparkSession. This is fine as far as it goes, except that this script is *glo...

  • 3200 Views
  • 1 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

Databricks Connect on MacOS (and some other platforms) adds a file to the global IPython startup folder, which causes every new IPython session—including those outside the Databricks environment—to attempt loading this SparkSession initialization. Th...

  • 0 kudos