cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

jq2024
by New Contributor II
  • 406 Views
  • 2 replies
  • 1 kudos

Resolved! I cannot curl a URL in a notebook

I tried to curl the following url in a notebook %sh curl https://staging-api.newrelic.com/graphql -v  But I got the following error message { [5 bytes data] * TLSv1.2 (OUT), TLS header, Supplemental data (23): } [5 bytes data] * TLSv1.2 (IN), TLS he...

  • 406 Views
  • 2 replies
  • 1 kudos
Latest Reply
jq2024
New Contributor II
  • 1 kudos

Thank you for the suggestion. It works

  • 1 kudos
1 More Replies
brady_tyson
by New Contributor
  • 75 Views
  • 0 replies
  • 0 kudos

Databricks Connect Vscode. Cannot find package installed on cluster

I am using Databricks Connect v2 to connect to a UC enabled cluster. I have a package I have made and installed in a wheel file on the cluster.  When using vscode to import the package and use it I get a module not found error when running cell by ce...

Community Platform Discussions
databricks-connect
package
python
VSCode
  • 75 Views
  • 0 replies
  • 0 kudos
Kushal12345
by New Contributor III
  • 13365 Views
  • 24 replies
  • 2 kudos

Resolved! DataBricks Certification Exam Got Suspended. Require support for the same.

Hello Team, I encountered Pathetic experience while attempting my 1st DataBricks certification. Abruptly, Proctor asked me to show my desk, after showing he/she asked multiple times.. wasted my time and then suspended my exam, saying I have exceeded ...

  • 13365 Views
  • 24 replies
  • 2 kudos
Latest Reply
Cert-Team
Esteemed Contributor
  • 2 kudos

@narayana_r I'm sorry to hear your exam was suspended. Thank you for filing a ticket with our support team. Please allow the support team 24-48 hours for a resolution. In the meantime, you can review the following documentation:Room requirementsBehav...

  • 2 kudos
23 More Replies
manupmanoos
by New Contributor III
  • 1952 Views
  • 5 replies
  • 1 kudos

How to save the best model checkpoi through the epochs of a deep learning network through callbacks?

I have create a neural network and I am training the model with the code as below.  The code fails to write to the databricks file storage. is there any other way to write the checkpoint to databricks storage or to an s3 bucket directly?custom_early_...

  • 1952 Views
  • 5 replies
  • 1 kudos
Latest Reply
MeakhMalik
New Contributor
  • 1 kudos

There is a great website named (networthio.com) You can get all the information about celebrities. Just click on this link and dive in the worlds of celebrities. 

  • 1 kudos
4 More Replies
reggie
by New Contributor II
  • 220 Views
  • 3 replies
  • 0 kudos

Resolved! Issue enabling mosaic

Hi,I am trying to install mosaic on my cluster, but get the error once I use 'enable_mosaic': ImportError: cannot import name '_to_java_column' from 'pyspark.sql.functions' (/databricks/spark/python/pyspark/sql/functions/__init__.py) File <command-14...

  • 220 Views
  • 3 replies
  • 0 kudos
Latest Reply
reggie
New Contributor II
  • 0 kudos

Thank you, I thought mosaic requires a DBR at least 13.x since I didn't get a version error, but this fixed my problem  

  • 0 kudos
2 More Replies
Reply_Domenico
by New Contributor II
  • 364 Views
  • 2 replies
  • 1 kudos

Resolved! UCX code migration

Hello Databricks Community,I’m currently in the process of migrating our codebase to Unity Catalog using UCX and would appreciate some advice. Our environment has a mix of jobs and tables running on both Unity Catalog and hive_metastore.After running...

  • 364 Views
  • 2 replies
  • 1 kudos
Latest Reply
Brahmareddy
Contributor III
  • 1 kudos

Hi @Reply_Domenico, How are you dong today?To filter jobs, try adjusting the UCX assessment query or use a script to exclude jobs already on Unity Catalog. Unfortunately, UCX doesn't yet have specific commands for automating code migration to Unity C...

  • 1 kudos
1 More Replies
EirikMa
by New Contributor II
  • 1668 Views
  • 3 replies
  • 0 kudos

UTF-8 troubles in DLT

Issues with UTF-8 in DLTI am having issues with UTF-8 in DLT:I have tried to set the spark config on the cluster running the DLT pipeline:  I have fixed this with normal compute under advanced settings like this:spark.conf.set("spark.driver.extraJava...

EirikMa_0-1711360526822.png EirikMa_1-1711361452104.png
  • 1668 Views
  • 3 replies
  • 0 kudos
Latest Reply
EirikMA1
New Contributor II
  • 0 kudos

@Kaniz_Fatma Hi, DLT has updated its runtime but I get a different error now:this is my code: 

  • 0 kudos
2 More Replies
Meghana_Vasavad
by New Contributor III
  • 207 Views
  • 1 replies
  • 0 kudos

Assistance Required for Enabling Unity Catalog in Databricks Workspace

Hi,I hope this message finds you well.I am reaching out regarding a concern with Databricks Administrator privileges. I have an Azure subscription and I use Azure Databricks for my tutorials, but I currently do not have Global Administrator access, w...

  • 207 Views
  • 1 replies
  • 0 kudos
Latest Reply
Slash
Contributor
  • 0 kudos

Hi @Meghana_Vasavad ,During initial setup of unity catalog you need to find a person with global administrator role of Entra ID tenant. It's one time action, because then he can give necessary permission to manage catalog to your account, or even bet...

  • 0 kudos
thibault
by Contributor II
  • 4568 Views
  • 7 replies
  • 0 kudos

Asset Bundles git branch per target

Hi,I am migrating from dbx to Databricks Asset Bundles (DAB) a deployment setup where I have specific parameters per environment. This was working well with dbx, and I am trying now to define those parameters defining targets (3 targets : dev, uat, p...

  • 4568 Views
  • 7 replies
  • 0 kudos
Latest Reply
thibault
Contributor II
  • 0 kudos

Something must have changed in the meantime on Databricks side. I have only updated databricks CLI to 016 and now, using a git / branch under each target deploys this setup, where feature-dab is the branch I want the job to pull sources from, I see t...

  • 0 kudos
6 More Replies
sanjay
by Valued Contributor II
  • 431 Views
  • 5 replies
  • 0 kudos

Resolved! maxFilesPerTrigger not working while loading data from Unity Catalogue table

Hi,I am using streaming on unity catalogue tables and trying to limit the number of records read in each batch. Here is my code but its not respecting maxFilesPerTrigger, instead reads all available data. (spark.readStream.option("skipChangeCommits",...

  • 431 Views
  • 5 replies
  • 0 kudos
Latest Reply
Witold
Contributor
  • 0 kudos

I believe you misunderstand the fundamentals of delta tables. `maxFilesPerTrigger` has nothing to do with how many rows you will process at the same time. And if you really want to control the number of records per file, then you need to adapt the wr...

  • 0 kudos
4 More Replies
Henrik
by New Contributor III
  • 407 Views
  • 1 replies
  • 1 kudos

Resolved! Serving pay-per-token Chat LLM Model

We have build a chat solution on LLM RAG chat model, but we face an issue when we spin up a service endpoint to host the model.According to the documentation, there should be sevral LLM models available as pay-per-token endpoints, for instance the DB...

  • 407 Views
  • 1 replies
  • 1 kudos
Latest Reply
daniel_sahal
Esteemed Contributor
  • 1 kudos

@Henrik The documentation clearly states that it should be available in west europe, but i'm also unable to see DBRX ppt endpoint. I think that it would be best to raise an Azure Support ticket - they should either somehow enable it on your workspace...

  • 1 kudos
NelsonE
by New Contributor II
  • 167 Views
  • 1 replies
  • 0 kudos

Databricks repo not working with installed python libraries

Hello,I'm trying to use some installed libraries in my cluster.I created a single node cluster with the version Runtime version 14.3 LTS.I also installed libraries like oracledb==2.2.1Then when I try to use python to load this libraries in the worksp...

  • 167 Views
  • 1 replies
  • 0 kudos
Latest Reply
Brahmareddy
Contributor III
  • 0 kudos

Hello Nelson, How are you dong today?Try checking the permissions on your repo folder to ensure your cluster can access it without issues. Use absolute paths when running from your GitHub repo to avoid directory confusion. Reinstall the oracledb libr...

  • 0 kudos
unity_Catalog
by New Contributor III
  • 190 Views
  • 1 replies
  • 0 kudos

Concurrent installation of UCX in multiple workspaces

I am trying to install UCX in multiple workspaces concurrently through bash script but facing issue continuously. I have created separate directories for each workspace. I'm facing the below error everytime.Installing UCX in Workspace1Error: lib: cle...

  • 190 Views
  • 1 replies
  • 0 kudos
Latest Reply
Brahmareddy
Contributor III
  • 0 kudos

Hi @unity_Catalog, How are you dong today?Try running the UCX installations sequentially to avoid file access conflicts, adding a small delay between each. Ensure each workspace uses a separate installation directory to prevent overlap. You could als...

  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors