cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

AK031
by New Contributor II
  • 592 Views
  • 0 replies
  • 1 kudos

How to display RunName as the source in job compute grid?

I’m using Databricks on GCP and currently facing an issue where I want the RunName of a job to be displayed as the source in the Job Compute Grid.Here’s what I’ve already done:I’ve included the RunName in the custom_tags section of my cluster JSON:Wh...

  • 592 Views
  • 0 replies
  • 1 kudos
phanisaisrir
by New Contributor
  • 1096 Views
  • 1 replies
  • 0 kudos

Accessing table in Unity Catalog

What is the preferred way of accessing a UC enabled SqlWarehouse table from Databricks Spark Cluster . My requirement is to fetch the data from a sqlwarehouse table using complex queries, transform it using Pyspark notebook and save the results.But t...

  • 1096 Views
  • 1 replies
  • 0 kudos
Latest Reply
filipniziol
Esteemed Contributor
  • 0 kudos

Hi @phanisaisrir ,Use spark sql. This is the native and most integrated way to interact with data within Databricks.

  • 0 kudos
MM4
by New Contributor II
  • 1790 Views
  • 2 replies
  • 1 kudos

"Data" is not available in the left hand side menu

Hi, "Data" is not showing up in the left hand side menu. I have attached the cluster to the notebook, pfa snapshot for the reference.Any idea, how can it be resolved ?  

MM4_0-1724877598621.png
  • 1790 Views
  • 2 replies
  • 1 kudos
Latest Reply
MM4
New Contributor II
  • 1 kudos

Thanks for the response @szymon_dybczak .Actually, I am having community edition. It seems data pane is unavailable for the community edition.

  • 1 kudos
1 More Replies
jq2024
by New Contributor II
  • 1982 Views
  • 2 replies
  • 1 kudos

Resolved! I cannot curl a URL in a notebook

I tried to curl the following url in a notebook %sh curl https://staging-api.newrelic.com/graphql -v  But I got the following error message { [5 bytes data] * TLSv1.2 (OUT), TLS header, Supplemental data (23): } [5 bytes data] * TLSv1.2 (IN), TLS he...

  • 1982 Views
  • 2 replies
  • 1 kudos
Latest Reply
jq2024
New Contributor II
  • 1 kudos

Thank you for the suggestion. It works

  • 1 kudos
1 More Replies
GabriemMuller
by New Contributor III
  • 4075 Views
  • 7 replies
  • 2 kudos

Trying to connect datrabricks with Mulesoft

Hi im trying to connect to Databricks using the mulesoft database connector, using databricks JDBC, I already connect using personal access token, but i need to use OAuth2 M2M, and only return a error 500151 Invalid local Address:org.mule.runtime.api...

  • 4075 Views
  • 7 replies
  • 2 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 2 kudos

Assuming you followed the guide (https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc/authentication#--oauth-machine-to-machine-m2m-authentication), is it possible your workspace uses private link?because that won't work.Also: only Da...

  • 2 kudos
6 More Replies
brady_tyson
by New Contributor
  • 1023 Views
  • 0 replies
  • 0 kudos

Databricks Connect Vscode. Cannot find package installed on cluster

I am using Databricks Connect v2 to connect to a UC enabled cluster. I have a package I have made and installed in a wheel file on the cluster.  When using vscode to import the package and use it I get a module not found error when running cell by ce...

Get Started Discussions
databricks-connect
package
python
VSCode
  • 1023 Views
  • 0 replies
  • 0 kudos
Christofferfn
by New Contributor II
  • 1637 Views
  • 0 replies
  • 0 kudos

Unable to move/merge a account from customer-academy to partner-academy

Hi,Last year I created a customer-academy account for learning purpose.New I need to move/merge my account to partner-academy using my company mail. The goal is to only have a partner-academy account where my primary mail will be my private email and...

  • 1637 Views
  • 0 replies
  • 0 kudos
Reply_Domenico
by New Contributor II
  • 1865 Views
  • 2 replies
  • 1 kudos

Resolved! UCX code migration

Hello Databricks Community,I’m currently in the process of migrating our codebase to Unity Catalog using UCX and would appreciate some advice. Our environment has a mix of jobs and tables running on both Unity Catalog and hive_metastore.After running...

  • 1865 Views
  • 2 replies
  • 1 kudos
Latest Reply
Brahmareddy
Esteemed Contributor
  • 1 kudos

Hi @Reply_Domenico, How are you dong today?To filter jobs, try adjusting the UCX assessment query or use a script to exclude jobs already on Unity Catalog. Unfortunately, UCX doesn't yet have specific commands for automating code migration to Unity C...

  • 1 kudos
1 More Replies
EirikMa
by New Contributor II
  • 3032 Views
  • 2 replies
  • 0 kudos

UTF-8 troubles in DLT

Issues with UTF-8 in DLTI am having issues with UTF-8 in DLT:I have tried to set the spark config on the cluster running the DLT pipeline:  I have fixed this with normal compute under advanced settings like this:spark.conf.set("spark.driver.extraJava...

EirikMa_0-1711360526822.png EirikMa_1-1711361452104.png
Get Started Discussions
data engineering
  • 3032 Views
  • 2 replies
  • 0 kudos
Latest Reply
EirikMA1
New Contributor II
  • 0 kudos

@Retired_mod Hi, DLT has updated its runtime but I get a different error now:this is my code: 

  • 0 kudos
1 More Replies
Meghana_Vasavad
by New Contributor III
  • 948 Views
  • 1 replies
  • 1 kudos

Assistance Required for Enabling Unity Catalog in Databricks Workspace

Hi,I hope this message finds you well.I am reaching out regarding a concern with Databricks Administrator privileges. I have an Azure subscription and I use Azure Databricks for my tutorials, but I currently do not have Global Administrator access, w...

  • 948 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @Meghana_Vasavad ,During initial setup of unity catalog you need to find a person with global administrator role of Entra ID tenant. It's one time action, because then he can give necessary permission to manage catalog to your account, or even bet...

  • 1 kudos
thibault
by Contributor III
  • 8268 Views
  • 6 replies
  • 0 kudos

Asset Bundles git branch per target

Hi,I am migrating from dbx to Databricks Asset Bundles (DAB) a deployment setup where I have specific parameters per environment. This was working well with dbx, and I am trying now to define those parameters defining targets (3 targets : dev, uat, p...

  • 8268 Views
  • 6 replies
  • 0 kudos
Latest Reply
thibault
Contributor III
  • 0 kudos

Something must have changed in the meantime on Databricks side. I have only updated databricks CLI to 016 and now, using a git / branch under each target deploys this setup, where feature-dab is the branch I want the job to pull sources from, I see t...

  • 0 kudos
5 More Replies
Phani1
by Valued Contributor II
  • 14239 Views
  • 1 replies
  • 0 kudos

RBAC

Hi Team,can provide you with step-by-step instructions on how to create role-based access and attribute-based access in Databricks.Regards,Phanindra

  • 14239 Views
  • 1 replies
  • 0 kudos
sanjay
by Valued Contributor II
  • 5984 Views
  • 5 replies
  • 0 kudos

Resolved! maxFilesPerTrigger not working while loading data from Unity Catalogue table

Hi,I am using streaming on unity catalogue tables and trying to limit the number of records read in each batch. Here is my code but its not respecting maxFilesPerTrigger, instead reads all available data. (spark.readStream.option("skipChangeCommits",...

  • 5984 Views
  • 5 replies
  • 0 kudos
Latest Reply
Witold
Honored Contributor
  • 0 kudos

I believe you misunderstand the fundamentals of delta tables. `maxFilesPerTrigger` has nothing to do with how many rows you will process at the same time. And if you really want to control the number of records per file, then you need to adapt the wr...

  • 0 kudos
4 More Replies

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels