cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
MaheshDR
by • New Contributor II
  • 2678 Views
  • 2 replies
  • 0 kudos

Informatica Cloud mapping with Databricks connection failing with java.util.NoSuchElementException

Hi Team,When we tried to configure our source with Databricks table with Databricks connection on Informatica Cloud, we received below error.We already tried the suggestions mentioned in the below community post which seems to be similar error as our...

Data Engineering
Reply
  • 2678 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Mahesh D​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!

  • 0 kudos
1 More Replies
IG1
by • New Contributor II
  • 2020 Views
  • 3 replies
  • 2 kudos

Why there's no "New Union" option with Databricks connection

I'm trying to use databricks connect with tableau but it doesn't give me the "New Union" option. Is this normal or it's particular to me? My tableau desktop version is 2021.3

Data Engineering
Reply
  • 2020 Views
  • 3 replies
  • 2 kudos
View Replies
Latest Reply
Aviral-Bhardwaj
Esteemed Contributor III
  • 2 kudos

there is option for connecting tableau find there SPARK SQL then it should work after adding proper connection string

  • 2 kudos
2 More Replies
kthneighbor
by • New Contributor II
  • 3408 Views
  • 5 replies
  • 2 kudos

Resolved! What will be the next LTS version after 10.4?

What will be the next LTS version after 10.4?

Data Engineering
Reply
  • 3408 Views
  • 5 replies
  • 2 kudos
View Replies
Latest Reply
youssefmrini
Databricks Employee
  • 2 kudos

Hello, 11.3 LTS is now available https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/11.3

  • 2 kudos
4 More Replies
RK_AV
by • New Contributor III
  • 2011 Views
  • 1 replies
  • 0 kudos

Databricks to Databricks connection

How do you connect to Azure Databricks instance from another Databricks instance?  I needed to access (database) Views created in a Databricks instance from a Pyspark notebook running in another Databricks instance.  Appreciate if anyone has any samp...

Data Engineering
Reply
  • 2011 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi there, @Venkata Ramakrishna Alvakonda​! My name is Piper, and I'm a moderator for the community. Thank you for your great question! Let's give the community a chance to respond first, and then we'll circle back around. If the community's response ...

  • 0 kudos
Axel_Schwanke
by • Contributor
  • 5274 Views
  • 7 replies
  • 3 kudos

Resolved! Issue with AWS Glue metacatalogue and DBR 9.1 ... 10.1

I have a simple SparkSQL Select statementoffers_df = (spark.sql(""" SELECT * FROM delta.`{}` """.format(TABLE_LOCATION)))It runs under DBR 9.0 and previous. When changing the DBR to 9.1 ...10.1 I get an exceptionorg.apache.spark.SparkException: Una...

Data Engineering
Reply
  • 5274 Views
  • 7 replies
  • 3 kudos
View Replies
Latest Reply
Axel_Schwanke
Contributor
  • 3 kudos

Retest in DBR 10.3 beta SUCCESSFUL.Problem does not occur in DBR 10.3 beta

  • 3 kudos
6 More Replies
brickster_2018
by • Databricks Employee
  • 1937 Views
  • 1 replies
  • 0 kudos

Resolved! How Can I update the DBR versions of all my jobs in one go?

I keep it a point to use the latest DBR versions for my workloads and mostly we leverage those new features. But I have 300 jobs on the Databricks workspace and updating the DBR versions for each job manually is difficult to do. Any quick hack

Data Engineering
Reply
  • 1937 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
brickster_2018
Databricks Employee
  • 0 kudos

Below code snippet can be helpful if you are using Databricks CLIfor jobid in `databricks jobs list | awk '{print $1}'`; do databricks jobs get --job-id $jobid | jq .settings > /tmp/jobs/$jobid.json; done sed -i 's/"spark_version": ".*"/"spark_ver...

  • 0 kudos
Labels