cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Skv
by New Contributor II
  • 1347 Views
  • 1 replies
  • 0 kudos

Snowflake filter Query giving empty results in Databricks, same query working in Snowflake.

I am trying to fetch filter data based on date format on a date column. Below is the query forming in Databricks. In Databricks giving empty results.SELECT * FROM Test.TestSchema.Address where TO_DATE(TO_VARCHAR(MODIFIEDDATE,'YYYY-MM-DD')) = '2023-09...

  • 1347 Views
  • 1 replies
  • 0 kudos
Paulv14
by New Contributor
  • 828 Views
  • 1 replies
  • 0 kudos

Sql warehouse setting permission

How do you set permission to just execute a query but cannot modify settings on the sql warehouse

  • 828 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, Have you tried this: https://docs.databricks.com/en/security/auth-authz/access-control/sql-endpoint-acl.html Please let us know if this helps.  Thanks!

  • 0 kudos
botn
by New Contributor
  • 1733 Views
  • 1 replies
  • 0 kudos

Resolved! Structured streaming from Azure Event Hub, authenticating without SAS keys

Using SAS keys is a security issue that we would like to avoid, how do we utilize structured streaming from Event Hub while authenticating to Azure AD (client_id and secret).We know that we can use pythons Event Hub library, but that will make have t...

  • 1733 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, Could you please try structured streaming event hubs integration? https://docs.databricks.com/en/_extras/notebooks/source/structured-streaming-event-hubs-integration.html

  • 0 kudos
venkatddatabrik
by New Contributor
  • 1186 Views
  • 1 replies
  • 1 kudos

How to connect to database in azure databricks from vs2022 console application to access the data

Hi Team,Am new to databricks and please find my below question and do the favor.I have created a cluster then database, tables and data also inserted, Now I want to access this table data from my dotnet console application which is in 6.0 framework(v...

  • 1186 Views
  • 1 replies
  • 1 kudos
Latest Reply
Debayan
Databricks Employee
  • 1 kudos

Hi, Databricks extension will help you to do so. https://learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext Please let us know if this helps. Thanks!

  • 1 kudos
AniP
by New Contributor II
  • 3763 Views
  • 3 replies
  • 3 kudos

I created the workspace successfully using QuickStart(recommended) method, now I want to create one more workspace and it is showing an error.

Hi,I created the workspace using QuickStart(recommended) method and at the time of creating workspace, it asked following parameters - AccountId   -AWSRegionBucketNameDataS3BucketIAMRole.PasswordUsernameWorkspaceNameThe workspace was created successf...

  • 3763 Views
  • 3 replies
  • 3 kudos
Latest Reply
Debayan
Databricks Employee
  • 3 kudos

Hi, could you please elaborate on the error code here? There is some misconfiguration which is causing the error. Thanks!

  • 3 kudos
2 More Replies
none
by New Contributor
  • 1780 Views
  • 2 replies
  • 0 kudos

What's going wrong in my attempt to start with DataBricks?

I'm trying to get going with DataBricks for the first time. It's told me to create a workspace, which takes me to AWS (I'm also new to AWS). Following the instructions through there gets it to start creating something, but then it just gets stuck on ...

  • 1780 Views
  • 2 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, this looks like a workspace creation failure. Would like to know about the error details more. Thanks!

  • 0 kudos
1 More Replies
andresalvati
by New Contributor II
  • 1579 Views
  • 0 replies
  • 0 kudos

Tags to run S3 lifecycle rules

Hello,Is it possible to utilize S3 tags when writing a DataFrame with PySpark? Or is the only option to write the dataframe and then use boto3 to tag all the files?More information about S3 object tagging is here: Amazon S3 Object Tagging.Thank you.

  • 1579 Views
  • 0 replies
  • 0 kudos
jamescw
by New Contributor II
  • 997 Views
  • 0 replies
  • 1 kudos

VS code 2023

Do I need to save the data locally and run the plotting locally as well or does anyone have a smart solution to this

  • 997 Views
  • 0 replies
  • 1 kudos
mehdilamranikpl
by New Contributor
  • 1240 Views
  • 0 replies
  • 0 kudos

Change the Admin Owner Email Account for Databricks cloud standard account?

As stated. My company changed name and the email address has migrated. I need  to change it to the new one. And there is no way to open a support ticket to address that from what I saw (Standard Plan)Please do not tell me to contact AWS as they have ...

  • 1240 Views
  • 0 replies
  • 0 kudos
APKS
by New Contributor
  • 792 Views
  • 0 replies
  • 0 kudos

Plotting using Databricks in VS code

Hi,I am quite new to working with Databricks in VS code. I am trying to figure out the best way to plot my data, when running on a cluster. I would like to have the possibility to zoom and move the plot as I have when plotting locally with Matplotlib...

  • 792 Views
  • 0 replies
  • 0 kudos
thibault
by Contributor III
  • 7968 Views
  • 1 replies
  • 1 kudos

Databricks connect and spark session best practice

Hi all!I am using databricks-connect to develop and test pyspark code pure python (not notebook) files in my local IDE, running on a Databricks cluster. These files are part of a deployment setup with dbx so that they are run as tasks in a workflow.E...

  • 7968 Views
  • 1 replies
  • 1 kudos
Latest Reply
thibault
Contributor III
  • 1 kudos

Thanks for your response @Retired_mod . Can you elaborate on the difference between your suggestion and the code I provided? i.e. what would your if-else look like?

  • 1 kudos
ashik
by New Contributor II
  • 10311 Views
  • 6 replies
  • 3 kudos

Resolved! Databricks voucher code error

Hi Team, I am getting error that voucher code is invalid error when trying to register for "Databricks Certified Associate Data Engineer Associate. I got this issue once page was reloaded due to slowness of the internet before checkout. and the vouch...

  • 10311 Views
  • 6 replies
  • 3 kudos
Latest Reply
Priyag1
Honored Contributor II
  • 3 kudos

No Worries. Contact help and support system , also raise the ticket.

  • 3 kudos
5 More Replies
kashy
by New Contributor III
  • 15204 Views
  • 2 replies
  • 0 kudos

Resolved! Access Foreign Catalog using Python in Notebook

Hello - I have a foreign catalog which I can access fine in SQL.  However, I can't access it from from python notebook.i.e. this works just fine if I have notebook using a Pro SQL Warehouse%sqlUSE CATALOG <my_foreign_catalog_name>;USE SCHEMA public;S...

  • 15204 Views
  • 2 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, Are you using this in single user cluster? Also, please tag @Debayan with your next response so that I will get notified. 

  • 0 kudos
1 More Replies
Kratik
by New Contributor III
  • 2356 Views
  • 1 replies
  • 0 kudos

--files in spark submit task

Regarding --files option in spark submit task of Databricks jobs, would like to understand how it works and what is the syntax to pass multiple files to --files? I tried using --files and --py-files and my understanding is, it should make available t...

  • 2356 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, could you please check if this helps: https://docs.databricks.com/en/files/index.html Also please tag @Debayan​ with your next response which will notify me, Thank you!

  • 0 kudos
Phani1
by Valued Contributor II
  • 1151 Views
  • 1 replies
  • 0 kudos

Hive Migration best practices

Hi ,Could you please share with us the approach and best practices for migrating from hadoop-hive to Databricks?Regards,Phanindra

  • 1151 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, You can try checking the below resources:  https://www.databricks.com/resources/ebook/migration-guide-hadoop-to-databricks https://www.databricks.com/solutions/migration/hadoop https://www.databricks.com/blog/2021/08/06/5-key-steps-to-successfull...

  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels
Top Kudoed Authors