cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Skv
by New Contributor II
  • 2260 Views
  • 1 replies
  • 0 kudos

Snowflake filter Query giving empty results in Databricks, same query working in Snowflake.

I am trying to fetch filter data based on date format on a date column. Below is the query forming in Databricks. In Databricks giving empty results.SELECT * FROM Test.TestSchema.Address where TO_DATE(TO_VARCHAR(MODIFIEDDATE,'YYYY-MM-DD')) = '2023-09...

  • 2260 Views
  • 1 replies
  • 0 kudos
Paulv14
by New Contributor
  • 1073 Views
  • 1 replies
  • 0 kudos

Sql warehouse setting permission

How do you set permission to just execute a query but cannot modify settings on the sql warehouse

  • 1073 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, Have you tried this: https://docs.databricks.com/en/security/auth-authz/access-control/sql-endpoint-acl.html Please let us know if this helps.  Thanks!

  • 0 kudos
botn
by New Contributor
  • 2108 Views
  • 1 replies
  • 0 kudos

Resolved! Structured streaming from Azure Event Hub, authenticating without SAS keys

Using SAS keys is a security issue that we would like to avoid, how do we utilize structured streaming from Event Hub while authenticating to Azure AD (client_id and secret).We know that we can use pythons Event Hub library, but that will make have t...

  • 2108 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, Could you please try structured streaming event hubs integration? https://docs.databricks.com/en/_extras/notebooks/source/structured-streaming-event-hubs-integration.html

  • 0 kudos
venkatddatabrik
by New Contributor
  • 1442 Views
  • 1 replies
  • 1 kudos

How to connect to database in azure databricks from vs2022 console application to access the data

Hi Team,Am new to databricks and please find my below question and do the favor.I have created a cluster then database, tables and data also inserted, Now I want to access this table data from my dotnet console application which is in 6.0 framework(v...

  • 1442 Views
  • 1 replies
  • 1 kudos
Latest Reply
Debayan
Databricks Employee
  • 1 kudos

Hi, Databricks extension will help you to do so. https://learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext Please let us know if this helps. Thanks!

  • 1 kudos
AniP
by New Contributor II
  • 4340 Views
  • 3 replies
  • 3 kudos

I created the workspace successfully using QuickStart(recommended) method, now I want to create one more workspace and it is showing an error.

Hi,I created the workspace using QuickStart(recommended) method and at the time of creating workspace, it asked following parameters - AccountId   -AWSRegionBucketNameDataS3BucketIAMRole.PasswordUsernameWorkspaceNameThe workspace was created successf...

  • 4340 Views
  • 3 replies
  • 3 kudos
Latest Reply
Debayan
Databricks Employee
  • 3 kudos

Hi, could you please elaborate on the error code here? There is some misconfiguration which is causing the error. Thanks!

  • 3 kudos
2 More Replies
none
by New Contributor
  • 2732 Views
  • 2 replies
  • 0 kudos

What's going wrong in my attempt to start with DataBricks?

I'm trying to get going with DataBricks for the first time. It's told me to create a workspace, which takes me to AWS (I'm also new to AWS). Following the instructions through there gets it to start creating something, but then it just gets stuck on ...

  • 2732 Views
  • 2 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, this looks like a workspace creation failure. Would like to know about the error details more. Thanks!

  • 0 kudos
1 More Replies
drii_cavalcanti
by New Contributor III
  • 955 Views
  • 0 replies
  • 0 kudos

Hive Metastore permission on DBX 10.4

I've been working on creating a schema in the Hive Metastore using the following command:spark.sql(f'CREATE DATABASE IF NOT EXISTS {database}')The schema or database is successfully created, but I encountered an issue where it's only accessible for m...

Get Started Discussions
clusters
hive_metastore
legacy
permission
  • 955 Views
  • 0 replies
  • 0 kudos
andresalvati
by New Contributor II
  • 1880 Views
  • 0 replies
  • 0 kudos

Tags to run S3 lifecycle rules

Hello,Is it possible to utilize S3 tags when writing a DataFrame with PySpark? Or is the only option to write the dataframe and then use boto3 to tag all the files?More information about S3 object tagging is here: Amazon S3 Object Tagging.Thank you.

  • 1880 Views
  • 0 replies
  • 0 kudos
jamescw
by New Contributor II
  • 1916 Views
  • 0 replies
  • 1 kudos

VS code 2023

Do I need to save the data locally and run the plotting locally as well or does anyone have a smart solution to this

  • 1916 Views
  • 0 replies
  • 1 kudos
mehdilamranikpl
by New Contributor
  • 1444 Views
  • 0 replies
  • 0 kudos

Change the Admin Owner Email Account for Databricks cloud standard account?

As stated. My company changed name and the email address has migrated. I need  to change it to the new one. And there is no way to open a support ticket to address that from what I saw (Standard Plan)Please do not tell me to contact AWS as they have ...

  • 1444 Views
  • 0 replies
  • 0 kudos
APKS
by New Contributor
  • 931 Views
  • 0 replies
  • 0 kudos

Plotting using Databricks in VS code

Hi,I am quite new to working with Databricks in VS code. I am trying to figure out the best way to plot my data, when running on a cluster. I would like to have the possibility to zoom and move the plot as I have when plotting locally with Matplotlib...

  • 931 Views
  • 0 replies
  • 0 kudos
ashik
by New Contributor II
  • 11137 Views
  • 6 replies
  • 3 kudos

Resolved! Databricks voucher code error

Hi Team, I am getting error that voucher code is invalid error when trying to register for "Databricks Certified Associate Data Engineer Associate. I got this issue once page was reloaded due to slowness of the internet before checkout. and the vouch...

  • 11137 Views
  • 6 replies
  • 3 kudos
Latest Reply
Priyag1
Honored Contributor II
  • 3 kudos

No Worries. Contact help and support system , also raise the ticket.

  • 3 kudos
5 More Replies
gilo12
by New Contributor III
  • 4979 Views
  • 2 replies
  • 1 kudos

Change default catalog

It seems that when I am connecting to Databricks Warehouse, it is using the default catalog which is hive_metastore. Is there a way to define unity catalog to be the default?I know I can run the queryUSE CATALOG MAINAnd then the current session will ...

  • 4979 Views
  • 2 replies
  • 1 kudos
Latest Reply
Jon-ton
New Contributor II
  • 1 kudos

Thanks Brian2. Is there an equivalent config parameter for a SQL Warehouse?

  • 1 kudos
1 More Replies
fazlu_don23
by New Contributor III
  • 1054 Views
  • 0 replies
  • 0 kudos

ronaldo is back

create table SalesReport(TerritoryName NVARCHAR(50), ProductName NVARCHAR(100), TotalSales DECIMAL(10,2), PreviousYearSales DECIMAL(10,2), GrowthRate DECIMAL(10,2));  create table ErrorLog( ErrorID int, ErrorMessage nvarchar(max),ErrorDate datetime);...

  • 1054 Views
  • 0 replies
  • 0 kudos
alesventus
by Contributor
  • 1662 Views
  • 0 replies
  • 0 kudos

Save dataframe to the same variable

I would like to know if there is any difference if I save dataframe during tranformation to itself as first code or to new dataframe as second example.Thankslog_df = log_df.withColumn("process_timestamp",from_utc_timestamp(lit(current_timestamp()),"E...

  • 1662 Views
  • 0 replies
  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels