cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Paulv14
by New Contributor
  • 457 Views
  • 1 replies
  • 0 kudos

Sql warehouse setting permission

How do you set permission to just execute a query but cannot modify settings on the sql warehouse

  • 457 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 0 kudos

Hi, Have you tried this: https://docs.databricks.com/en/security/auth-authz/access-control/sql-endpoint-acl.html Please let us know if this helps.  Thanks!

  • 0 kudos
botn
by New Contributor
  • 1142 Views
  • 1 replies
  • 0 kudos

Resolved! Structured streaming from Azure Event Hub, authenticating without SAS keys

Using SAS keys is a security issue that we would like to avoid, how do we utilize structured streaming from Event Hub while authenticating to Azure AD (client_id and secret).We know that we can use pythons Event Hub library, but that will make have t...

  • 1142 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 0 kudos

Hi, Could you please try structured streaming event hubs integration? https://docs.databricks.com/en/_extras/notebooks/source/structured-streaming-event-hubs-integration.html

  • 0 kudos
venkatddatabrik
by New Contributor
  • 709 Views
  • 1 replies
  • 1 kudos

How to connect to database in azure databricks from vs2022 console application to access the data

Hi Team,Am new to databricks and please find my below question and do the favor.I have created a cluster then database, tables and data also inserted, Now I want to access this table data from my dotnet console application which is in 6.0 framework(v...

  • 709 Views
  • 1 replies
  • 1 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 1 kudos

Hi, Databricks extension will help you to do so. https://learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext Please let us know if this helps. Thanks!

  • 1 kudos
AniP
by New Contributor II
  • 1596 Views
  • 3 replies
  • 3 kudos

I created the workspace successfully using QuickStart(recommended) method, now I want to create one more workspace and it is showing an error.

Hi,I created the workspace using QuickStart(recommended) method and at the time of creating workspace, it asked following parameters - AccountId   -AWSRegionBucketNameDataS3BucketIAMRole.PasswordUsernameWorkspaceNameThe workspace was created successf...

  • 1596 Views
  • 3 replies
  • 3 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 3 kudos

Hi, could you please elaborate on the error code here? There is some misconfiguration which is causing the error. Thanks!

  • 3 kudos
2 More Replies
none
by New Contributor
  • 1175 Views
  • 3 replies
  • 0 kudos

What's going wrong in my attempt to start with DataBricks?

I'm trying to get going with DataBricks for the first time. It's told me to create a workspace, which takes me to AWS (I'm also new to AWS). Following the instructions through there gets it to start creating something, but then it just gets stuck on ...

  • 1175 Views
  • 3 replies
  • 0 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 0 kudos

Hi, this looks like a workspace creation failure. Would like to know about the error details more. Thanks!

  • 0 kudos
2 More Replies
APKS
by New Contributor
  • 465 Views
  • 1 replies
  • 0 kudos

Plotting using Databricks in VS code

Hi,I am quite new to working with Databricks in VS code. I am trying to figure out the best way to plot my data, when running on a cluster. I would like to have the possibility to zoom and move the plot as I have when plotting locally with Matplotlib...

  • 465 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @APKS, To plot your data when running on a Databricks cluster, you can use the %matplotlib inline magic command in a notebook cell. This will allow you to use Matplotlib to create plots and display them inline in the notebook.

  • 0 kudos
mehdilamranikpl
by New Contributor
  • 651 Views
  • 1 replies
  • 0 kudos

Change the Admin Owner Email Account for Databricks cloud standard account?

As stated. My company changed name and the email address has migrated. I need  to change it to the new one. And there is no way to open a support ticket to address that from what I saw (Standard Plan)Please do not tell me to contact AWS as they have ...

  • 651 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @mehdilamranikpl, To change the email address associated with your Databricks account, you can follow the steps below: 1. Log in to the Databricks account console as the account owner or an account-level administrator.2. Go to each workspace and e...

  • 0 kudos
thibault
by Contributor
  • 3563 Views
  • 3 replies
  • 0 kudos

Databricks connect and spark session best practice

Hi all!I am using databricks-connect to develop and test pyspark code pure python (not notebook) files in my local IDE, running on a Databricks cluster. These files are part of a deployment setup with dbx so that they are run as tasks in a workflow.E...

  • 3563 Views
  • 3 replies
  • 0 kudos
Latest Reply
thibault
Contributor
  • 0 kudos

Thanks for your response @Kaniz_Fatma . Can you elaborate on the difference between your suggestion and the code I provided? i.e. what would your if-else look like?

  • 0 kudos
2 More Replies
ashik
by New Contributor II
  • 4184 Views
  • 6 replies
  • 3 kudos

Resolved! Databricks voucher code error

Hi Team, I am getting error that voucher code is invalid error when trying to register for "Databricks Certified Associate Data Engineer Associate. I got this issue once page was reloaded due to slowness of the internet before checkout. and the vouch...

  • 4184 Views
  • 6 replies
  • 3 kudos
Latest Reply
Priyag1
Honored Contributor II
  • 3 kudos

No Worries. Contact help and support system , also raise the ticket.

  • 3 kudos
5 More Replies
kashy
by New Contributor III
  • 5909 Views
  • 2 replies
  • 0 kudos

Resolved! Access Foreign Catalog using Python in Notebook

Hello - I have a foreign catalog which I can access fine in SQL.  However, I can't access it from from python notebook.i.e. this works just fine if I have notebook using a Pro SQL Warehouse%sqlUSE CATALOG <my_foreign_catalog_name>;USE SCHEMA public;S...

  • 5909 Views
  • 2 replies
  • 0 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 0 kudos

Hi, Are you using this in single user cluster? Also, please tag @Debayan with your next response so that I will get notified. 

  • 0 kudos
1 More Replies
Kratik
by New Contributor III
  • 1248 Views
  • 1 replies
  • 0 kudos

--files in spark submit task

Regarding --files option in spark submit task of Databricks jobs, would like to understand how it works and what is the syntax to pass multiple files to --files? I tried using --files and --py-files and my understanding is, it should make available t...

  • 1248 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 0 kudos

Hi, could you please check if this helps: https://docs.databricks.com/en/files/index.html Also please tag @Debayan​ with your next response which will notify me, Thank you!

  • 0 kudos
Phani1
by Valued Contributor
  • 547 Views
  • 1 replies
  • 0 kudos

Hive Migration best practices

Hi ,Could you please share with us the approach and best practices for migrating from hadoop-hive to Databricks?Regards,Phanindra

  • 547 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 0 kudos

Hi, You can try checking the below resources:  https://www.databricks.com/resources/ebook/migration-guide-hadoop-to-databricks https://www.databricks.com/solutions/migration/hadoop https://www.databricks.com/blog/2021/08/06/5-key-steps-to-successfull...

  • 0 kudos
Phani1
by Valued Contributor
  • 820 Views
  • 1 replies
  • 0 kudos

Sqoop Migration best practices

Hi ,Could you please share with us the approach and best practices for migrating from hadoop-SQOOP to Databricks?

  • 820 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 0 kudos

Hi, You can try checking the below resources:  https://www.databricks.com/resources/ebook/migration-guide-hadoop-to-databricks https://www.databricks.com/solutions/migration/hadoop https://www.databricks.com/blog/2021/08/06/5-key-steps-to-successfull...

  • 0 kudos
Phani1
by Valued Contributor
  • 465 Views
  • 1 replies
  • 0 kudos

OOZE Jobs migration to databricks

Hi ,Could you please share with us the approach and best practices for migrating from hadoop-ooze jobs to Databricks?

  • 465 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 0 kudos

Hi, You can try checking the below resources on Hadoop migration:  https://www.databricks.com/resources/ebook/migration-guide-hadoop-to-databricks https://www.databricks.com/solutions/migration/hadoop https://www.databricks.com/blog/2021/08/06/5-key-...

  • 0 kudos
Phani1
by Valued Contributor
  • 795 Views
  • 1 replies
  • 0 kudos

HDFS to Databricks

Hi ,Could you please share with us the approach and best practices for migrating from hadoop-HDFS to Databricks?

  • 795 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 0 kudos

Hi, You can try checking the below resources:  https://www.databricks.com/resources/ebook/migration-guide-hadoop-to-databricks https://www.databricks.com/solutions/migration/hadoop https://www.databricks.com/blog/2021/08/06/5-key-steps-to-successfull...

  • 0 kudos
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels
Top Kudoed Authors