cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

alex-syk
by New Contributor II
  • 4791 Views
  • 7 replies
  • 0 kudos

Delta Sharing - Alternative to config.share

I was recently given a credential file to access shared data via delta sharing. I am following the documentation from https://docs.databricks.com/en/data-sharing/read-data-open.html. The documentation wants the contents of the credential file in a fo...

  • 4791 Views
  • 7 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, the most feasible way would be to convert the contents of your key file into base64 and only mention the spark config as below: credentials <base 64 encoded code>

  • 0 kudos
6 More Replies
DavidValdez
by New Contributor II
  • 817 Views
  • 1 replies
  • 0 kudos

I can't access to my account

Hi, I can't access to my account, and need to book an exam. I completed my registration at: https://www.webassessor.com/form/createAccount.do, and when I try to login I have this error: "Login or Password is incorrect"Please help me with this issue. ...

  • 817 Views
  • 1 replies
  • 0 kudos
Latest Reply
Cert-Team
Databricks Employee
  • 0 kudos

Hi @DavidValdez Looks like you were able to schedule your exam. If you experience any other issues you can request support here.We also have a new FAQ: https://www.databricks.com/learn/certification/faq

  • 0 kudos
kp12
by New Contributor II
  • 10685 Views
  • 1 replies
  • 0 kudos

Accessing TenantId via secret to connect to Azure Data Lake Storage Gen2 doesn't work

Hello,I'm following instructions in this article to connect to ADLS gen2 using Azure service principal. I can access service principal's app id and secret via Databricks key vault backed secret scope. However, this doesn't work for directory-id and I...

  • 10685 Views
  • 1 replies
  • 0 kudos
Latest Reply
kp12
New Contributor II
  • 0 kudos

Hi @Retired_mod , Thanks for the prompt reply. As per the document, the syntax is the text highlighted in red below for accessing keys from secret scope in spark config. I used the same for app id too and that works. But I if use the same syntax for ...

  • 0 kudos
rohithmalla
by New Contributor
  • 822 Views
  • 1 replies
  • 0 kudos

Snowflake Data Formatting Issue

I'm loading snowflake data to delta tables in databricks, few columns in snowflake data have datatype as Number (20,7) after loading to delta table it is taking as decimal (20,7), for example, if the value is 0.0000000 in snowflake then it is showing...

  • 822 Views
  • 1 replies
  • 0 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 0 kudos

explicit casting seems like the way to go.First try with one column, to see if that solves your issue.If so, you can write a function that casts all decimal columns to a certain precision, something like this:def convert_decimal_precision_scale(df, p...

  • 0 kudos
Mumrel
by Contributor
  • 1839 Views
  • 4 replies
  • 1 kudos

Why is importing python code supported in Repos but not in Workspaces ?

Hi, we currently use a one repo approach which does not require a local development environment (we utilize azure dev ops and nutter for automated tests). We also have shared code accross pipelines and started with %run-sytle modularization and have ...

  • 1839 Views
  • 4 replies
  • 1 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 1 kudos

the why is most probably because of different development tracks/teams between workspace and repos.If they will consilidate in functionality?  Can't tell, only Databricks knows that; but it seems reasonable to assume the files will also be added to w...

  • 1 kudos
3 More Replies
DeltaTrain
by New Contributor II
  • 1173 Views
  • 3 replies
  • 0 kudos

hive_metastore Access Control by different cluster type

Hello Databricks Community,I'm reaching out with a query regarding access control in the hive_metastore. I've encountered behavior that I'd like to understand better and potentially address.To illustrate the situation:I've set up three users for test...

DeltaTrain_0-1691616911858.png DeltaTrain_1-1691617650542.png
  • 1173 Views
  • 3 replies
  • 0 kudos
Latest Reply
DeltaTrain
New Contributor II
  • 0 kudos

Hi @Debayan, thank you for your reply.  with hive_metastore, still I cannot get the level of isolation, which means that if anyone activates the Single node cluster, she/he can see all the catalog, schema, and table. However, with Unity catalog appli...

  • 0 kudos
2 More Replies
BobBubble2000
by New Contributor II
  • 1368 Views
  • 0 replies
  • 0 kudos

Workflows pricing

Hi there,I checked the Databricks page on the pricing of Databricks Workflows ( https://www.databricks.com/product/pricing/jobs ) and have a question regarding the cost components: the pricing page only mentions compute costs (depending whether it's ...

  • 1368 Views
  • 0 replies
  • 0 kudos
Seongmin
by New Contributor
  • 1071 Views
  • 2 replies
  • 0 kudos

What's LLM?

What's LLM for generative AI?

  • 1071 Views
  • 2 replies
  • 0 kudos
Latest Reply
annianni
New Contributor II
  • 0 kudos

LLMs are large language models like Google Bard or OpenAI or ChatGPT, etc. "It is a type of artificial intelligence (AI) algorithm that uses deep learning techniques and massively large data sets to understand, summarize, generate and predict new con...

  • 0 kudos
1 More Replies
mallesh2088
by New Contributor II
  • 1327 Views
  • 1 replies
  • 1 kudos

Compute cluster, SQL warehouse not starting - AWS

Hey,I am using "AWSQuickstartCloudformationLambda" to create a workspace in my trial environment and on the AWS side the stack create succeeded but on the Databricks side compute cluster is not starting. The error says:Aws Authorization Failure:Failu...

  • 1327 Views
  • 1 replies
  • 1 kudos
Latest Reply
Debayan
Databricks Employee
  • 1 kudos

Hi, the error suggests there is some error with the credentials. You can check the credentials chain to see where aws is looking for the credentials. https://blog.leapp.cloud/aws-sdk-unable-to-locate-credentials.You can refer to another article: http...

  • 1 kudos
AleksandraFrolo
by New Contributor III
  • 924 Views
  • 1 replies
  • 0 kudos

WebDriverException: Message: unknown error: Chrome failed to start: exited abnormally.

Hiiiii,I want to scratch a text from the web page with simple code:from selenium import webdriver # Set options to make browsing easier #Function is responsible to create a driver and return that driver. def get_driver(): chrome_options = webdr...

  • 924 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, Looks like the issue is with your browser, could you please try to change the browser and confirm?Please tag @Debayan with your next comment, which will get me notified. Thanks!

  • 0 kudos
375721
by New Contributor II
  • 2273 Views
  • 4 replies
  • 0 kudos

webscraping with Firefox driver failing - Python code

Getting below exception while running web scraping script, stuck at installing firefox from snap.   Getting apparmor permission issue and tried to reinstall it and still getting the same. please check the error message section. Dependencies:Python li...

  • 2273 Views
  • 4 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, This is an issue with the dependencies of different packages. Please try as below: apt get update && apt get upgrade; apt install firefox;Please tag @Debayan with your next comment which will notify me. 

  • 0 kudos
3 More Replies
Phani1
by Valued Contributor II
  • 9328 Views
  • 1 replies
  • 0 kudos

Run a job with an Azure service principal

We had a problem in pointing out the Service Principal in the “Run as” option of workflow. Below are the details about the issue we are facing.Issue Details:I had created a Workflow in Azure Databricks workspace to automate the Data movement process....

Phani1_0-1692256727118.png Phani1_1-1692256735431.png
Get Started Discussions
Service Principal
  • 9328 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, Could you please confirm if the service principle is already added to the workspace via admin console? https://docs.databricks.com/en/administration-guide/users-groups/service-principals.html#assign-a-service-principal-to-a-workspace-using-the-ac...

  • 0 kudos
gg_047320_gg_94
by New Contributor II
  • 1143 Views
  • 1 replies
  • 0 kudos

Update metastore bucket

Hello,Our Databricks workspace is currently hosted on AWS account1, while the meta store bucket is configured within a separate AWS account2. We want to transfer this bucket to account1 to eliminate our reliance on account2. How to configure this buc...

  • 1143 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, You can use: https://github.com/databrickslabs/migrate/blob/master/METASTORE.md# for the metastore data migration. Please tag @Debayan with your next comment which will get me notified. 

  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels