cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MetaMaestro
by New Contributor III
  • 1247 Views
  • 1 replies
  • 0 kudos

GCP hosted Databricks - DBFS temp files - Not Found

I've been working on obtaining DDL at the schema level in Hive Metastore within GCP-hosted Databricks. I've implemented a Python code that generates SQL files in the dbfs/temp directory. However, when running the code, I'm encountering a "file path n...

  • 1247 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, the error code snippet with the whole error may help to determine the issue, also, considering the above points may also work as a fix. 

  • 0 kudos
Rajan_651
by New Contributor
  • 1949 Views
  • 1 replies
  • 0 kudos

Unable to find permission button in Sql Warehouse for providing Access

Hi Everyone, am unable to see the permission button in sql warehouse to provide access to other users.I have admin rights and databricks is premium subscription.  

  • 1949 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, Could you please provide a screenshot of the SQL warehouse? Also, you can go through: https://docs.databricks.com/en/security/auth-authz/access-control/sql-endpoint-acl.htmlAlso, please tag @Debayan with your next comment which will notify me. Th...

  • 0 kudos
Leszek
by Contributor
  • 856 Views
  • 1 replies
  • 1 kudos

SQL Serverless - cost view

Hi,Anyone knows how I'm able to monitor cost of the SQL Serverless? I'm using Databricks in Azure and I'm not sure where to find cost generated by compute resources hosted on Databricks.

  • 856 Views
  • 1 replies
  • 1 kudos
Latest Reply
Debayan
Databricks Employee
  • 1 kudos

Hi, You can calculate the pricing in https://www.databricks.com/product/pricing/databricks-sql also, https://azure.microsoft.com/en-in/pricing/details/databricks/#:~:text=Sign%20in%20to%20the%20Azure,asked%20questions%20about%20Azure%20pricing. For A...

  • 1 kudos
Bagger
by New Contributor II
  • 2740 Views
  • 1 replies
  • 0 kudos

Monitoring job metrics

Hi,We need to monitor Databricks jobs and we have made a setup where are able to get the prometheus metrics, however, we are lagging an overview of which metrics refer to what.Namely, we need to monitor the following:failed jobs : is a job failedtabl...

Get Started Discussions
jobs
metrics
prometheus
  • 2740 Views
  • 1 replies
  • 0 kudos
Latest Reply
Bagger
New Contributor II
  • 0 kudos

I have reposted this post in "Administation and Architecture"Monitoring job metrics - Databricks - 42956

  • 0 kudos
Cryptocurentcyc
by New Contributor
  • 765 Views
  • 0 replies
  • 0 kudos

ListBucket

{  "Version": "2012-10-17",  "Statement": [    {      "Effect": "Allow",      "Action": [        "s3:ListBucket"      ],     "Resource": [        "arn:aws:s3:::<s3-bucket-name>"      ]    },    {      "Effect": "Allow",      "Action": [        "s3:Pu...

  • 765 Views
  • 0 replies
  • 0 kudos
mano7438
by New Contributor III
  • 7279 Views
  • 6 replies
  • 1 kudos

Resolved! Unable to create table with primary key

Hi Team,Getting below error while creating a table with primary key,"Table constraints are only supported in Unity Catalog."Table script : CREATE TABLE persons(first_name STRING NOT NULL, last_name STRING NOT NULL, nickname STRING,CONSTRAINT persons_...

  • 7279 Views
  • 6 replies
  • 1 kudos
Latest Reply
Debayan
Databricks Employee
  • 1 kudos

Hi, this needs further investigation, could you please raise a support case with Databricks? 

  • 1 kudos
5 More Replies
inesandres567
by New Contributor
  • 1366 Views
  • 1 replies
  • 0 kudos

Problem starting cluster

I try to start cluster that i used to start it 7 times before and it gave me this error Cloud provider is undergoing a transient resource throttling. This is retryable. 1 out of 2 pods scheduled. Failed to launch cluster in kubernetes in 1800 seconds...

  • 1366 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, This error "GCE out of resources" typically means that Google compute engine is out of resources as in out of nodes (can be a quota issue or can be node issues in that particular region in GCP). Could you please raise a google support case on thi...

  • 0 kudos
inesandres567
by New Contributor
  • 916 Views
  • 1 replies
  • 0 kudos

Fail start cluster

I try to start cluster that i used to start it 7 times before and it gave me this error Cloud provider is undergoing a transient resource throttling. This is retryable. 1 out of 2 pods scheduled. Failed to launch cluster in kubernetes in 1800 seconds...

  • 916 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, This error "GCE out of resources" typically means that Google compute engine is out of resources as in out of nodes (can be a quota issue or can be node issues in that particular region in GCP). Could you please raise a google support case on thi...

  • 0 kudos
diego_poggioli
by Contributor
  • 2180 Views
  • 1 replies
  • 1 kudos

Resolved! Run tasks conditionally "Always" condition missing?

Does the new feature 'Run If' that allows you to run tasks conditionally lack the 'ALWAYS' option? In order to execute the task both when there is OK and error from the dependencies

  • 2180 Views
  • 1 replies
  • 1 kudos
Latest Reply
Lakshay
Databricks Employee
  • 1 kudos

You can choose the All Done option to run the task in both the scenarios

  • 1 kudos
apiury
by New Contributor III
  • 562 Views
  • 0 replies
  • 0 kudos

Analyze data metodoly

Hello,I have an ETL process that ingests data into bronze tables, transforms the data, and then ingests it into silver tables before finally populating the gold tables. This workflow is executed every 5 minutes. When I want to analyze the data or app...

  • 562 Views
  • 0 replies
  • 0 kudos
alex-syk
by New Contributor II
  • 5590 Views
  • 7 replies
  • 0 kudos

Delta Sharing - Alternative to config.share

I was recently given a credential file to access shared data via delta sharing. I am following the documentation from https://docs.databricks.com/en/data-sharing/read-data-open.html. The documentation wants the contents of the credential file in a fo...

  • 5590 Views
  • 7 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, the most feasible way would be to convert the contents of your key file into base64 and only mention the spark config as below: credentials <base 64 encoded code>

  • 0 kudos
6 More Replies
DavidValdez
by New Contributor II
  • 923 Views
  • 1 replies
  • 0 kudos

I can't access to my account

Hi, I can't access to my account, and need to book an exam. I completed my registration at: https://www.webassessor.com/form/createAccount.do, and when I try to login I have this error: "Login or Password is incorrect"Please help me with this issue. ...

  • 923 Views
  • 1 replies
  • 0 kudos
Latest Reply
Cert-Team
Databricks Employee
  • 0 kudos

Hi @DavidValdez Looks like you were able to schedule your exam. If you experience any other issues you can request support here.We also have a new FAQ: https://www.databricks.com/learn/certification/faq

  • 0 kudos
kp12
by New Contributor II
  • 11413 Views
  • 1 replies
  • 0 kudos

Accessing TenantId via secret to connect to Azure Data Lake Storage Gen2 doesn't work

Hello,I'm following instructions in this article to connect to ADLS gen2 using Azure service principal. I can access service principal's app id and secret via Databricks key vault backed secret scope. However, this doesn't work for directory-id and I...

  • 11413 Views
  • 1 replies
  • 0 kudos
Latest Reply
kp12
New Contributor II
  • 0 kudos

Hi @Retired_mod , Thanks for the prompt reply. As per the document, the syntax is the text highlighted in red below for accessing keys from secret scope in spark config. I used the same for app id too and that works. But I if use the same syntax for ...

  • 0 kudos
rohithmalla
by New Contributor
  • 1007 Views
  • 1 replies
  • 0 kudos

Snowflake Data Formatting Issue

I'm loading snowflake data to delta tables in databricks, few columns in snowflake data have datatype as Number (20,7) after loading to delta table it is taking as decimal (20,7), for example, if the value is 0.0000000 in snowflake then it is showing...

  • 1007 Views
  • 1 replies
  • 0 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 0 kudos

explicit casting seems like the way to go.First try with one column, to see if that solves your issue.If so, you can write a function that casts all decimal columns to a certain precision, something like this:def convert_decimal_precision_scale(df, p...

  • 0 kudos
Mumrel
by Contributor
  • 2242 Views
  • 4 replies
  • 1 kudos

Why is importing python code supported in Repos but not in Workspaces ?

Hi, we currently use a one repo approach which does not require a local development environment (we utilize azure dev ops and nutter for automated tests). We also have shared code accross pipelines and started with %run-sytle modularization and have ...

  • 2242 Views
  • 4 replies
  • 1 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 1 kudos

the why is most probably because of different development tracks/teams between workspace and repos.If they will consilidate in functionality?  Can't tell, only Databricks knows that; but it seems reasonable to assume the files will also be added to w...

  • 1 kudos
3 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels
Top Kudoed Authors