cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

SridharADB
by New Contributor II
  • 2042 Views
  • 2 replies
  • 1 kudos

Resolved! Cluster Termination Issue

Hi, I am new to ADB and started recently using this community edition. I created a cluster and it is terminating immediately when i use to connect.What I am missing or what i need do? kindly help me. 

SridharADB_0-1719551064801.png
  • 2042 Views
  • 2 replies
  • 1 kudos
Latest Reply
SridharADB
New Contributor II
  • 1 kudos

Hi Walter_C, thanks for your response. Your assumption is correct. Now I tried to create new Cluster whenever I start practice. Then no issues. 

  • 1 kudos
1 More Replies
BrandonCroom_
by New Contributor II
  • 980 Views
  • 1 replies
  • 1 kudos

Winston-Salem/Greensboro, NC User Group

Hi All! I'm looking to start at Databricks Usergroup in the Greensboro/Winston-Salem, NC area. Wanted to gauge interest to find others who would like to join.

  • 980 Views
  • 1 replies
  • 1 kudos
Latest Reply
CBrandon
New Contributor II
  • 1 kudos

Thank you for setting this up, Brandon!

  • 1 kudos
Jaron
by New Contributor III
  • 4518 Views
  • 4 replies
  • 0 kudos

Where the "Driver logs" are stored by default, and How much default space to store it.

Recently, when I was using databricks for deep learning I ran into an issue, i.e., after a certain amount of time of execution the cluster would break and restart. The logs are as below:The Event logs displayed "Metastore is down; Driver is up but is...

  • 4518 Views
  • 4 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

Hello Jaron, is it not possible for you to redirect the login to an ABFSS or S3 bucket?

  • 0 kudos
3 More Replies
Henrik_
by New Contributor III
  • 8184 Views
  • 2 replies
  • 0 kudos

Callback bound method error

 When executing a withColumn (running on DBR 14.3 LST) I get this error:Error in callback <bound method UserNamespaceCommandHook.post_run_cell of <dbruntime.DatasetInfo.UserNamespaceCommandHook object at 0x7feda2b2efb0>> (for post_run_cell):How shoul...

  • 8184 Views
  • 2 replies
  • 0 kudos
Latest Reply
TjommeV-Vlaio
New Contributor III
  • 0 kudos

We have the same issue using a shared cluster running DBR 14.3:Code executed: dfNew = dfTmp.withColumn(HashKeyColumnName, F.sha2(F.concat_ws("||", *ColumnList), 256))Error received: Error in callback <bound method UserNamespaceCommandHook.post_run_ce...

  • 0 kudos
1 More Replies
sara-aliza
by New Contributor
  • 1344 Views
  • 0 replies
  • 0 kudos

Pystan3 with databricks runtime 13.3

I am getting a read-only error when running pystan3 build() in a UDF.I think the issue is related to the location that the code is being run from, which is read-only. I am looking to set a custom cache location inside the UDF. Based on this link  I a...

  • 1344 Views
  • 0 replies
  • 0 kudos
151640
by New Contributor III
  • 2229 Views
  • 1 replies
  • 0 kudos

Databricks JDBC driver attempting to pass access token (JWT) from an external IDP (OKTA)

Configured a Databricks workspace for SSO to an IDP (OKTA).Databricks JDBC driver 02.06.38.1068Attempting to connect to Databricks using a URL similar to following where access token is obtained from the IDP (OKTA). Using tool such as SQLSquirrel wit...

  • 2229 Views
  • 1 replies
  • 0 kudos
Latest Reply
151640
New Contributor III
  • 0 kudos

Yes, latest version 02.06.38.1068Would like to know if other persons have successfully passed access tokens from an external IDP via the driver.

  • 0 kudos
jannemanson
by New Contributor III
  • 4983 Views
  • 4 replies
  • 1 kudos

run datarbicks worflow as service pricipal (managed identity) reads from azure dev ops repo Failed

Hello,we are running a workflow as a service principal, that is a aad managed identity. This does result in the issue: run databricks workflow as service principal the reads from azure dev ops repo Failed to checkout Git repository: PERMISSION_DENIED...

Get Started Discussions
azure
managed identity
Service Principal
  • 4983 Views
  • 4 replies
  • 1 kudos
Latest Reply
IvanK
New Contributor III
  • 1 kudos

We managed to solve this problem, however it is not an elegant solution. Databricks should simplify this.The steps that have to be done are listed below. We are using user assigned managed identity (MI), but I assume this should work for Azure Servic...

  • 1 kudos
3 More Replies
dataailearner
by New Contributor II
  • 3023 Views
  • 1 replies
  • 0 kudos

Cluster Auto Termination Best Practices

Are there any recommended practices to set cluster auto termination for cost optimization?

  • 3023 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ravivarma
Databricks Employee
  • 0 kudos

Hello @dataailearner , Greetings of the day! Here are a few steps that you can follow for cost optimizations: 1. Choose the most efficient compute size: Databricks runs one executor per worker node. The total number of cores across all executors is a...

  • 0 kudos
Zavi
by New Contributor
  • 1817 Views
  • 1 replies
  • 0 kudos

When are DLT going to support multiple targets

Due to the limitations with all output data needing to be stored in one target we have stopped using DLT until more flexibility is added. If anyone has a workaround we are open to suggestions. 

  • 1817 Views
  • 1 replies
  • 0 kudos
Latest Reply
Rafael-Ribeiro
New Contributor II
  • 0 kudos

Hi Zavi,One potential workaround is to establish multiple DLT pipelines, with each pipeline specifically configured to point to a unique target. This approach effectively allows for a diverse range of output data to be stored across various targets.T...

  • 0 kudos
pjv
by New Contributor III
  • 1145 Views
  • 1 replies
  • 0 kudos

VSCode Databricks Extension

Hi all,I've been trying to sync my VSCode IDE with our Databricks GCP workspace using the Databricks extension. I am able to connect authenticate my account and workspace and find our clusters. However, when I try to sync a destination it throws a st...

  • 1145 Views
  • 1 replies
  • 0 kudos
Latest Reply
pjv
New Contributor III
  • 0 kudos

@Retired_mod thanks for you response.I am not running through a proxy. At least, not on purpose. How do I know if I am running through a proxy? And where can I find the values of <proxy_url> and <port> so that I can try restarting my VSCode.I have tr...

  • 0 kudos
rachit-prodigal
by New Contributor
  • 24421 Views
  • 0 replies
  • 0 kudos

Identity column has null values

I created a table in databricks using a dbt model pre hook  CREATE TABLE IF NOT EXISTS accounts ( account_id BIGINT GENERATED ALWAYS AS IDENTITY, description STRING other columns)I use the same dbt model to merge values into this table in the post...

  • 24421 Views
  • 0 replies
  • 0 kudos
unity_Catalog
by New Contributor III
  • 1594 Views
  • 0 replies
  • 0 kudos

UCX Installation Error

While downloading and installing ucx from a shell code,I am facing the below error. Can anyone provide a solution[i] Creating isolated Virtualenv with Python: /c/Program Files/Python312/pythonActual environment location may have moved due to redirect...

  • 1594 Views
  • 0 replies
  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels