Databricks

Ravikumashi

Hi All,We had azure databricks workspaces created thru terraform with public network access enabled to true and everything was working great. recently we have disabled the public network access and started to face issues.terraform is uanble to add us...

Ravikumashi · 03-21-2024

We have been using Hive Metastore in Databricks workspaces and recently enabled Unity Catalog for one of the workspace. However, we are encountering issues while applying grants on databases. The system is complaining, stating that table access contr...

Ravikumashi · 01-21-2024

Is it possible we extract cluster usage tags from databricks cluster init script, I am specifically interested in spark.databricks.clusterUsageTags.clusterAllTags.I tried to extract from /databricks/spark/conf/spark.conf and /databricks/spark/conf/sp...

Ravikumashi · 08-17-2023

we've encountered issue while attempting to install Maven libraries on Databricks clusters version 11.3 LTS. Specifically, we are encountering SSL handshake errors during the installation process. It's worth noting that these same libraries install w...

Ravikumashi · 08-15-2023

We have recently been in the process of upgrading our Databricks clusters to version 11.3 LTS. As part of this upgrade, we have been working on integrating the logging of Spark events to LogAnalytics using the repository available at https://github.c...

Ravikumashi

we use the following code to create private endpoint and on UI we can see the private endpoint connection status as approved.resource "azurerm_private_endpoint" "example" { name = "example-endpoint" location = azurerm_re...

Ravikumashi

we have created a private endpoint for our azure databricks workspace is this not enough. Do we need to also explictly set up setwork security rule to allow traffic from private endpoint to databricks workspace.Also required NSG rules for workspace i...

Ravikumashi

@swathi-dataops I have added ServicePrincipalCredentialsAuth and ServicePrincipalAuthBase as a normal classes instead of creating a separate jar for these 2 classes and packaged them as a part of my project jar.And used the below code for configuring...

Ravikumashi · 01-22-2024

@Debayan thank you for your reply.Reference link helps to get the cluster usage tags from notebook when the cluster is completly up and running.Our requirement is to extract cluster usage tags during the cluster initiation and pass this info to spar...

Ravikumashi · 08-18-2023

as per the behavioural changes in 11.3 and above, maven libraries now resolve in your data plane by default when you install libraries on a cluster. You cluster must have access to maven central. Alternatively, you can revert to the previous behavior...

Databricks

User Stats

User Activity

issue with azure databricks workspace after we disable public network access

Issue with applying ACL's in Unit catlog enabled workspace

Extract cluster usage tags from databricks cluster init script

maven libraries installation issue on 11.3/12.2 LTS

Issue with Logging Spark Events to LogAnalytics after Upgrading to Databricks 11.3 LTS

Re: issue with azure databricks workspace after we disable public network access

Re: issue with azure databricks workspace after we disable public network access

Re: failed to initialise azure-event-hub with azure AAD(service principal)

Re: Extract cluster usage tags from databricks cluster init script

Re: maven libraries installation issue on 11.3/12.2 LTS