cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

issue with azure databricks workspace after we disable public network access

Ravikumashi
Contributor

Hi All,

We had azure databricks workspaces created thru terraform with public network access enabled to true and everything was working great. recently we have disabled the public network access and started to face issues.

terraform is uanble to add user/admins to workspace and giving us weird errors.

1. cannot read service principal: invalid charecter '<' begining of the value

2. cannot read workspace config: invalid charecter '<' begining of the value

we are using azurerm provider version 3.35.0 and databricks provider 1.7.0

And also we have private end points enabled for azure databricks workspace and it should go by private network.

Any help will be greatly appreaciated.

4 REPLIES 4

koushiknpvs
New Contributor III

Were you able to add the needed up addresses to the list in the networking settings?

Ravikumashi
Contributor

we have created a private endpoint for our azure databricks workspace is this not enough. Do we need to also explictly set up setwork security rule to allow traffic from private endpoint to databricks workspace.

Also required NSG rules for workspace is set to 'No Azure Databricks Rules' do we need to change this to 'All Rules' ?.

Could you elaborate on this please ?.

 

 

 

 

 

Ravikumashi
Contributor

we use the following code to create private endpoint and on UI we can see the private endpoint connection status as approved.

resource "azurerm_private_endpoint" "example" {
  name                = "example-endpoint"
  location            = azurerm_resource_group.example.location
  resource_group_name = azurerm_resource_group.example.name
  subnet_id           = azurerm_subnet.endpoint.id

  private_service_connection {
    name                           = "example-privateserviceconnection"
    private_connection_resource_id = azurerm_private_link_service.example.id
    is_manual_connection           = false
  }
}

After we disable public network access databricks provider is unable to add users/service principal to the azure daatbricks workspace.

@koushiknpvs 

Mohamednazeer
New Contributor III

Do you got any solution for this issue? I am also facing the same issue.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group