cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

pvilasra
by New Contributor II
  • 383 Views
  • 1 replies
  • 0 kudos

Unable to access databricls workspaces

Hi Team, Previously we are able to access databricks workspaces using username and password but now its asking for token, But we dont have access to mail account with username that we are using while login. Could you please assist on the issue how ca...

  • 383 Views
  • 1 replies
  • 0 kudos
Latest Reply
pvilasra
New Contributor II
  • 0 kudos

Anyone can help on this ?

  • 0 kudos
ma10
by New Contributor
  • 263 Views
  • 0 replies
  • 0 kudos

Issue with updating email with SCIM Provisioning

Hi all,For our set-up we have configured SCIM provisioning using Entra ID, group assignment on Azure is dealt with by IdentityIQ Sailpoint, and have enabled SSO for Databricks. It has/is working fine apart from one scenario. The original email assign...

  • 263 Views
  • 0 replies
  • 0 kudos
ADuma
by New Contributor III
  • 1012 Views
  • 1 replies
  • 0 kudos

Resolved! Using Databricks Connect with PyCharm behind Proxy

I am using Databricks connect with PyCharm in order to locally develop my pipelines before deploying to Databricks. I set up authentication for databricks-connect using the following guide https://learn.microsoft.com/en-us/azure/databricks/dev-tools/...

  • 1012 Views
  • 1 replies
  • 0 kudos
Latest Reply
ADuma
New Contributor III
  • 0 kudos

I managed to solve the problem by including my login and password in the HTTPS_PROXY environment variable.I set it to something like this HTTPS_PROXY = "http://username:password@proxy.company.com:port" and databricks-connect can create spark sessions...

  • 0 kudos
joe_zhou
by New Contributor III
  • 513 Views
  • 3 replies
  • 1 kudos

Can't login to new AWS databricks workspace

Just get our first AWS Databricks workspace created by following the instructions: https://docs.databricks.com/en/admin/workspace/create-uc-workspace.htmladopted the customer-managed VPC and private link for the setup. Upon reviewing the network conf...

joe_zhou_1-1723024460015.png joe_zhou_0-1723024191031.png
  • 513 Views
  • 3 replies
  • 1 kudos
Latest Reply
joe_zhou
New Contributor III
  • 1 kudos

the problem resolved after networking team currently set the DNS to point to the endpoint. We can login through the workspace link now. 

  • 1 kudos
2 More Replies
agarg
by New Contributor II
  • 1564 Views
  • 2 replies
  • 0 kudos

Databricks REST API to fetch mount points

Is there a way to fetch workspace  mount points ( mount infos) through REST API or SQL-query  ? ( similar to the python API "display(dbutils.fs.mounts())" )  I couldn't find any REST API for the mounts in the official databricks API  documentation ( ...

  • 1564 Views
  • 2 replies
  • 0 kudos
Latest Reply
pradeep1
New Contributor II
  • 0 kudos

How to create mount points using aws Databricks with shared cluster?

  • 0 kudos
1 More Replies
pv12
by New Contributor II
  • 1131 Views
  • 4 replies
  • 3 kudos

Resolved! Does REST API usage is chargeable ?

If we use REST API to perform some operation on the Databricks cluster- like running some SQL Statements, will that be chargeable, will it costs us. 

  • 1131 Views
  • 4 replies
  • 3 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 3 kudos

Yep, to sum up - anything that requires compute power and makes the cluster to spin up will be charged.

  • 3 kudos
3 More Replies
AlbertWang
by Contributor III
  • 1054 Views
  • 3 replies
  • 1 kudos

Resolved! Confusion about SCC, NAT, and Internet connection (Azure)

Hi all,I created an Azure Databricks workspace with the below featuresDeployed in my Azure virtual network (VNet injection)Enabled Secure cluster connectivityEnabled the Back-end Private LinkI did not create and use a NAT. I found that I still can ac...

  • 1054 Views
  • 3 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @AlbertWang ,If you choose SCC option, there shouldn't be NAT gateway created. You can check that yourself if you go the managed resource group that is created when you deploying databricks workspace.When you use SCC then if you would like to have...

  • 1 kudos
2 More Replies
mushroom_posse
by New Contributor II
  • 550 Views
  • 2 replies
  • 1 kudos

Resolved! Delta sharing gold layer data within organisation but outside of Vnet

Hi all,The organisation I’m working for has a data engineering team using medallion architecture and wants to share materialised views in the gold layer to members of the organisation who do not have access to the Vnet to be delivered in power BI rep...

  • 550 Views
  • 2 replies
  • 1 kudos
Latest Reply
mushroom_posse
New Contributor II
  • 1 kudos

Thanks for that information will take it to the infrastructure team

  • 1 kudos
1 More Replies
Mysilvercloud
by New Contributor II
  • 403 Views
  • 1 replies
  • 0 kudos

Databricks Account Admin architecture

Hi,I have a couple of question regarding the Databricks Account architecture. I was given an Azure admin user to create Databricks admin account. When open the Databricks admin account console, there are some metastores already & some workspaces, whi...

  • 403 Views
  • 1 replies
  • 0 kudos
Latest Reply
Mysilvercloud
New Contributor II
  • 0 kudos

Also another question is, I have assigned a user to be account admin, but he can not see the previews in the account console? Why is that?Ok now is work, I guess Databricks API is broken!

  • 0 kudos
know-how
by New Contributor III
  • 1650 Views
  • 6 replies
  • 4 kudos

What is the Databricks equivalent of a stored procedure that works with Power BI?

Is there a way to query Databricks using Power BI, via a stored procedure or similar? In my use case the query will have multiple parameters, that the user will provide values for at runtime. I don't think Databricks notebooks can be consumed directl...

  • 1650 Views
  • 6 replies
  • 4 kudos
Latest Reply
db_20240821
New Contributor II
  • 4 kudos

Hi @BrahmareddySorry ... But Stored procedures are much more than just views. This is a big loss for DATABRICKS users. Can they not implement something  ? SOON ? 

  • 4 kudos
5 More Replies
Olfa_Kamli
by New Contributor II
  • 910 Views
  • 3 replies
  • 0 kudos

Config sso and user provioning on databricks via terraform or api

Hi All,I am looking for a way to automate SSO configuration and user provisioning on Databricks. I see that this is feasible via the Databricks console, as documented SSO in your Databricks account console | Databricks on AWS. However, I am not sure ...

  • 910 Views
  • 3 replies
  • 0 kudos
Latest Reply
alex43
New Contributor II
  • 0 kudos

I am also looking to configure SSO in databricks using REST API. Were you able to figure out a way to do that?Thanks

  • 0 kudos
2 More Replies
EdsonDEV
by New Contributor
  • 200 Views
  • 0 replies
  • 0 kudos

Error on github association

Hello,I'm having an error when trying to link a GitHub account to store some scripts. Looks like my profile keeps on eternal loading too. Does anyone know how I can fix that?

  • 200 Views
  • 0 replies
  • 0 kudos
Rajatkumar002
by New Contributor
  • 1253 Views
  • 1 replies
  • 1 kudos

session expired Error

Within two minutes of logging into Databricks Community Edition, I am receiving the following error message: "Session expired." The session has ended; please log in again." I've attempted to log in again, but the message "Authenticate the session is ...

  • 1253 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @Rajatkumar002 ,You can check now. I think it's been resovled now.

  • 1 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels