- 8228 Views
- 33 replies
- 5 kudos
Databricks to SFTP: Connection Fails Even with Whitelisted NAT Gateway IP
Hi community,I’m experiencing a strange issue with my connection from Databricks to an SFTP server.I provided them with an IP address created for Databricks via a NAT gateway, and that IP is whitelisted on their side. However, even though I have the ...
- 8228 Views
- 33 replies
- 5 kudos
- 5 kudos
Hi @szymon_dybczak , Thanks for the suggestion. I tried to attach the ip address to the NAT but it requires a NAT also to have an internet routing preference and Azure doesn't allow that. Quite a unique scenario indeed. We have created a workaround n...
- 5 kudos
- 2827 Views
- 7 replies
- 1 kudos
missing github email address in commits
Hello everyone, I would like to configure github client on my databricks workspace. Especially an email address in not visible and is replace by my github user name. Do you know how I can do that?
- 2827 Views
- 7 replies
- 1 kudos
- 1 kudos
@Louis_Frolio Hi Louis,I am using Enterprise databricks version. Could you please share the exact name of the features that needs to be enabled that I can ask my account team to enable this for us ?Thanks
- 1 kudos
- 1346 Views
- 1 replies
- 1 kudos
Databricks RoadMap
Is there any RoadMap delivered by Databricks Team ? I'm doing some tests in my enviroment in order to decide if I will use Databricks as my GenAI platform. However, there are a lot of features in beta stage that can be usefull or not, and to properly...
- 1346 Views
- 1 replies
- 1 kudos
- 1 kudos
Hey Pedro, Databricks does not have a public-facing roadmap. Cheers, Lou.
- 1 kudos
- 1793 Views
- 1 replies
- 0 kudos
Error installing python dependencies
Hi guys! At first, I am sorry if my question is dumb but I am newbie to Databricks! I am just starting and as I try to install ibm_db as a dependency for my python notebook, I get this error :Collecting ibm_db (from -r /tmp/tmp-e8a4538f00b7498fab13c2...
- 1793 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @FRB1984 ,It looks like the ibm_db package doesn’t support the Python version currently used in your Databricks environment.Instead of relying on ibm_db, you can use Spark’s JDBC connector with the IBM DB2 JDBC driver for a more stable and support...
- 0 kudos
- 3240 Views
- 5 replies
- 4 kudos
Resolved! community portal needs some updates
Hello databricks teamcan you please make me understand the search bar on community portal doesnt show results. is it for me or for everyone?Also this portal needs good updates.
- 3240 Views
- 5 replies
- 4 kudos
- 4 kudos
@Advika Hey thank you so much. Just wow. Its working now. I dont know what you did but it works as expected. thank you so much
- 4 kudos
- 1079 Views
- 2 replies
- 0 kudos
Share notebooks with a AD-user assigned via group
Hi everybody,I try to share a notebook with a user that was assigned to the workspace via a AD-Group (using the new automatic sync). But I only see users directly assigned to the workspace. My expectation would be that I see all users that are within...
- 1079 Views
- 2 replies
- 0 kudos
- 0 kudos
Here are some helpful tips/tricks, and general guidance. Sharing notebooks with users who are members of Active Directory (AD) groups can sometimes be challenging due to the way Azure Databricks handles user permissions. Here are some important poi...
- 0 kudos
- 4275 Views
- 1 replies
- 0 kudos
Workspace creation is getting failed constanly
We are trying to create a workspace with custome VPC. But the creation is getting failed constantly.The error doesn't have any description which makes the troubleshoting hard.Does anyboday had similar issue like this before and has a solution? Thanks...
- 4275 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Nisha, If you are still having the issue, I recommend opening a Support ticket with the workspace ID and any error details so that we can investigate. Regards Kamal
- 0 kudos
- 1681 Views
- 2 replies
- 0 kudos
Error with file events in external location (via pub/sub)
Hi everyone!I am new here and in Databricks world.I was trying to enable a trigger event on file uploading in GCP bucket in order to start a job following this tutorial: https://docs.databricks.com/gcp/en/connect/unity-catalog/cloud-storage/manage-ex...
- 1681 Views
- 2 replies
- 0 kudos
- 0 kudos
Hey @hmnilp did you contact databricks, may be there is a feature to be enabled.
- 0 kudos
- 8426 Views
- 8 replies
- 2 kudos
Resolved! Creating Azure Databricks Workspace Without NAT Gateway
Hello,Recently, when I create a new Databricks workspace on Azure, it automatically create a NAT Gateway which incurs additional cost !When creating the workspace, I don't choose secure cluster connectivity, so I'm expecting not to have a NAT Gateway...
- 8426 Views
- 8 replies
- 2 kudos
- 2 kudos
Make sure to disable the following option when creating your workspace, as it has recently become enabled by default.Deploy Azure Databricks workspace with Secure Cluster Connectivity (No Public IP)
- 2 kudos
- 1714 Views
- 2 replies
- 1 kudos
Resolved! How do I access Hive Metastore via API?
Hi,Is there any Databricks REST API to directly access Hive Metastore tables (like list of tables, schemas, columns) without using Unity Catalog or SQL Warehouse?I’m specifically looking to fetch metadata from hive_metastore.Thanks.
- 1714 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Ninad-Mulik ,As far as I know, there’s no Databricks REST API to directly access Hive Metastore metadata without using Unity Catalog or SQL Warehouses. The legacy Hive Metastore only supports SQL-based queries. REST APIs for metadata access are o...
- 1 kudos
- 1908 Views
- 1 replies
- 1 kudos
Resolved! Guidance on Managing Databricks Apps Whitelisting
Hi,Our workspace users currently have permissions to create Databricks apps, and we’ve observed a rise in associated costs. To address this, we’re developing an administrative notebook to:Check whether an app is whitelisted/approved from the admins.A...
- 1908 Views
- 1 replies
- 1 kudos
- 1 kudos
Here are some helpful tips that you might find useful: Summary of Best Practices and Recommendations for App Whitelisting and Automated App Removal in Databricks 1. Overview and Whitelisting Strategy To control costs and maintain governance over Da...
- 1 kudos
- 3097 Views
- 1 replies
- 2 kudos
Delete Azure Databricks Workspace resource but reference remains in Account Console
As the title says. I have deleted both the Azure Databricks Workspace resource and the resource group it was located in. However, I can still see the workspace in the account console. Also, it appears in the response from GET https://accounts.azureda...
- 3097 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi Kim3, same problem here, did you find a solution for this?Thanks!
- 2 kudos
- 3505 Views
- 6 replies
- 1 kudos
Databricks Apps with FastAPI
I have a FastAPI Databricks App deployed to a hosted workspace. How can I call the API from external tools like Postman?P.S. I was able to call the API within the same browser.
- 3505 Views
- 6 replies
- 1 kudos
- 1 kudos
Hi,Make sure your token endpoint url is like this: https://<databricks-instance>/oidc/v1/token.Refer here for workspace-level access token: https://docs.databricks.com/aws/en/dev-tools/auth/oauth-m2mAlso make sure you have granted access of the servi...
- 1 kudos
- 1686 Views
- 3 replies
- 2 kudos
Databricks Apps
I've created a Databricks App that is essentially a REST Api in Flask. It returns a json object. Data is in sql-warehouse. It works when calling directly in browser but I want to access it with rest api and Bearer token. But when I login with a servi...
- 1686 Views
- 3 replies
- 2 kudos
- 2 kudos
Did it work, I am trying something similar? If yes, please provide how you achieved it?
- 2 kudos
- 1607 Views
- 1 replies
- 0 kudos
Is it possible to run all Python (not just Spark) via Databricks cluster from local IDE?
Hi all,When connecting to a Databricks cluster from a local IDE like VS Code, Spark operations already run on the cluster.But is there a way to route all Python code — not just Spark — to run directly on the Databricks cluster as well?Thanks!
- 1607 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @tasozgurcem! If you want your whole Python script to run on the cluster, you can either upload the file or run it as a job using the Databricks extension.Check this out: https://docs.databricks.com/aws/en/dev-tools/vscode-ext/runhttps://docs.d...
- 0 kudos
