- 1801 Views
- 4 replies
- 0 kudos
Databricks Default Catalog with House Icon
Hi everyone,I have a question regarding workspace catalogs in Databricks with Unity Catalog.In our setup, when a new workspace is created and automatically assigned to a Unity Catalog metastore (with automatic workspace catalog creation enabled), a c...
- 1801 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi @vziog, I can see the earlier suggestion about using the kebab menu Rename didn't fully solve the problem. There are actually a few distinct concepts at play here, and understanding the difference is the key. WHAT IS THE WORKSPACE CATALOG (HOUSE I...
- 0 kudos
- 3632 Views
- 6 replies
- 0 kudos
Resolved! Any documentation mentioning connectivity from Azure SQL database connectivity to Azure Databricks
Any documentation available to connect from the Azure SQL database to Azure Databricks SQL workspace. We created a SQL warehouse personal access token for a user in a different team who can connect from his on-prem SQL DB to Databricks using the conn...
- 3632 Views
- 6 replies
- 0 kudos
- 779 Views
- 2 replies
- 1 kudos
Resolved! Any recommended way for a different app to start their dependent job based on Databricks job?
How can we configure a job in a different Azure application to be triggered after the completion of an Azure Databricks job? Once the Databricks job is successful, the job in the third-party application hosted in Azure should start. I attempted to us...
- 779 Views
- 2 replies
- 1 kudos
- 1 kudos
Thank you. Thank you for the detailed answer!I have tested the Azure function way and also using an Azure runbook as well. Both works fine.Also tested the option of adding as the final task and a condition to "if all other notebooks" successful, the...
- 1 kudos
- 22684 Views
- 5 replies
- 1 kudos
Resolved! databricks OAuth is not supported for this host
I'm trying to deploy using Databricks Asset Bundles via an Azure DevOps pipeline. I keep getting this error when trying to use oauth:Error: default auth: oauth-m2m: oidc: databricks OAuth is not supported for this host. Config: host=https://<workspac...
- 22684 Views
- 5 replies
- 1 kudos
- 1 kudos
Hi @bradleyjamrozik, thank you for posting your question. You will need to use ARM_ variables to make it work Specifically ARM_CLIENT_ID ARM_TENANT_ID ARM_CLIENT_SECRET https://learn.microsoft.com/en-us/azure/databricks/dev-tools/auth#environment-3 f...
- 1 kudos
- 2859 Views
- 19 replies
- 13 kudos
Resolved! Databricks kicking me out every 2 minutes
After the session expire every 2 minutes as show below, I can't log in afterwards as shown further below. What the heck is this? Then I have to wait the platform own will to allow me to log in many minutes later.
- 2859 Views
- 19 replies
- 13 kudos
- 13 kudos
I can definitely tell it's improved—it's been 30 minutes and it hasn't logged me out yet.Thank you so much!
- 13 kudos
- 5866 Views
- 15 replies
- 2 kudos
Need Help - System tables that contains all databricks users, service principal details !!
Hi all - I am trying to create a dashabord where I need to list down all users and service principals along with groups and understand their databricks usages. Is there any table available in Databricks that contains user, service principal details. ...
- 5866 Views
- 15 replies
- 2 kudos
- 669 Views
- 1 replies
- 1 kudos
Custom MCP for Genie via Apps
I wanted to create a custom MCP to help Genie generate some code - its a simple API callI had everything set up - the app, the secrets, everything was deployedBut Genie won't connect, and when I try to add "On Behalf of User Authorization" roles it d...
- 669 Views
- 1 replies
- 1 kudos
- 1 kudos
Check these: First, make sure you're adding the authorization roles through the App's settings in the workspace where Genie will actually use it, not just where you developed it. The roles need to be set in the target workspace. Second, try refreshin...
- 1 kudos
- 527 Views
- 1 replies
- 1 kudos
OJDBC8 stoped working on LTS 17.3
Hi, we upgraded our clusters to LTS 17.3 as we needed some functionality from that release and our OJDBC8 drivers have stopped working. Downgraded back to LTS 14 and its all fine again.What are the latest OJDBC drivers that are compatible with LTS 1...
- 527 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @ScottDunk, Looking at the release notes for LTS 14 and LTS 17.3, it appears to be a compatibility issue... LTS 14:LTS 17.3: As you can see from the images above, Databricks 17.3 LTS upgrades the cluster JVM to Java 17. Oracle’s own compatibility ...
- 1 kudos
- 720 Views
- 1 replies
- 1 kudos
Resolved! DLT pipeline production deployment with AWS
Hi,We are currently working with pyspark where we are doing the ETL as well as data quality check. We are converting our code in to the wheel package to go in to the prod and manage the version for better stability.We are running Databricks with AWS...
- 720 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @satycse06, Have you considered Declarative Automation Bundles (Previously called Databricks Asset bunddles) for this? This is exactly the type of problem it solves. You can still keep your DLT code and a databricks.yml bundle file in Azure DevOps...
- 1 kudos
- 3308 Views
- 4 replies
- 3 kudos
Resolved! Security & Compliance understanding on LLM Usage in Databricks Genie and Agentbricks
Hi everyone,With the increasing focus on security and compliance for AI Agents and LLMs, I wanted to get some clarity on a couple of points related to Databricks Genie and Agentbricks.Could someone help provide detailed information on the following, ...
- 3308 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @abhijit007, Please take a look at these pages. They answer your queries in detail for Genie. https://docs.databricks.com/genie - Covers architecture and how it works. Also covers security. https://docs.databricks.com/databricks-ai/databricks-ai-...
- 3 kudos
- 1176 Views
- 2 replies
- 1 kudos
Resolved! Newly added workspace users do not appear immediately in WorkspaceClient().users.list() or SCIM API
Hello,I’m trying to retrieve the list of users in a Databricks workspace.I am currently using both the Databricks SDK and the SCIM API: from databricks.sdk import WorkspaceClient w = WorkspaceClient() users = list(w.users.list())and also: import re...
- 1176 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @discuss_darende, I agree with Pradeep here. In practice, there can be a delay before the identity and its memberships are fully visible everywhere, especially if you’re on Azure and using AIM or a SCIM connector from your IdP. The delay isn’t do...
- 1 kudos
- 1215 Views
- 1 replies
- 0 kudos
Issues when configuring keystore spark config for pyspark to mongo atlas X.509 connectivity
Step followed - Step1: To add init script that will copy the keystore file in the tmp location.Step2: To add spark config in cluster advance options - spark.driver.extraJavaOptions -Djavax.net.ssl.keyStore=/tmp/keystore.jks -Djavax.net.ssl.keyStorePa...
- 1215 Views
- 1 replies
- 0 kudos
- 0 kudos
The error isn’t actually about MongoDB. HikariCP failing on port 3306 via DataNucleus is your Hive Metastore losing its SSL connection to MySQL on the driver.Setting javax.net.ssl.keyStore globally in extraJavaOptions overwrites the default JVM trust...
- 0 kudos
- 2208 Views
- 3 replies
- 0 kudos
Resolved! How can i run a single task in job from Rest API
How can I run a single task in a job that has many tasks?I can do it in the UI, but I can’t find a way to do it using the REST API. Does anyone know how to accomplish this?
- 2208 Views
- 3 replies
- 0 kudos
- 0 kudos
It looks like this may be a possibility now? I haven't actually tried it, but I noticed a parameter named "only" has been added to the Databricks SDK for when running a job. Here is the commit that made the change: [Release] Release v0.38.0 (#826) · ...
- 0 kudos
- 958 Views
- 3 replies
- 0 kudos
Resolved! Migrating notebooks from Old databricks community instance
I didn't migrate my notebooks from the old community instance. Now I can not login. How can I access the old instance or the materials therein? Please help, I had tons of notebooks in there
- 958 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @RichardWanjohi ,Unfortunately, Databricks Community Editon has been shutdown at January 1, 2026. So there's no way to restore your content. From now on you should use Free Edition.This was announced several times and they asked every user to back...
- 0 kudos
- 1289 Views
- 1 replies
- 1 kudos
Resolved! Copy files from /tmp to abfss location
I have a notebook which generates a bunch of excel and pdf reports. These reports needs to be sent out through email and also needs to be archived in external location. i am able to generate these reports in the /tmp file and then send them as attach...
- 1289 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @deepu, The reason it isn't working is that Python’s shutil only understands local/POSIX-style paths, not abfss:// URIs, and dbutils.fs expects Databricks-style paths (e.g., file:/..., /Volumes/...). The recommended pattern for this is.. Write re...
- 1 kudos
