I know that context-based ingress control is currently a preview feature, but it is an extremely important one. It removes the need for workspace-level IP access lists, making it much easier to govern allowed IPs centrally and preventing workspace-le...
Databricks integrating with ServiceNow via Lakeflow Connect for data ingestion and looking for guidance on enforcing integration-user based data access.Observed behaviourU2M OAuth authentication succeeds when ServiceNow access is granted to the works...
Hi @emma_s I’ve reviewed the setup and wanted to clarify the behavior I’m seeing with the ServiceNow connector and U2M OAuth.The ServiceNow connection was created successfully using a U2M OAuth integration user, and that integration user has admin pe...
Good morning, I want to create a serving endpoint with a GPU. However, I get a warning "GPU is not enabled for this workspace". Your AI chatbot is telling me I have to contact someone at Databricks. I tried this form - https://www.databricks.com/comp...
Hello everyoneI'd like to try integration of Data Bricks with on-premise Oracle database, and now I have the following fundamental questions as below about the architectures of that integration.1) I guess the following is the list of integration way...
Hi @HideK253, Your list is essentially correct. The main Databricks-native patterns are export to files + COPY INTO / Auto Loader, Lakehouse Federation and Lakeflow Connect. A couple of other options are listed below. Custom Spark JDBC jobs: spark.re...
We're using Azure Databricks and automatic identity management. Users and groups sync over automatically.If I want to grant permissions to an Entra group to a schema, I can't just run something like this in a workspace notebook:GRANT USE SCHEMA ON SC...
Hi @mzs, To make sure we suggest the right option, can you share a bit more about your setup? Cloud & workspace type: Are you on Azure Databricks, and is the workspace identity-federated (Unity Catalog enabled)?Identity sync: Are you using Automatic ...
Hello, I have been generating a Databricks personal access token in my YAML-based CI pipeline using a bash script. The pipeline installs the Databricks CLI and then creates a token using a Service Principal (Azure AD application) credentials.Current ...
Hi, I'm pretty sure what you're hitting is stricter auth detection in the newer CLI/SDK. Your error shows azure_tenant_id, client_id, and client_secret all populated, so it's seeing more than one credential type and refusing to guess between them. Th...
I don't want users using serverless interactive compute for their jobs. how do i disable it for everyone or for specific users
Btw. I just realized that at least with VNet injected workspaces you probably can prevent any sensible serverless usage by not giving permissions and network route to the needed resources. At least in Azure Databricks, notebooks need access to Databr...
HiHow do I disable Data Apps on my workspace. This is really annoying that Databricks pushes new features without any option to disable them. At least you should have some tools to control access before rolling it out. It seems you only care about fe...
I'm an account level admin and can't find any options manage creation access of Databricks Apps in the account console. Where can I limit app creation in the Account Console?
Hi guys!I faced an issue with the permission model in Databricks.Data engineers in my team are using a Pipeline that runs on serverless compute. The permissions for the pipeline are configured correctly, for example as follows:resource "databricks_pe...
Dear all,Appreciate if anyone can provide the document/source related to Naming convention that can be followed within Databricks. Regards,Aijaz
Hi @miraijaz , Databricks doesn’t enforce a single enterprise-wide naming standard, but there are a few official/public guidelines you can lean on. See the "Names" section of the SQL language reference.This covers allowed characters, length limits, a...
Workspace deployed via AWS Marketplace.Internal endpoint 10.53.215.1 exists in VPC butSSL handshake fails. Cannot connect to metastore.Workspace URL: dbc-bb08dd2f-f142.cloud.databricks.comAWS Account: 452456948535Region: us-east-1"
Databricks endpoints present certificates for hostnames like *.cloud.databricks.com (or *.privatelink.cloud.databricks.com when PrivateLink is enabled). If your client connects to https://10.53.215.1 directly, the TLS ClientHello typically lacks the ...
Hi everyone,I’m getting this error when trying to create a Git folder in Databricks:Error creating Git folderInvalid Git provider credential for repository with URL [Placeholder].How to fixPlease go to your remote Git provider to ensure that:You have...
1. Confirm HTTPS URL with .git suffix → no embedded credentials in URL Don't Use Use Insteadgit@github.com:org/repo.git (SSH)https://github.com/org/repo.githttps://github.com/org/repo (no .git)https://github.com/org/repo.githttps://user@github.com/or...
I'm experiencing an unusual issue following my return from annual leave. I'm unable to connect to any compute from a notebook (both Classic Compute and Serverless) this is despite having Can Manage permissions on the clusters.The error shown is: "Unk...
Hi all, the issue should now be mitigated. Really appreciate your patience on this!Do let us know if you’re still experiencing any problems.
Hi,I am using a medallion architecture on Azure Data Lake Storage Gen2 with Azure Databricks. Currently, I am storing data in Parquet format (not Delta tables), and I am planning to implement Unity Catalog (UC).As part of this setup, I understand tha...
I was going to follow 3rd but then it violets our medallion. And we don't have that much data to separate it physically. So going with 1st approach. But Thank you very much @karthickrs, I'll keep this in mind
Hi, I'm using Databricks in AWS environment andI'm trying to link the data from GCP GCS to Unity Catalog.[Official document]I tried to set it up by referring to the official guide of Databricks below.▶ Create service credentials guides[Problem situat...
Hi — this is expected behavior, not a bug. Unity Catalog storage credentials in the UI are cloud-specific to your workspace deployment. Since your workspace runs on AWS, you only see AWS IAM Role and Cloudflare API Token. The GCP Service Account opti...
