- 1916 Views
- 2 replies
- 0 kudos
Resolved! Architecture With the Enhanced Security and Compliance Add-On
Morning everyone! Wondering if someone has a high-level reference architecture of Databricks on AWS that includes the Enhanced Security and Compliance Add-On??thanks,Brad
- 1916 Views
- 2 replies
- 0 kudos
- 0 kudos
@sheridan06 please check this documentation: https://www.databricks.com/trust/security-features/protect-your-data-with-enhanced-security-and-compliance Let us know if it helps.
- 0 kudos
- 2129 Views
- 2 replies
- 0 kudos
Disabled S3 bucket version, Next steps?
We have been using Databricks for some time and didn't knew that S3 bucket versioning was not recommended. We have disabled it now. What are the next steps that we need to take to clean up the data, should we create a lifecycle rule to delete older v...
- 2129 Views
- 2 replies
- 0 kudos
- 0 kudos
Adding lifecycle policies to databricks s3 bucket does not impact existing data, is that correct @Yeshwanth .
- 0 kudos
- 1695 Views
- 1 replies
- 0 kudos
Resolved! Set Deafult Cluster
HelloIs there a way to set one of the clusters in my workspace to be the default cluster when choosing from list of available clusters when running my Code?Thanks in Advanced.
- 1695 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Krubug ,Thanks for bringing up your concerns, always happy to help Upon checking internally, it seems that we do not currently support setting a default cluster for the workspace. But we do have a Feature request titled "Workspace - Settings - S...
- 0 kudos
- 3218 Views
- 4 replies
- 1 kudos
Resolved! Azure Databricks Assistant and Private Link
Hi,I was wondering if anyone is using the Databricks Assistant using the standard private link configuration of their network.Kind of curious how data is passed from the Databricks Workspace, in a private link configuration, to the Azure OpenAI servi...
- 3218 Views
- 4 replies
- 1 kudos
- 1 kudos
I asked our SA at Databricks. AWS is different if anyone is looking for that answerAzure Open AI connects to the control planeIt doe not use private endpoints, though since you are an Azure customer, the traffic stays on the Azure global network (no ...
- 1 kudos
- 3109 Views
- 1 replies
- 1 kudos
Feature request: Run cluster in a different region
We are one of those which unfortunately decided (earlier) to set up our infastructure in one of the sub-par Azure regions, and we happen to dont have any GPU clusters available.We would like to test out some GPU enhanced ML in databricks, but at the ...
- 3109 Views
- 1 replies
- 1 kudos
- 1 kudos
@Erik I think it would be really useful if we could create a cluster in another region from our normal workspace This does not seem like a possible thing for me as the Control plane resources and the Data plane resources are bound to that region. If...
- 1 kudos
- 3361 Views
- 4 replies
- 0 kudos
Language Preferences changes all day
Since a few days I have the phenomenon that the language in the Databricks Workspace always changes to German. I have to change the language back to English in the settings every day. My PC has German set as the default language, but I want to keep t...
- 3361 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi @stefankoch-OLD I had the same issue from a french perspective To fix this issue, I had to configure the Language + Region settings on the Azure portal, and set the Regional format to English (Europe) ... it was previously on France. After a ...
- 0 kudos
- 10643 Views
- 3 replies
- 4 kudos
Databricks Runtime JDK 17 upgrade
HeyI'm using Databricks Runtime 13.2 https://docs.databricks.com/en/release-notes/runtime/13.2.html#system-environmentIt uses JDK 8. Question: Is it possible to upgrade the Java version to JDK 17?Thanks!
- 10643 Views
- 3 replies
- 4 kudos
- 4 kudos
@orlik @sroeena34 JDK 17 is in public preview for Databricks runtime versions 13.1 and above. Pls refer to this https://docs.databricks.com/en/dev-tools/sdk-java.html#create-a-cluster-that-uses-jdk-17
- 4 kudos
- 2674 Views
- 2 replies
- 0 kudos
Connecting to Azure Databricks deployed using Vnet injection over Public Internet
I'm trying to connect to Azure Databricks (deployed using Vnet injection method) from a 3rd party service running on Azure in the same region. When I try to connect using the Databricks hostname directly in my connection the host name always resolves...
- 2674 Views
- 2 replies
- 0 kudos
- 0 kudos
@arpit thanks for the link and I did review the doc. But it doesn't really say whether it its always required to use an Azure Private Link to connect to databricks deployed with Vnet injection method from a 3rd party service also on deployed on Azure...
- 0 kudos
- 1537 Views
- 1 replies
- 0 kudos
AWS S3 Object Lock Timeline
Hello, I see that Object Lock is not currently supported by Databricks: https://kb.databricks.com/en_US/delta/object-lock-error-write-delta-s3Is there any timeline / roadmap for the support of this feature?
- 1537 Views
- 1 replies
- 0 kudos
- 0 kudos
@timlopez We already have a feature request created on this one. Our product team is currently reviewing this feature request and will decide further on this feature in the product roadmap.
- 0 kudos
- 1657 Views
- 1 replies
- 0 kudos
- 1657 Views
- 1 replies
- 0 kudos
- 0 kudos
@User16752244127 Please elaborate on what do you mean by "features". I am tagging a generic documentation, but if you are looking for something specific please let me know.
- 0 kudos
- 1407 Views
- 1 replies
- 0 kudos
- 1407 Views
- 1 replies
- 0 kudos
- 0 kudos
@mnziza We expect to rollout in Feb in region: Azure Australia East
- 0 kudos
- 1981 Views
- 1 replies
- 0 kudos
Azure SP OAuth wont generate token
Hi all,Hopefully someone has had this issue and fixed it before. No matter how many times I try, no token is generated (yes, i am in a premium tier). Any ideas? I tried using the API but I got this error that apparently is because I am in Azure. for ...
- 1981 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @_rafa ,Currently, we do not have an API similar to the "https://<databricks-instance>/api/2.0/token-management/on-behalf-of/tokens" in azure as Azure supports the service principle authentication by default. Please authenticate to normal PAT ...
- 0 kudos
- 3780 Views
- 1 replies
- 0 kudos
Azure Databricks SQL Warehouse tags not being populated
In Azure cost monitor I am trying to get list of my cluster names and cost associated to it.It works fine with job cluster and all purpos clusters but not for SQL Warehouses.When you look at below example, where I am querying only for my SQL Warehous...
- 3780 Views
- 1 replies
- 0 kudos
- 0 kudos
@Wojciech_BUK I would recommend you get in touch with the Azure Pricing team once to check this in a great deatil.
- 0 kudos
- 1580 Views
- 1 replies
- 0 kudos
How to delete or update cluster-scoped init scripts
We are working on to deprecate the dbfs based cluster-scoped init scripts and replace them with workspace based, therefore finding a way to delete the dbfs cluster-scoped init scripts from all the clusters that are running in our environment using RE...
- 1580 Views
- 1 replies
- 0 kudos
- 0 kudos
@dbx_8451 There is no direct way for doing it, you may need to automate using the list Cluster API.
- 0 kudos
- 2421 Views
- 1 replies
- 0 kudos
No enable option for Customize containers with Databricks Container Services on Azure and GCP
Customize containers with Databricks Container ServicesI want to create a spark cluster with the hail container [1]. But there is no Enable Container Services on the Workspace configuration for Azure Databricks and GCP Databricks.The API does not ret...
- 2421 Views
- 1 replies
- 0 kudos
- 0 kudos
Did you tested out using the cluster API ?
- 0 kudos
