- 71 Views
- 4 replies
- 0 kudos
NAT Gateway with Azure Databricks
Hi all, what are the steps to enable external communication through a NAT Gateway? Our Databricks instance was created through VNET injection and did not have a NAT gateway created by default. We now want to pass external traffic through NAT gateway ...
- 71 Views
- 4 replies
- 0 kudos
- 0 kudos
I made the changes and it works! I was able to communicate to the NAT Gateway IP in our external on-prem application.I noticed though that Databricks instance is not showing the NAT Gateway within Parameters. Is this an issue?
- 0 kudos
- 7 Views
- 0 replies
- 0 kudos
Alert ACL's not available
The list of available ACL's for alerts suggests there's a way to set "can run" and "can manage" permissions but neither the REST API nor the Databricks CLI show options for setting permissions. Is there a way to set acl's on alerts? If so, how?Alert ...
- 7 Views
- 0 replies
- 0 kudos
- 72 Views
- 3 replies
- 1 kudos
Question regarding permission of azure databricks account console
We are facing an issue while onboarding pipelines to Azure Databricks.Our Databricks environment is deployed on an Azure subscription where all of us have owner permissions. However, we're encountering problems when trying to access the Azure Databri...
- 72 Views
- 3 replies
- 1 kudos
- 1 kudos
Hello, Databricks admin account console is not linked to your Azure subscriptions.If you are owner of your sub, you will be admin of the workspaces instanciated in the sub. That's all.You need to find the identified Databricks admin for your company ...
- 1 kudos
- 35 Views
- 0 replies
- 0 kudos
Windows ODBC connection error
Hi all,I'm just started learning Databricks and have created a community-level workspace and loaded few tables.Now I'm trying to get access to the data from Excel ODBC connector following the guide here:https://docs.databricks.com/en/integrations/exc...
- 35 Views
- 0 replies
- 0 kudos
- 78 Views
- 1 replies
- 1 kudos
Spark event log frequently missing rollover logs
Hi,We are currently using the event log to gain some visibility to what spark is doing under the hood but we frequently find that rollover logs are missing and we are left with a partial set. Is there a reason for this or a bug being tracked? Is ther...
- 78 Views
- 1 replies
- 1 kudos
- 1 kudos
I'm also having this issue , it seems to occur much more frequently on azure than aws, but even on aws jobs sometimes some of the logs will be missing
- 1 kudos
- 202 Views
- 2 replies
- 0 kudos
Reverse colors in dark mode
It seems that Databricks implements its dark mode by applying the invert filter so that all colors are reversed. This is problematic if one wants to create some sort of html widget or rich output since this filter is passed down to the result of disp...
- 202 Views
- 2 replies
- 0 kudos
- 67 Views
- 0 replies
- 0 kudos
Lakehouse federation -' on behalf of ' queries
Is it possible to achieve the following in a lake-house federation setup using Azure Databricks?1. Establish an external connection (EC1) to an external data source (EDS) using the credentials of user U1.2. Create a foreign catalog (FC1) utilizing EC...
- 67 Views
- 0 replies
- 0 kudos
- 63 Views
- 1 replies
- 0 kudos
Features tab under Machine learning shows error
Cannot resolve metastore id, go back. FeatureStoreError- Workspace Feature Store has been deprecated in the current workspace. Databricks recommends using Feature Engineering in Unity Catalog. Please reach out to system admin if you have any more que...
- 63 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @rutuja1,Could it be that this one workspace that has this problem is not configured to use Unity Catalog?
- 0 kudos
- 80 Views
- 1 replies
- 0 kudos
How to access smtplib with ACL enables cluster
I am having a tough time to connect to smtp server from databricks with ACL enabled cluster , I am able to access with out ACL enabled cluster what can be done to access it via ACL enabled cluster import smtplibfrom email.mime.multipart import MIMEMu...
- 80 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @unalluri9999 ,What error do you get? By ACL you mean IP access lists or something different? Your workspace is vnet injected?
- 0 kudos
- 71 Views
- 0 replies
- 0 kudos
Streaming job update
Hi! Using bundles, I want to update a running streaming job. All good until the new job gets deployed, but then the job needs to be stopped manually so that the new assets are used and it has to be started manually. This might lead to the job running...
- 71 Views
- 0 replies
- 0 kudos
- 110 Views
- 0 replies
- 3 kudos
Databricks "Page Not Responding" Error Affecting All Users
For the past two days, our entire project team has been experiencing a recurring "Page Not Responding" error in Databricks. This issue occurs roughly every five minutes, making it impossible to run any code effectively.What's notable is that this pr...
- 110 Views
- 0 replies
- 3 kudos
- 764 Views
- 4 replies
- 0 kudos
Open Delta Sharing and Deletion Vectors
Hi,Just experimenting with open delta sharing and running into a few technical traps. Mainly that if deletion vectors are enabled on a delta table (which they are by default now) we get errors when trying to query a table (specifically with PowerBI)...
- 764 Views
- 4 replies
- 0 kudos
- 0 kudos
I am also experiencing this issue when connecting through Power BI connector. @DrK did you manage to solve it?
- 0 kudos
- 82 Views
- 0 replies
- 0 kudos
Survey about cluster configuration and optimization
Hi everyone, I hope you are very well.In the research for my university we are conducting a survey to Databricks users, aimed to gather information about how cluster configuration and optimization is faced in the industry.If you like you can answer i...
- 82 Views
- 0 replies
- 0 kudos
- 87 Views
- 0 replies
- 0 kudos
Adding service principal with Microsoft Entra ID fails
Hi,I am trying to add a service principal using Microsoft Entre ID, but I encounter an issue as described in the following documentation: https://learn.microsoft.com/en-us/azure/databricks/dev-tools/auth/oauth-m2m.I followed the instructions step by ...
- 87 Views
- 0 replies
- 0 kudos
- 2368 Views
- 2 replies
- 0 kudos
Error running 80 task at same time in Job, how limit this?
Hi! I have a Job running to process multiple streaming tables. In the beginning, it was working fine, but now I have 80 tables running in this job, the problem is that all the runs are trying to run at the same time throwing an error. Is there a way ...
- 2368 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Maxi1693, It appears that you’re encountering issues with parallel execution of tasks in your Databricks job. Let’s address this by considering a few strategies: Concurrency Limit for Tasks: Databricks allows a maximum of 1000 concurrent tas...
- 0 kudos
