- 5138 Views
- 2 replies
- 3 kudos
Resolved! How can I set the data access for each SQL warehouse individually?
As far as the official documentation from Microsoft says and I understood it correctly, each SQL warehouse uses the same service principal for data access. But I want to control the access to the data (Azure Data Lake Storage) for each SQL warehouse ...
- 5138 Views
- 2 replies
- 3 kudos
- 3 kudos
It can be done but it's very tricky. You should create a service principal to whom you will grant permission over some tables then you can generate a token using the SP to access only this data.
- 3 kudos
- 15886 Views
- 2 replies
- 0 kudos
How to move from an embedded spark inside a spring boot microservices to azure databricks?
Hi, My question will be more about the architecture solutions and potential implementation of these solutions.The project :Multiple microservices each one deployed on a Tomcat and each Tomcat is running in one of the tree VM existing in Azure.Each mi...
- 15886 Views
- 2 replies
- 0 kudos
- 0 kudos
My main question is why you use spark in the first place, but that is another discussion.If you want to use databricks, you will have to launch a spark job in one way or another on the databricks cluster with spark-submit or by using the jobs api.How...
- 0 kudos
- 2593 Views
- 0 replies
- 0 kudos
Unity Catalog - Cluster Access Mode - Change Management
Hi all,I am curious to know how you handled change management when rolling out changes to cluster access modes (single user, shared) applicable to UC, especially when there is a centralized platform team offering Infrastructure Deployment services vi...
- 2593 Views
- 0 replies
- 0 kudos
- 8575 Views
- 2 replies
- 2 kudos
Resolved! What is the advantages and disadvantages of setting up log-delivery at account vs workspace level?
- 8575 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @janaki jagadeesh​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answ...
- 2 kudos
- 3195 Views
- 2 replies
- 0 kudos
Resolved! Does CVE-2020-13949 (vulnerability) affect the data plane and its security patch is included in Databricks 10.4 LTS?
Here is the previous discussion. https://community.databricks.com/s/question/0D58Y0000ACcIv2SQF/does-thrift-only-exist-in-databrick-control-planeI have the following questions.Does CVE-2020-13949 affect the data plane or not?Do you know from which ve...
- 3195 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Jimin Hsieh​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so w...
- 0 kudos
- 8706 Views
- 0 replies
- 0 kudos
Is CVE-2023-22946 managed by databricks?
Hi Databricks,We want to understand a vulnerability issue - CVE-2023-22946.does this CVE affect Azure databricks users? Does it affect data plane? Is it managed by databricks? Should end users do anything to mitigate it if this issue is a shared res...
- 8706 Views
- 0 replies
- 0 kudos
- 2641 Views
- 1 replies
- 0 kudos
Number of DBU's utilized in Azure
We would like to know the number of DBU's utilized cluster level/workspace level which was hosted in Azure. We were able to see the amount spend but not able to see the DBU's. If we get any idea of no.of DBU's it would help us to think of reserved DB...
- 2641 Views
- 1 replies
- 0 kudos
- 0 kudos
@Mani Teja G​ we don't have screen like aws for azure, but in azure you can monitor everything in cost management --> cost analysis and select tags as Databricks
- 0 kudos
- 1736 Views
- 1 replies
- 0 kudos
How can I set up a DBU usage alert
Hi,I would like to set up a DBU usage alert, such that I will get an email notification when the DBU usage of last X hour exceeds the budget.How can I do that?Thanks,Kit
- 1736 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Kit Yam Tse​ You can download and analyse usage logs to monitor the DBUs.Check this out: https://docs.databricks.com/administration-guide/account-settings-e2/usage.htmlwe also have usage analysis dashboard notebook:https://docs.databricks.com/...
- 0 kudos
- 1330 Views
- 1 replies
- 1 kudos
How to get Azure Databricks Workspaces databricks unit (DBU)?
Is there a way to get the databricks units (DBU) for an existing Azure databricks workspace?
- 1330 Views
- 1 replies
- 1 kudos
- 1 kudos
I'm keen to know this as well.
- 1 kudos
- 3520 Views
- 2 replies
- 0 kudos
Access Ganglia metrics via endpoint
How to access the raw Ganglia metrics. Is there an endpoint or a DBFS storage it belongs to?
- 3520 Views
- 2 replies
- 0 kudos
- 1382 Views
- 1 replies
- 0 kudos
How do I get the cost of my notebook run?
How do I get the cost of my notebook run?
- 1382 Views
- 1 replies
- 0 kudos
- 10457 Views
- 2 replies
- 1 kudos
Resolved! How can we pause jobs?
- 10457 Views
- 2 replies
- 1 kudos
- 1 kudos
how to update the schedule via the Jobs API (it would be within the Cron Schedule field).
- 1 kudos
- 10078 Views
- 9 replies
- 0 kudos
Resolved! AWS Databricks Pay-as-you-Go
Hi Team,We are currently using AWS cloud service for our AI/ML Project. We wanted to use Databricks based GPU service for model training purposes. We do not find a Pay-as-you-go option in marketplace for this purposes.Can someone help me on this !Tha...
- 10078 Views
- 9 replies
- 0 kudos
- 0 kudos
https://databricks.com/product/aws-pricingI guess you try to roll out something else?
- 0 kudos
- 4148 Views
- 4 replies
- 4 kudos
Resolved! Databricks and DDD
Our architecture is according to Domain Driven Design. The data is therefore distributed among different domains.We would like to run workloads on top of our data but we would like to avoid to have a dedicated (duplicated) data lake just for Databric...
- 4148 Views
- 4 replies
- 4 kudos
- 4 kudos
So basically you do not want to persist data outside of your source systems.I think the so called 'Kappa architecture' could be a fit, where everything is treated like a stream.Hubert already mentioned Kafka, which is an excellent source to build thi...
- 4 kudos
- 3589 Views
- 4 replies
- 5 kudos
Resolved! GDPR/LGPD Compliance
How do you work to compliance the GDPR/LGPD, in special to people data ?have any suggestion ?
- 3589 Views
- 4 replies
- 5 kudos
- 5 kudos
there is identifying PII data and handling/storing PII data.Identifying can be done with Purview, Macie, other tools. Those are not free ofc, so if your env is pretty big it can be interesting. Otherwise, you could also do manual checks.For storin...
- 5 kudos
