- 2796 Views
- 1 replies
- 0 kudos
Connection Error
I am getting this type of erro "com.databricks.spark.sqldw.SqlDWConnectorException: Exception encountered in Azure Synapse Analytics connector code" while loading the data into Synapse. I am able to load other tables with the same connection. Not sur...
- 2796 Views
- 1 replies
- 0 kudos
- 0 kudos
The error message you provided indicates that an exception occurred in the Azure Synapse Analytics connector code while loading data into Synapse. This can happen due to various reasons, such as issues with the table structure, data type compatibilit...
- 0 kudos
- 15299 Views
- 2 replies
- 0 kudos
How to move from an embedded spark inside a spring boot microservices to azure databricks?
Hi, My question will be more about the architecture solutions and potential implementation of these solutions.The project :Multiple microservices each one deployed on a Tomcat and each Tomcat is running in one of the tree VM existing in Azure.Each mi...
- 15299 Views
- 2 replies
- 0 kudos
- 0 kudos
My main question is why you use spark in the first place, but that is another discussion.If you want to use databricks, you will have to launch a spark job in one way or another on the databricks cluster with spark-submit or by using the jobs api.How...
- 0 kudos
- 8525 Views
- 0 replies
- 0 kudos
Is CVE-2023-22946 managed by databricks?
Hi Databricks,We want to understand a vulnerability issue - CVE-2023-22946.does this CVE affect Azure databricks users? Does it affect data plane? Is it managed by databricks? Should end users do anything to mitigate it if this issue is a shared res...
- 8525 Views
- 0 replies
- 0 kudos
- 2470 Views
- 1 replies
- 0 kudos
Number of DBU's utilized in Azure
We would like to know the number of DBU's utilized cluster level/workspace level which was hosted in Azure. We were able to see the amount spend but not able to see the DBU's. If we get any idea of no.of DBU's it would help us to think of reserved DB...
- 2470 Views
- 1 replies
- 0 kudos
- 0 kudos
@Mani Teja G​ we don't have screen like aws for azure, but in azure you can monitor everything in cost management --> cost analysis and select tags as Databricks
- 0 kudos
- 1169 Views
- 1 replies
- 1 kudos
How to get Azure Databricks Workspaces databricks unit (DBU)?
Is there a way to get the databricks units (DBU) for an existing Azure databricks workspace?
- 1169 Views
- 1 replies
- 1 kudos
- 1 kudos
I'm keen to know this as well.
- 1 kudos
- 6349 Views
- 4 replies
- 7 kudos
Resolved! Architecture choice, streaming data
I have sensor data coming into Azure Event Hub and need some help in deciding how to best ingest it into the Data Lake and Delta Lake:Option 1:azure event hub > databricks structured streaming > delta lake (bronze)Option 2:azure event hub > event hu...
- 6349 Views
- 4 replies
- 7 kudos
- 7 kudos
If batch job is possible and you need to process data I would use probably:azure event hub from (events after previous job run) > databricks job process as dataframe > save df to delta lakeno streaming or capturing needed in that case
- 7 kudos
- 825 Views
- 1 replies
- 0 kudos
- 825 Views
- 1 replies
- 0 kudos
- 0 kudos
One way to increase the CIDR range id the ip list is available or create a complete different work space on same vpc with different subnets
- 0 kudos
- 1203 Views
- 1 replies
- 0 kudos
- 1203 Views
- 1 replies
- 0 kudos
- 0 kudos
All Databricks workspaces are deployed with this setting as of Q1 of 2021.
- 0 kudos