cancel
Turn on suggestions
Showing results for 
Search instead for 
Did you mean: 
Help
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Turn on suggestions
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
Dharinip
by • New Contributor III
  • 3133 Views
  • 1 replies
  • 0 kudos

Connection Error

I am getting this type of erro "com.databricks.spark.sqldw.SqlDWConnectorException: Exception encountered in Azure Synapse Analytics connector code" while loading the data into Synapse. I am able to load other tables with the same connection. Not sur...

Administration & Architecture
Reply
  • 3133 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Anonymous
Not applicable
  • 0 kudos

The error message you provided indicates that an exception occurred in the Azure Synapse Analytics connector code while loading data into Synapse. This can happen due to various reasons, such as issues with the table structure, data type compatibilit...

  • 0 kudos
JH
by • New Contributor II
  • 8817 Views
  • 0 replies
  • 0 kudos

Is CVE-2023-22946 managed by databricks?

Hi Databricks,   We want to understand a vulnerability issue - CVE-2023-22946.   does this CVE affect Azure databricks users? Does it affect data plane?Is it managed by databricks?Should end users do anything to mitigate it if this issue is a shared ...

Administration & Architecture
Reply
  • 8817 Views
  • 0 replies
  • 0 kudos
Teja07
by • New Contributor II
  • 2829 Views
  • 1 replies
  • 0 kudos

Number of DBU's utilized in Azure

We would like to know the number of DBU's utilized cluster level/workspace level which was hosted in Azure. We were able to see the amount spend but not able to see the DBU's. If we get any idea of no.of DBU's it would help us to think of reserved DB...

Administration & Architecture
Reply
  • 2829 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
karthik_p
Esteemed Contributor
  • 0 kudos

@Mani Teja G​ we don't have screen like aws for azure, but in azure you can monitor everything in cost management --> cost analysis and select tags as Databricks

  • 0 kudos
baatchus
by • New Contributor III
  • 7031 Views
  • 4 replies
  • 7 kudos

Resolved! Architecture choice, streaming data

I have sensor data coming into Azure Event Hub and need some help in deciding how to best ingest it into the Data Lake and Delta Lake:   Option 1: azure event hub > databricks structured streaming > delta lake (bronze)   Option 2: azure event hub > e...

Administration & Architecture
Reply
  • 7031 Views
  • 4 replies
  • 7 kudos
View Replies
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 7 kudos

If batch job is possible and you need to process data I would use probably:azure event hub from (events after previous job run) > databricks job process as dataframe > save df to delta lakeno streaming or capturing needed in that case

  • 7 kudos
3 More Replies
Anonymous
by • Not applicable
  • 1014 Views
  • 1 replies
  • 0 kudos

What is the recommendation if I am running out of IP ranges in the subnets?

Administration & Architecture
Reply
  • 1014 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
User16826994223
Honored Contributor III
  • 0 kudos

One way to increase the CIDR range id the ip list is available or create a complete different work space on same vpc with different subnets

  • 0 kudos
Top