cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Experiencing Performance Issues When Using Databricks as a Transactional System with .NET App

usman_naseem
New Contributor

Hello everyone,

We are currently facing performance issues when using Databricks as a transactional system with our .NET application via the Simba ODBC driver. Specifically, queries are taking 30 seconds to 1 minute to insert data into 8 to 10 tables, each having max to 400 records.

We also tested the Cdata ODBC and Cdata ADO.NET drivers for a proof of concept, but the results were not satisfactory. (https://www.cdata.com/drivers/).

Given the situation, we are considering switching to PostgreSQL as the transactional system for our .NET application, and then implementing a nightly data pipeline to incrementally load data from PostgreSQL into Databricks.

Before making this change, we would appreciate any suggestions on how we might improve performance with the current setup. Alternatively, do you think switching to PostgreSQL as the transactional system is the best approach?

Your expert opinions would be greatly appreciated. Thank you!

 

0 REPLIES 0

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group