cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Kishore76
by New Contributor
  • 1068 Views
  • 1 replies
  • 0 kudos

Do databricks support iceberg tables

Do databricks support iceberg tables

  • 1068 Views
  • 1 replies
  • 0 kudos
Latest Reply
Fangrou
New Contributor II
  • 0 kudos

It support iceberg tables but with some Requirements and limitations, you could find détails in this doc: Incrementally clone Parquet and Iceberg tables to Delta Lake 

  • 0 kudos
dprutean
by New Contributor III
  • 1346 Views
  • 0 replies
  • 0 kudos

JDBC Driver Error

connect to databricks unity catalog and meet this error java.sql.SQLException: [Databricks][DatabricksJDBCDriver](500540) Error caught in BackgroundFetcher. Foreground thread ID: 59. Background thread ID: 61. Error caught: null. at com.databricks.cli...

  • 1346 Views
  • 0 replies
  • 0 kudos
amitca71
by Contributor II
  • 2802 Views
  • 2 replies
  • 1 kudos

performance tool for databricks sql

Hii'm looking for performance test tool.I saw that there was apost about jmeter https://stackoverflow.com/questions/66913893/how-can-i-connect-jmeter-with-databricks-spark-cluster#comment118293766_66915965 , however, the jdbc paraeters are requesting...

  • 2802 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Amit Cahanovich​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.

  • 1 kudos
1 More Replies
SubhaJ
by New Contributor III
  • 1649 Views
  • 2 replies
  • 1 kudos

Test Proctoring Issue

Hi Team,I have given the databricks associate engineer v2 test on 18th June. There were some proctoring issues on my test. They kept removing me from the test so they could thoroughly check the room. Even though they were satisfied they removed me fr...

  • 1649 Views
  • 2 replies
  • 1 kudos
Latest Reply
SubhaJ
New Contributor III
  • 1 kudos

Hi team, hope you are doing well, It's been a week or far I didn't get any response. It'll be a great help if you can look into the issue as a priority.Thanks, Subha  

  • 1 kudos
1 More Replies
nicolamonaca
by New Contributor III
  • 2557 Views
  • 2 replies
  • 0 kudos

Resolved! IoT-based scenario

Hi,We're trying to design a new solution to collect IoT data in real-time on Azure. Could you please suggest me which tools from Azure should we pick along with Databricks?

  • 2557 Views
  • 2 replies
  • 0 kudos
Latest Reply
lorenz
New Contributor III
  • 0 kudos

To build an IoT data ingestion and processing platform, you can consider using the following Azure tools and services:Azure IoT Hub: Azure IoT Hub is a fully managed service that enables reliable and secure communication between IoT devices and the c...

  • 0 kudos
1 More Replies
Srikanth_Gupta_
by Databricks Employee
  • 2371 Views
  • 2 replies
  • 1 kudos

How can I use data skipping with Delta Lake

How does data skipping work with delta lake, can I run ANALYZE TABLE COMPUTE STATISTICS with Delta lake? or Zorder going to solve these problems?

  • 2371 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
New Contributor III
  • 1 kudos

You can use Zorder with indexes for data skipping. Data skipping information is collected automatically when you write to delta table. Delta lake uses this information to provide faster query.You dont need to configure anything for data skipping as t...

  • 1 kudos
1 More Replies
Geeks
by New Contributor
  • 849 Views
  • 1 replies
  • 0 kudos

Hello Databricks

I would love Unity catalog , eager to learn more

  • 849 Views
  • 1 replies
  • 0 kudos
Latest Reply
Jsarfraz
New Contributor II
  • 0 kudos

There is a Databricks education university, you should get the account and also certified for some exam for free

  • 0 kudos
Jsarfraz
by New Contributor II
  • 477 Views
  • 0 replies
  • 0 kudos

Summit experience

SpoilerI like the overall experience, and like the data engineering training.I like the overall experience, and like the data engineering training.

  • 477 Views
  • 0 replies
  • 0 kudos
MikeTiveron
by New Contributor
  • 458 Views
  • 0 replies
  • 0 kudos

Summit

How is everyone enjoying the summit? 

  • 458 Views
  • 0 replies
  • 0 kudos
Anonymous
by Not applicable
  • 550 Views
  • 0 replies
  • 0 kudos

Daa & AI Summit

Sessions are very useful, welcome reception is very enjoyable. Thanks for the organization.

  • 550 Views
  • 0 replies
  • 0 kudos
Phkansakar
by New Contributor
  • 8123 Views
  • 0 replies
  • 0 kudos

What I learnt

I learned about how to implement and utilize databricks more efficiently. We also explored how to live tables and how to build pipelines in the vastness that we can use this in our data orchestration process.  We also explored autoloading go to live ...

  • 8123 Views
  • 0 replies
  • 0 kudos
daniel830
by New Contributor
  • 1044 Views
  • 0 replies
  • 0 kudos

Learning

I’ve learned so much I can’t put it into words!  Looking forward to more!hopefully more information on data ingestion!

  • 1044 Views
  • 0 replies
  • 0 kudos
rgnonohay
by New Contributor II
  • 606 Views
  • 0 replies
  • 0 kudos

Unity catalog

I need to setup a UC to share data among 4 different accounts. How can I do that using corporate VPC?

  • 606 Views
  • 0 replies
  • 0 kudos
Mlaricobar
by New Contributor
  • 605 Views
  • 0 replies
  • 0 kudos

Spark Optimization strategies

How can we get the correct size for job cluster in a job workflow pipeline based in the complexity of the process? #databricks #deltalake

  • 605 Views
  • 0 replies
  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels