cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Lakehouse
by New Contributor
  • 2083 Views
  • 2 replies
  • 0 kudos

Is Rust the future if analytics?

Today I walked into a session that talked about a fairly new language - Rust. The name can mislead you, I believe taking a look at the roots of how to best use CPU cycles is a game changer and Rust is traversing new areas that others might have ignor...

  • 2083 Views
  • 2 replies
  • 0 kudos
Latest Reply
Tom-Coffin
New Contributor II
  • 0 kudos

Yes, Rust is definitely part of the future.  It brings performance and simplicity to us.  I think it will add to the community, rather than replacing.  Scala and R will never go away, Python will always be strong, but Rust gives us one other tool in ...

  • 0 kudos
1 More Replies
kingmobil
by New Contributor
  • 390 Views
  • 0 replies
  • 0 kudos

Summit

Really enjoying my time at the summit!

  • 390 Views
  • 0 replies
  • 0 kudos
Orthoscope
by New Contributor
  • 545 Views
  • 0 replies
  • 0 kudos

Epic Keynote

Wow what was cool, so many of my workarounds have materialized into solutions!!

  • 545 Views
  • 0 replies
  • 0 kudos
Tom-Coffin
by New Contributor II
  • 903 Views
  • 0 replies
  • 0 kudos

Summit Keynote

Just saw the keynote! I’m really excited for LakehouseIQ and the updates to Unity Catalog!

  • 903 Views
  • 0 replies
  • 0 kudos
Benhcosta
by New Contributor
  • 900 Views
  • 0 replies
  • 0 kudos

Data Engineering

The Data and Ai summit provided a great insight into the future of the Databricks platform and ideas for future utilization. 

  • 900 Views
  • 0 replies
  • 0 kudos
abetogi
by New Contributor III
  • 511 Views
  • 0 replies
  • 0 kudos

AI

At Chevron we actively use Databricks to provide answers to business users. It was extremely interesting to see the use LakeHouseIQ initiatives as it can expedite how fast our users can receive their answers/reports. Is there any documentation that I...

  • 511 Views
  • 0 replies
  • 0 kudos
IS8
by New Contributor
  • 325 Views
  • 0 replies
  • 0 kudos

Summit

Great conference. Exited about upcoming LakehouseIQ feature. 

  • 325 Views
  • 0 replies
  • 0 kudos
DiegoG
by New Contributor
  • 413 Views
  • 0 replies
  • 0 kudos

Lot of new learns

the new way to optimize my notebook is something that I learned and I will execute soon 

  • 413 Views
  • 0 replies
  • 0 kudos
tariq
by New Contributor III
  • 8244 Views
  • 2 replies
  • 5 kudos

Databricks reading from a zip file

I have mounted an Azure Blob Storage in the Azure Databricks workspace filestore. The mounted container has zipped files with csv files in them. What is the best way to read the zipped files and write into a delta table?@sasikumar sagabala​ 

  • 8244 Views
  • 2 replies
  • 5 kudos
Latest Reply
Rishitha
New Contributor III
  • 5 kudos

Hello @Debayan  I recently came across the similar scenario, is there a way to do this via autoloader. We have zip Folders added daily to our AWS S3 bucket and we want to be able to unzip and load the csv files continuously (Autoloading)

  • 5 kudos
1 More Replies
Zhudocode
by New Contributor II
  • 1554 Views
  • 2 replies
  • 2 kudos

Resolved! What's the purpose of data governance

Forgive me for a nooby question, but what is the point of data governance if everyone is working at the same company? Is it for insider purposes?

  • 1554 Views
  • 2 replies
  • 2 kudos
Latest Reply
Datajoe
Contributor
  • 2 kudos

Hey Zhudocode, Actually answered this is person, but Data Governance fundamentally is about the appropriate, efficient and effective use of data. Appropriate use has to do with ethical ai, use of personal information, and policy around confidential a...

  • 2 kudos
1 More Replies
danieleads
by New Contributor
  • 1361 Views
  • 0 replies
  • 0 kudos

Parameters as query strings in the URL

Working with a query that was imported to Databricks from Redash.There are a couple fields set as parameters on this query:In Redash, it was possible to pre-fill the values for those parameters in the URL. Here's an example showing a valid pre-fill f...

danieleads_0-1687972165051.png
  • 1361 Views
  • 0 replies
  • 0 kudos
Kishore76
by New Contributor
  • 954 Views
  • 1 replies
  • 0 kudos

Do databricks support iceberg tables

Do databricks support iceberg tables

  • 954 Views
  • 1 replies
  • 0 kudos
Latest Reply
Fangrou
New Contributor II
  • 0 kudos

It support iceberg tables but with some Requirements and limitations, you could find détails in this doc: Incrementally clone Parquet and Iceberg tables to Delta Lake 

  • 0 kudos
dprutean
by New Contributor III
  • 1191 Views
  • 0 replies
  • 0 kudos

JDBC Driver Error

connect to databricks unity catalog and meet this error java.sql.SQLException: [Databricks][DatabricksJDBCDriver](500540) Error caught in BackgroundFetcher. Foreground thread ID: 59. Background thread ID: 61. Error caught: null. at com.databricks.cli...

  • 1191 Views
  • 0 replies
  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels