cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Anonymous
by Not applicable
  • 2890 Views
  • 2 replies
  • 1 kudos

Is it the Lakehouse suitable as a OLTP and OLAP system at the same time? Recently I have seen some discussion in the company I work and it is basicall...

Is it the Lakehouse suitable as a OLTP and OLAP system at the same time?Recently I have seen some discussion in the company I work and it is basically if the Lakehouse is a tool to be used as both transactional and analytical system.The discussion ha...

  • 2890 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Esteban Sierra-Munera​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from ...

  • 1 kudos
1 More Replies
ftc
by New Contributor II
  • 2492 Views
  • 3 replies
  • 0 kudos

Resolved! Multi-Hop Architecture for ingestion data via http API

I'd like to know what is the design pattern for ingesting data via http API request. The pattern needs use multi-hop architecture. Do we need ingest JSON output to cloud storage first (not bronze layer), then use auto loader to process data further? ...

  • 2492 Views
  • 3 replies
  • 0 kudos
Latest Reply
artsheiko
Honored Contributor
  • 0 kudos

The API -> Cloud Storage -> Delta is more suitable approach.Auto Loader helps not to lose any data (it keeps track of discovered files in the checkpoint location using RocksDB to provide exactly-once ingestion guarantees), enables schema inference ev...

  • 0 kudos
2 More Replies
Labels