- 2957 Views
- 6 replies
- 2 kudos
How not to reprocess old files without delta ?
Hi guys,​Look that case: Company ACME (hypothetical company)​This company does not use delta, but uses open source Spark to process raw data for .parquet, we have a 'sales' process which consists of receiving every hour a new dataset (.csv) within th...
- 2957 Views
- 6 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @Jose Gonzalez​ , ​I agree the best option is to use auto load, but some cases you don`t have the databricks plataform and don`t use delta, i this cases you need build a way to process the new raw files
- 2 kudos
- 1469 Views
- 1 replies
- 1 kudos
- 1469 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
High level:Check this out for a detailed comparison - https://databricks.com/spark/comparing-databricks-to-apache-spark
- 1 kudos