cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

User16826994223
by Honored Contributor III
  • 1658 Views
  • 1 replies
  • 0 kudos

Which file size is better 1 GB file size in target or 128 MB or lesser than that

Which file size is better 1 GB file size in target or 128 MB or lesser than that , I am interested in knowing concept too.

  • 1658 Views
  • 1 replies
  • 0 kudos
Latest Reply
sajith_appukutt
Honored Contributor II
  • 0 kudos

If data is getting appended primarily to the delta table and read ratio is higher than writes ratio - larger file sizes ( 1GB) would be ideal. However, if your delta table undergoes frequent upserts/merges, having smaller files than the default 1GB ...

  • 0 kudos
Labels