cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

g96g
by New Contributor III
  • 491 Views
  • 1 replies
  • 0 kudos

Read the file from datalake in databricks -No such file directory error

0I have a problem with reading the file from ADLS gen 2.I have dont the mounting properly as after executing dbutils.fs.ls('/mnt/bronze') I can see the file path.the way how I did the mounting:  # dbutils.fs.mount( # source = "abfss://"+container_r...

  • 491 Views
  • 1 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Givi Salu​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.

  • 0 kudos
bruno_valero
by New Contributor II
  • 3517 Views
  • 2 replies
  • 1 kudos

How to download a .csv or .pkl file from databricks?

When I save files on "dbfs:/FileStore/shared_uploads/brunofvn6@gmail.com/", it doesn't appear anywhere in my workspace. I've tried to copy the path of the workspace with the right mouse button, pasted on ("my pandas dataframe").to_csv('path'), but wh...

  • 3517 Views
  • 2 replies
  • 1 kudos
Latest Reply
bruno_valero
New Contributor II
  • 1 kudos

I think I discover how to do this. Is in the label called data in the left menu of the databricks environment, in the top left of the menu there are two labels "Database Tables" and "DBFS" in which "Database Table" is the default label. So it is just...

  • 1 kudos
1 More Replies
User16826994223
by Honored Contributor III
  • 1630 Views
  • 1 replies
  • 0 kudos

Which file size is better 1 GB file size in target or 128 MB or lesser than that

Which file size is better 1 GB file size in target or 128 MB or lesser than that , I am interested in knowing concept too.

  • 1630 Views
  • 1 replies
  • 0 kudos
Latest Reply
sajith_appukutt
Honored Contributor II
  • 0 kudos

If data is getting appended primarily to the delta table and read ratio is higher than writes ratio - larger file sizes ( 1GB) would be ideal. However, if your delta table undergoes frequent upserts/merges, having smaller files than the default 1GB ...

  • 0 kudos
Anonymous
by Not applicable
  • 726 Views
  • 1 replies
  • 0 kudos
  • 726 Views
  • 1 replies
  • 0 kudos
Latest Reply
aladda
Honored Contributor II
  • 0 kudos

Optimize is largely designed as a data organization strategy for Delta Tables. Its help by compacting small files, collecting columns stats to help with data skipping and also Z-ordering of data if that's called explicitly can help with both read/wri...

  • 0 kudos
Labels