- 846 Views
- 1 replies
- 0 kudos
Read the file from datalake in databricks -No such file directory error
0I have a problem with reading the file from ADLS gen 2.I have dont the mounting properly as after executing dbutils.fs.ls('/mnt/bronze') I can see the file path.the way how I did the mounting: # dbutils.fs.mount( # source = "abfss://"+container_r...
- 846 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Givi Salu​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 0 kudos
- 5052 Views
- 2 replies
- 1 kudos
How to download a .csv or .pkl file from databricks?
When I save files on "dbfs:/FileStore/shared_uploads/brunofvn6@gmail.com/", it doesn't appear anywhere in my workspace. I've tried to copy the path of the workspace with the right mouse button, pasted on ("my pandas dataframe").to_csv('path'), but wh...
- 5052 Views
- 2 replies
- 1 kudos
- 1 kudos
I think I discover how to do this. Is in the label called data in the left menu of the databricks environment, in the top left of the menu there are two labels "Database Tables" and "DBFS" in which "Database Table" is the default label. So it is just...
- 1 kudos
- 2030 Views
- 1 replies
- 0 kudos
Which file size is better 1 GB file size in target or 128 MB or lesser than that
Which file size is better 1 GB file size in target or 128 MB or lesser than that , I am interested in knowing concept too.
- 2030 Views
- 1 replies
- 0 kudos
- 0 kudos
If data is getting appended primarily to the delta table and read ratio is higher than writes ratio - larger file sizes ( 1GB) would be ideal. However, if your delta table undergoes frequent upserts/merges, having smaller files than the default 1GB ...
- 0 kudos
- 1035 Views
- 1 replies
- 0 kudos
- 1035 Views
- 1 replies
- 0 kudos
- 0 kudos
Optimize is largely designed as a data organization strategy for Delta Tables. Its help by compacting small files, collecting columns stats to help with data skipping and also Z-ordering of data if that's called explicitly can help with both read/wri...
- 0 kudos
- 956 Views
- 1 replies
- 1 kudos
- 956 Views
- 1 replies
- 1 kudos
- 1 kudos
There are examples and sample notebooks available here...https://docs.databricks.com/data/data-sources/read-csv.html
- 1 kudos