cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
billaspiel
by • New Contributor II
  • 12602 Views
  • 3 replies
  • 0 kudos

Resolved! Python open function is unable to detect the file in dbfs

hi , Im a newbie learning spark using databricks , I did some investigation and searched if this questions was been asked earlier in community forum but unable to find anything so . 1. DBFS is unable to detect the file even though its present in it...

Data Engineering
Reply
  • 12602 Views
  • 3 replies
  • 0 kudos
View Replies
Latest Reply
Dflo
New Contributor II
  • 0 kudos

I am having similar issues currently. I can read or access my storage account but when I attempted to read or access the container it told me path not found. I create the container and have full access as an owner.

  • 0 kudos
2 More Replies
Varshith
by • New Contributor III
  • 5166 Views
  • 4 replies
  • 3 kudos

Getting "java.io.FileNotFoundException" when I'm trying to use wildcard character

Though there are parquet files in the folder which I'm trying to query, I'm getting FileNotFoundException. Please Let me know if there is any issue in the code.Thanks

Data Engineering
Reply
  • 5166 Views
  • 4 replies
  • 3 kudos
View Replies
Latest Reply
ramravi
Contributor II
  • 3 kudos

alternatively you can use this as shell command. This will work.%sh   ls /dbfs/mnt/mountpoint/path/to/raw/*.parquet

  • 3 kudos
3 More Replies
snoeprol
by • New Contributor II
  • 4771 Views
  • 3 replies
  • 2 kudos

Resolved! Unable to open files with python, but filesystem shows files exist

Dear community,I have the following problem:%fs mv '/FileStore/Tree_point_classification-1.dlpk' '/dbfs/mnt/group22/Tree_point_classification-1.dlpk'I have uploaded a file of a ML-model and have transferred it to the directory with When I now check ...

Data Engineering
Reply
  • 4771 Views
  • 3 replies
  • 2 kudos
View Replies
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 2 kudos

There is dbfs:/dbfs/ displayed maybe file is in /dbfs/dbfs directory? Please check it and try to open with open('/dbfs/dbfs. You can also use "data" from left menu to check what is in dbfs file system more easily.

  • 2 kudos
2 More Replies
Labels