cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Suresh_AWS
by New Contributor III
  • 4902 Views
  • 4 replies
  • 2 kudos

Resolved! Databricks fs ls does not work

I have configured the databricks CLI using token generated in Azure databricks configure --aad-tokenConfigure is success. When I used the command "databricks fs ls" I am running into an error as shown belowError: AttributeError: type object 'Retry' ...

  • 4902 Views
  • 4 replies
  • 2 kudos
Latest Reply
abos
New Contributor II
  • 2 kudos

It seems the Databricks cli needs and update. This issue is discussed on StackOverflow. For the time being, installing an older version of `urllib3` should solve the issue. The method was removed since 2.X, the latest 1.X version is 1.26.15. You can ...

  • 2 kudos
3 More Replies
kll
by New Contributor III
  • 7414 Views
  • 2 replies
  • 0 kudos

AttributeError: module 'pyspark.dbutils' has no attribute 'fs'

`AttributeError` when attempting to transfer files from `dbfs` filestore in DataBricks to a local directory.  import pyspark.dbutils as pdbutils   pdbutils.fs.cp("/dbfs/Data/file1.csv", "/Users/Downloads/")   Traceback (most recent call last):   ...

  • 7414 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Keval Shah​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...

  • 0 kudos
1 More Replies
jay548
by New Contributor
  • 1052 Views
  • 0 replies
  • 0 kudos

ERROR yarn.ApplicationMaster: - Wrong FS s3:// expected s3a://

We migrated from HDP to Cloudera platform 7, everything works except when we try to use databricks with redshift to load the data into a redshift table. we get the following error . ERROR yarn.ApplicationMaster: User class threw exception: java.lang....

  • 1052 Views
  • 0 replies
  • 0 kudos
bonjih
by New Contributor
  • 6984 Views
  • 3 replies
  • 3 kudos

Resolved! AttributeError: module 'dbutils' has no attribute 'fs'

Hi,Using db in SageMaker to connect EC2 to S3. Following other examples I get 'AttributeError: module 'dbutils' has no attribute 'fs'....I guess Im missing an import?

  • 6984 Views
  • 3 replies
  • 3 kudos
Latest Reply
Atanu
Databricks Employee
  • 3 kudos

agree with @Werner Stinckens​  . also may try importing dbutils - @ben Hamilton​ 

  • 3 kudos
2 More Replies
snoeprol
by New Contributor II
  • 4872 Views
  • 3 replies
  • 2 kudos

Resolved! Unable to open files with python, but filesystem shows files exist

Dear community,I have the following problem:%fs mv '/FileStore/Tree_point_classification-1.dlpk' '/dbfs/mnt/group22/Tree_point_classification-1.dlpk'I have uploaded a file of a ML-model and have transferred it to the directory with When I now check ...

  • 4872 Views
  • 3 replies
  • 2 kudos
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 2 kudos

There is dbfs:/dbfs/ displayed maybe file is in /dbfs/dbfs directory? Please check it and try to open with open('/dbfs/dbfs. You can also use "data" from left menu to check what is in dbfs file system more easily.

  • 2 kudos
2 More Replies
Labels