cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Bucketing in DataBricks free edition please help me with the ERROR

SparkPractice
New Contributor

Hello guys i am trying to implement Bucketing in DataBricks free edition this is the code and error

 
employee_df.write.format("csv")\
           .option("header","true")\
           .mode("overwrite")\
           .bucketBy(3,"id")\
           .option("path","/Volumes/workspace/default/hello/bucket_by_id/")\
           .saveAsTable("employee_bucket")

[RequestId=7a6c63a6-5996-4ff4-a397-6dbad16568be ErrorClass=INVALID_PARAMETER_VALUE.INVALID_PARAMETER_VALUE] Missing cloud file system scheme

1 REPLY 1

Coffee77
Contributor III

There are a lot of ways to work with files in Databricks, so take a look here: https://docs.databricks.com/aws/en/files/ 

And then reference the path in the correct way.

Coffee77_0-1763210276550.png

 


Lifelong Learner Cloud & Data Solution Architect | https://www.youtube.com/@CafeConData