topic Re: Options to access files in the community edition in Data Engineering

Options to access files in the community edition

adihc — Fri, 18 Oct 2024 12:22:00 GMT

As of now DBFS option is disabled in the Databricks community edition.

What are the other ways to use file in the Databricks notebooks for learning? When I go to catalog it show default option only with the AWS S3.

Is it the only option to access the files in the community edition now? For my learning I want to upload few types of file. Ex: CSV, JSON, Parquet etc...

Re: Options to access files in the community edition

gchandra — Fri, 18 Oct 2024 13:50:20 GMT

The workaround will be to Mount the S3 bucket and use that as your source.

access_key = ""

secret_key = ""

encoded_secret_key = secret_key.replace("/", "%2F")

aws_bucket_name = "yourawsbucketname/"

mount_name = "youraliasmountname"

# #dbutils.fs.unmountf"/mnt/{mount_name}")

dbutils.fs.mount(f"s3a://{access_key}:{encoded_secret_key}@{aws_bucket_name}", f"/mnt/{mount_name}")

After mounting
goto next cell %fs ls /mnt/youraliasmountname

Re: Options to access files in the community edition

adihc — Fri, 18 Oct 2024 14:47:00 GMT

Thanks for the answer @gchen. Apart from S3, there is no other option available in the community edition now?

Re: Options to access files in the community edition

Riporsa3011 — Fri, 18 Oct 2024 15:50:30 GMT

Any info on when the DBFS local file option will be back? It was the only option to keep studying without a paywall for me. Aprecciate your help.

Re: Options to access files in the community edition

gchandra — Fri, 18 Oct 2024 15:59:22 GMT

Signup for AWS Free https://aws.amazon.com/free/

You can use S3 buckets with IAM policies and use them with Databricks.

This is a good skill to have apart from using Databricks.

Re: Options to access files in the community edition

Riporsa3011 — Fri, 18 Oct 2024 17:39:24 GMT

Unfortunately, the AWS Free requires Billing (cr***t card) information to proceed with the account, which I can't provide, since I don't have one. The DBFS option was working just fine a few days ago, do you anticipate this option coming back in the future? I'm sure it will help lots of other students.

Re: Options to access files in the community edition

gchandra — Fri, 18 Oct 2024 17:48:02 GMT

Try this technique

https://medium.com/@gchandra/databricks-how-to-load-data-from-google-drive-github-c98d6b34d1b5?sk=674feb56e50fc9f348108bcede0b4582

Re: Options to access files in the community edition

Riporsa3011 — Fri, 18 Oct 2024 20:02:21 GMT

This worked Ganesh, thanks a lot. For anyone having problems with uploading files, I recommend the Github pipe. Upload your files to github, set the repository as public, then following Ganesh's code should allow you to create dataframes with your own data in Databricks. Thanks again!

Re: Options to access files in the community edition

gchandra — Fri, 18 Oct 2024 20:04:41 GMT

Don't forget to accept the solution so others will benefit.

Re: Options to access files in the community edition

gchandra — Sat, 19 Oct 2024 01:06:47 GMT

It's fixed. You can continue to use Upload.

Re: Options to access files in the community edition

GRV — Thu, 26 Jun 2025 05:01:16 GMT

its still saying "Public DBFS root is disabled. Access is denied on path: /FileStore/tables/weather_data.csv"

Re: Options to access files in the community edition

MastanRaoM — Sat, 19 Jul 2025 02:36:20 GMT

Hi Chandra,

Is it possible in new community edition.

Re: Options to access files in the community edition

DonV — Thu, 20 Nov 2025 10:20:20 GMT

Is it possible to connect to ADLS from the databricks community version. I have ADLS account and would love to use it databricks community edition.