topic Re: Uploading local file in Get Started Discussions

Uploading local file

Shoaib8587 — Wed, 24 Jul 2024 05:34:15 GMT

Since, last two day i getting an error called

"ERROR OCCURRED WHEN PROCESSING FILE:[OBJECT OBJECT]"

While uploading any "csv" or "json" file from my local system but it shows or running my previous file but give error after uploading a new file

Re: Uploading local file

MJ_BE8 — Wed, 24 Jul 2024 08:25:39 GMT

I got the same error today too when trying to upload .csv file. This error never appeared before.

Re: Uploading local file

PraveenReddy21 — Wed, 24 Jul 2024 12:24:45 GMT

I am also getting same issue last 2 days onwards , may be owner restricted .

Re: Uploading local file

Shoaib8587 — Wed, 24 Jul 2024 12:31:56 GMT

Yeah! I also think that it's a technical issue because it happened from past 2 days.

Re: Uploading local file

Fahadra02 — Wed, 24 Jul 2024 12:52:40 GMT

I am getting the same issue 😕 Is there any other way?

Re: Uploading local file

Mansi-DataEng — Wed, 24 Jul 2024 15:03:49 GMT

Hello,
Yes, I am also getting the same error while uploading csv of 689KB.

Re: Uploading local file

Fahadra02 — Wed, 24 Jul 2024 15:06:44 GMT

Do anybody know any alternative for learning pyspark?

Re: Uploading local file

Shoaib8587 — Wed, 24 Jul 2024 15:21:55 GMT

Yes, you can use "PW skill lab" it free open source to use.

Re: Uploading local file

jefflipkowitz — Wed, 24 Jul 2024 18:18:48 GMT

Is this for the community edition only your seeing this issue?

Re: Uploading local file

Shoaib8587 — Wed, 24 Jul 2024 18:31:03 GMT

Yes i make a account on Databricks community.

Re: Uploading local file

Fahadra02 — Wed, 24 Jul 2024 18:34:54 GMT

Anybody tried using databricks without community version? If it's working fine?

Re: Uploading local file

Pruthviraj — Thu, 25 Jul 2024 03:37:04 GMT

Hi,

This has been fixed now,

Re: Uploading local file

LokeshManne — Wed, 14 May 2025 10:31:55 GMT

If you are using databricks community edition, the error you are facing is because the file you are trying to upload contains PII or SPII data ( Personally Identifiable Information OR Sensitive Personally Identifiable Information) words like dob, Token, accesskey, password..,etc.

Solution: Rename such data like date_of_birth, token_no, access_key, default_password,..etc. It will upload now.

If you're not able to find the data which is restricted by databricks policy and throwing above exception, you can cut the file half and try to upload in first half of the set, But before that initially you try to upload with single row of data, if it fails the columns contain the PII/SPII data, if it succeed which means the rows contain PII/SPII data so now try uploading incrementally untill the databricks throws the error. you try to upload with first half set of data if it throws an error, which mean there is an PII/SPII data in the fist half and again split the first half into half and upload, if it throws an error then again do the same untill no error, Case 1: the row where the error throws is the data you need to update. Case 2: when the part of the file uploads successfully, which means there is no error in that part(fist half or second half)