topic Re: Pyspark execution error in Data Engineering

Pyspark execution error

Kanti1989 — Fri, 19 Apr 2024 10:30:37 GMT

I am getting a error message when executing a simple pyspark code. Can anyone help me with this.

Lakshay — Fri, 19 Apr 2024 11:00:52 GMT

The error message says "system cannot find the file specified". Could you check in the error message which file it is complaining about?

Kanti1989 — Sat, 20 Apr 2024 15:19:00 GMT

There is no file, it's a harcoded dataset.

Lakshay — Mon, 22 Apr 2024 19:45:50 GMT

Have you checked the error message?

AmanSehgal — Mon, 22 Apr 2024 23:44:22 GMT

Could you please share the entire error message?

Are you running the code locally or on databricks?