Read Json file

dhruval — Sat, 21 Oct 2023 08:30:30 GMT

I want to read json file. Code is shown as below

# credential_path ="/dbfs/Workspace/Users/dhruval/Return-label/GCP_Credential.json"

credential_path = "/Workspace/Users/dhruval/Return-label/GCP_Credential.json"

credential = spark.read.format("json").load(credential_path)

Here, credential_path is copied by right clicking on the file. I have also tried with using "dbfs" as prefix. Thought it shows there is no such file.

How to read that file

Re: Read Json file

Krishnamatta — Sat, 21 Oct 2023 22:30:41 GMT

Hi Dhruval,

Did you try using the file: prefix to the path?

credential = spark.read.format("json").option("multiline","true").load("file:/Workspace/Users/dhruval/Return-label/GCP_Credential.json")

Note: Tested on 13.3 LTS cluster

topic Read Json file in Data Engineering

Read Json file

Re: Read Json file