cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Read Json file

dhruval
New Contributor

I want to read json file. Code is shown as below

# credential_path ="/dbfs/Workspace/Users/dhruval/Return-label/GCP_Credential.json"

credential_path = "/Workspace/Users/dhruval/Return-label/GCP_Credential.json"
credential = spark.read.format("json").load(credential_path)
Here, credential_path is copied by right clicking on the file. I have also tried with using "dbfs" as prefix. Thought it shows there is no such file.

How to read that file
1 REPLY 1

Krishnamatta
Contributor

Hi Dhruval,

Did you try using the file: prefix to the path?

 

credential = spark.read.format("json").option("multiline","true").load("file:/Workspace/Users/dhruval/Return-label/GCP_Credential.json")
Note: Tested on 13.3 LTS cluster