cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

VIEW JSON result value in view which based on volume

Cami
Contributor III

Hello guys!

I have the following case:

It has been decided that the json file will be read from a following definition ( from volume) , which more or less looks like this:

 

CREATE OR REPLACE VIEW  [catalog_name].[schema_name].v_[object_name]
AS
SELECT result, _metadata.file_path  as etl_full_path, _metadata.file_modification_time as etl_inserted_at  FROM json.`dbfs:/Volumes/[catalog_name]/[schema_name]/[volume_name]/object=[object_name]/`

 

I would like to read this view using SQL warehouse and I can not view result column value - there is a  NULL value 

despite the flag is turn on  in view properties.

 

view.sqlConfig.spark.sql.legacy.json.allowEmptyString.enabled=true

 

Any tips? 

 

1 REPLY 1

Thank you for response.

But there no issue with NULL value when I query view created on my cluster which has set the flag

spark.sql.legacy.json.allowEmptyString.enabled = True


Without that flag on session or cluster I get NULL value querying json.
The issue with a NULL value occurs when I query view via SQL warehouse compute.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group