cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

View Failing due to filed not recognise

anujsen18
New Contributor III

Hi, 

I am facing problem where my existing view has stopped working due to unrecognised filed which is a alias field .

I  am using the same definition  and spark configuration.

DBR : 14.3 LTS, Spark 3.5.0

Any one faced similar problem recently ?  

1 ACCEPTED SOLUTION

Accepted Solutions

anujsen18
New Contributor III

HI @Khaja_Zaffer 

yes it was actaully issue with privacera version . 

after invastaigation with privacera team they suggested to upgrade the privacera version to 9.0.35.1.

View solution in original post

9 REPLIES 9

Khaja_Zaffer
Contributor

Hello @anujsen18 

good day!

Is select * working as expected? just remove those filters and confirm once?

Khaja_Zaffer
Contributor

Can you try this?

 

select *
from team_finance_global.vw_fact_pnl_exp001
where "Id Date" = "20250807"

Try with double quoats

 

OR

-- This assumes 'id_date' is the correct underlying column name
select *
from team_finance_global.vw_fact_pnl_exp001
where id_date = '20250807'

id_date is the original column name, but the alias is 'Id Date'. Using the alias with the appropriate quoting is the intended way to query the view.

anujsen18
New Contributor III

anujsen18_0-1754291283068.png

anujsen18_0-1754291534235.png

 

Khaja_Zaffer
Contributor

Okay, when you run select * where you able to see any data? just avoid filters for now. 

anujsen18
New Contributor III

it is working without filter

anujsen18_0-1754294634943.png

 

 

Hello @anujsen18 

it seems like the given date is not present. 

May be you can confirm with the above syntax and check filter with date 20241031, may be 20250131 is not present?

If thats not the expectation, I expect others to jump in for the solutions thank you have a great day!

anujsen18
New Contributor III

HI @Khaja_Zaffer , 

The Date is present in data . 

The problem i see  here :

The renamed column in select clause is not identifying with  single quotes " ` "   when we are passing with double quotes then it is considering the column but filtering is not working properly i am getting empty df.

I am suspecting some setting changed in cluster which is responsible for  quotes behaviour .

Hello @anujsen18 

is it resolved?

anujsen18
New Contributor III

HI @Khaja_Zaffer 

yes it was actaully issue with privacera version . 

after invastaigation with privacera team they suggested to upgrade the privacera version to 9.0.35.1.