cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Recursive view error while using spark 3.2.0 version

manasa
Contributor

This happens while creating temp view using below code block

latest_data.createOrReplaceGlobalTempView("e_test")

ideally this command should replace the view if e_test already exists instead it is throwing

"Recursive view `global_temp`.`e_test` detected (cycle: `global_temp`.`e_test` -> `global_temp`.`e_test`)" error..Can anyone help me with this

1 ACCEPTED SOLUTION

Accepted Solutions

shan_chandra
Honored Contributor III
Honored Contributor III

Hi, @Manasa​, could you please check SPARK-38318 and use Spark 3.1.2, Spark 3.2.2, or Spark 3.3.0 to allow cyclic reference?

View solution in original post

7 REPLIES 7

-werners-
Esteemed Contributor III

does it work when you don't use a global view?

Nope.Same error

User16763506477
Contributor III

Hi @Manasa Kalluri​  Is "latest_data" referring to "e_test".

How latest_data is created ?

Hi @Gaurav Rupnar​ ,

latest_data=spark.read.format('csv').option("header","true").option("multiLine","true").load(file_path)

latest_data is a simple dataframe of a small csv file

shan_chandra
Honored Contributor III
Honored Contributor III

Hi, @Manasa​, could you please check SPARK-38318 and use Spark 3.1.2, Spark 3.2.2, or Spark 3.3.0 to allow cyclic reference?

Hi @Manasa Kalluri​ ,

Just a friendly follow-up. Do you still need help with this issue?

No, it was resolved.Thanks!

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.