cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

pyspark.sql.utils.AnalysisException: Non-time-based windows are not supported on streaming DataFrames/Datasets

Gaurav_784295
New Contributor III

pyspark.sql.utils.AnalysisException: Non-time-based windows are not supported on streaming DataFrames/Datasets

Getting this error while writing can any one please tell how we can resolve it

2 REPLIES 2

Aviral-Bhardwaj
Esteemed Contributor III

Please give us the whole code by that we can understand what exactly you are doing

or you can connect with me in my LinkedIN and we can setup meeting.My LinkedIn URL is in my profile

AviralBhardwaj

Gaurav_784295
New Contributor III

I'm trying to run query on some table and then storing that result in some table .

query = stream

.writeStream

.format("delta")

.foreachBatch(batch_function) \

.option('checkpointLocation', self.checkpoint_loc)

.trigger(processingTime=self.trigger_interval)

And in that query I'm first using union function and then using window function. Their I'm facing this error pyspark.sql.utils.AnalysisException: Non-time-based windows are not supported on streaming DataFrames/Datasets

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group