szymon_dybczak
Esteemed Contributor III

Hi @ManojkMohan ,

Unfortunately there is no workaround here. Free Edition supports only serverless compute. And serverless has following streaming limitation - one of which you just encountered - there is no support for default or time-based trigger intervals:

szymon_dybczak_0-1757787425119.png

You can still run your code but you need to provide supported trigger (for instance availableNow)

query = (telemetryDF.writeStream
         .format("delta")
         .outputMode("append")
         .option("checkpointLocation", "/tmp/telemetry_checkpoints")
         .option("path", "/tmp/telemetry_bronze")
         .trigger(availableNow=True)  # Process all available data now
         .start())

If you want to POC other streaming triggers you need to either have access to Databricks Premium workspace with classic compute or just download OSS Apache Spark docker container.

View solution in original post