https://community.databricks.com/t5/data-engineering/structured-streaming-from-timescaledb/m-p/40025#M27111 <P><A title="timescaledb event streamer" href="https://github.com/noctarius/timescaledb-event-streamer/" target="_self">https://github.com/noctarius/timescaledb-event-streamer/</A></P><P>Might help.</P> Wed, 16 Aug 2023 07:07:55 GMT -werners- 2023-08-16T07:07:55Z https://community.databricks.com/t5/data-engineering/structured-streaming-from-timescaledb/m-p/40001#M27107 <P>I realize that the best practice would be to integrate our service with Kafka as a streaming source for Databricks, but given that the service already stores data into TimescaleDB, how can I stream data from TimescaleDB into DBX? Debezium doesn't work for TimescaleDB due to hypertables. Or is there some trivial way to integrate Kafka into our service for consuming data? I also need to have the historical data in TimescaleDB available for aggregate statistics.</P> Tue, 15 Aug 2023 22:55:21 GMT https://community.databricks.com/t5/data-engineering/structured-streaming-from-timescaledb/m-p/40001#M27107 Erik_L 2023-08-15T22:55:21Z https://community.databricks.com/t5/data-engineering/structured-streaming-from-timescaledb/m-p/40025#M27111 <P><A title="timescaledb event streamer" href="https://github.com/noctarius/timescaledb-event-streamer/" target="_self">https://github.com/noctarius/timescaledb-event-streamer/</A></P><P>Might help.</P> Wed, 16 Aug 2023 07:07:55 GMT https://community.databricks.com/t5/data-engineering/structured-streaming-from-timescaledb/m-p/40025#M27111 -werners- 2023-08-16T07:07:55Z