https://community.databricks.com/t5/get-started-discussions/structured-streaming-from-timescaledb/m-p/39897#M5642 <P>I realize that the best practice would be to integrate our service with Kafka as a streaming source for Databricks, but given that the service already stores data into TimescaleDB, how can I stream data from TimescaleDB into DBX? Debezium doesn't work for TimescaleDB due to hypertables. Or is there some trivial way to integrate Kafka into our service for consuming data? I also need to have the historical data in TimescaleDB available for aggregate statistics.</P> Mon, 14 Aug 2023 22:43:07 GMT Erik_L 2023-08-14T22:43:07Z https://community.databricks.com/t5/get-started-discussions/structured-streaming-from-timescaledb/m-p/39897#M5642 <P>I realize that the best practice would be to integrate our service with Kafka as a streaming source for Databricks, but given that the service already stores data into TimescaleDB, how can I stream data from TimescaleDB into DBX? Debezium doesn't work for TimescaleDB due to hypertables. Or is there some trivial way to integrate Kafka into our service for consuming data? I also need to have the historical data in TimescaleDB available for aggregate statistics.</P> Mon, 14 Aug 2023 22:43:07 GMT https://community.databricks.com/t5/get-started-discussions/structured-streaming-from-timescaledb/m-p/39897#M5642 Erik_L 2023-08-14T22:43:07Z