I realize that the best practice would be to integrate our service with Kafka as a streaming source for Databricks, but given that the service already stores data into TimescaleDB, how can I stream data from TimescaleDB into DBX? Debezium doesn't work for TimescaleDB due to hypertables. Or is there some trivial way to integrate Kafka into our service for consuming data? I also need to have the historical data in TimescaleDB available for aggregate statistics.
