Hi @Erik_L, Currently, there is no direct way to stream data from TimescaleDB into Databricks.
However, there are a couple of ways you can approach this:
1. **Kafka Integration**: You can integrate Kafka into your service for consuming data. Kafka is a popular choice for real-time data streaming services due to its ease of use and serverless setup. Databricks supports Apache Kafka as a source or a sink when running workloads. You can use Kafka as a bridge between your service and Databricks, where your service pushes data into Kafka, and Databricks consumes the data from Kafka.
2. **Historical Data**: For the historical data in TimescaleDB, you might need to export it from TimescaleDB and then import it into Databricks for aggregate statistics. Databricks supports various data sources for ingestion.
I hope this helps! Feel free to ask if you have further questions or need more clarification.