Using Databricks to transform cloudera lakehouse on-prem without bringing the data to cloud
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-13-2025 11:36 PM
I am looking for a solution to connect databricks to cloudera lakehouse hosted on-prem and transform the data using databricks without bringing the data to databricks delta tables or cloud storage. once the transformation is done the data need to be written back to cloudera lakehouse itself
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-14-2025 12:43 AM
Hello,
What is your data volume? You can connect using jdbc/odbc but this process will be slower if the data volume is too high.
Another way of connecting is if your cloudera storage is in HDFS then you can also connect through HDFS API as well.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-03-2025 07:54 AM
Are there specific use case examples for these two methods? Could you please provide some guidance? We are also looking for this solution.
