Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-09-2024 11:58 PM
well that depends on what kinds of tests you do. In data warehousing there are different kinds of loads.
What have you tested? Data transformations or analytical queries. Because for the latter databricks sql is a better choice than a common spark cluster (with or without photon).
So I suggest you check the different products of Databricks: managed spark clusters (with or without photon, ML/classic), (serverless/classic) SQL warehouses and to tests/ cost comparison likewise.
Also it might be interesting to check what language your data engineering part will use (sql, python, ...).