- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-26-2024 11:33 PM - edited 10-26-2024 11:35 PM
Hi,
Databricks is meant for that & it supports what ever feature you had asked in the OP.
1) You can ingest data from various sources - in both batch & streaming mode, various formats of data through Lakehouse architecture
2) In terms of data consistency while reading, also to manipulate the data / durability - pls read about Delta lake, open storage format with ACID support.
3)Yes, you can enforce constraints, schema enforcement, RBAC, Unity catalog - to centrally manage & follow data governance, compliance etc.
Here are some reference links:
https://docs.databricks.com/en/ingestion/index.html