Databricks Lakeflow - a unified data engineering solution
Lakeflow solves the data engineering challenges posed by fragmented stacks by offering a unified solution for ingestion, transformation, and orchestration on the data intelligence platform.
Now generally available (GA), Lakeflow includes:
1. Expanded ingestion connectors for popular data sources (e.g more conectors to databases, file sources).
2. Zerobus, a Lakeflow Connect API with high-throughput direct writes with low latency.
2. A new IDE for data engineering that makes it easy to build and debug
data pipelines
3. Expanded capabilities for operationalizing, developing and monitoring ETL.
Link: Databricks Lakeflow
