Databricks is bringing Genie Code deeper into Lakeflow, giving data engineers an AI partner built for data that can help with pipeline development, job orchestration, monitoring, and debugging in one experience.
Key highlights
- Build pipelines in plain English: Genie Code can generate and update Spark Declarative Pipelines with ingestion, transformations, and data quality checks from a natural language prompt.
- Orchestrate jobs faster: It works with Lakeflow Jobs to help define tasks, dependencies, scheduling, and monitoring without manually stitching everything together.
- Work with the tools data engineers already use: Genie Code can help extend workflows with CDC patterns, Auto Loader, expectations, and Declarative Automation Bundles for CI/CD-friendly projects.
- Debug with more context: It can inspect pipeline behavior, analyze failures, propose fixes, and show diffs before changes are applied, helping teams move faster while staying in control.
- Adapt to your environment: Teams can customize Genie Code with instructions, skills, and MCP connections to bring in domain knowledge, external tools, and internal workflows.
👉 Read the full post here
