- 3800 Views
- 13 replies
- 6 kudos
Parameters in dashboards data section passing via asset bundles
A new functionality allows deploy dashboards with a asset bundles. Here is an example :# This is the contents of the resulting baby_gender_by_county.dashboard.yml file. resources: dashboards: baby_gender_by_county: display_name: "Baby gen...
- 3800 Views
- 13 replies
- 6 kudos
- 6 kudos
Just three weeks ago, Databricks added the ability to parameterize the catalog and schema, here with examples -https://medium.com/@protmaks/dynamic-catalog-schema-in-databricks-dashboards-b7eea62270c6
- 6 kudos
- 345 Views
- 2 replies
- 0 kudos
Getting Genie to Generate SPC (Control) Charts Reliably
Hi everyone!I’m working on getting Genie to accurately generate Statistical Process Control (SPC) charts when prompted. I'm looking for suggestions on how to best approach this. So far, I’ve tried using pre-defined SQL queries to select the data, bu...
- 345 Views
- 2 replies
- 0 kudos
- 0 kudos
Or here is hopefully a more elegant way to phrase my question:To visualise a control diagram in Genie for an end-user, should I a) instruct Genie how to create an SPC chart with SQL on the fly, of b) create a background job (pre-defined SQL query in ...
- 0 kudos
- 289 Views
- 0 replies
- 1 kudos
Calling for Speakers – Manchester Databricks User Group | 19 March 2026
Hi everyoneThe Manchester Databricks User Group is looking for speakers for our in-person meetup on Thursday, 19 March 2026.https://www.meetup.com/manchester-databricks-user-group/We’re keen to hear from Databricks users, practitioners, partners, and...
- 289 Views
- 0 replies
- 1 kudos
- 550 Views
- 2 replies
- 2 kudos
Resolved! Error in creating external iceberg table
I am new to Databrcicks and was trying to create an Iceberg table. I have configured the Credentials and External Location using the UI under Catalog > External Locations and Credentials. I am able to create a table by using the Browse feature.But wh...
- 550 Views
- 2 replies
- 2 kudos
- 2 kudos
Thanks I am able to create a Lakehouse Federation and query the Snowflake catalog. So, if I create an Iceberg table in Databricks, one cannot access the path directly from else where like if I want to access it from Snowflake, right?
- 2 kudos
- 5199 Views
- 9 replies
- 0 kudos
Databricks apps - Volumes and Workspace - FileNotFound issues
I have a Databricks App I need to integrate with volumes using local python os functions. I've setup a simple test: def __init__(self, config: ObjectStoreConfig): self.config = config # Ensure our required paths are created ...
- 5199 Views
- 9 replies
- 0 kudos
- 493 Views
- 2 replies
- 3 kudos
Resolved! Ingesting data from APIs
Hi, I need to ingest some data available at API endpoint. I was thinking of this option - 1. make API call from Notebook and save data to ADLS2. use AutoLoader to load data from ADLS location. But then, i have some doubts - like I can directly write ...
- 493 Views
- 2 replies
- 3 kudos
- 3 kudos
@Anonym40 - its generally a good idea to break the direct API calls to your rest of the data pipeline. By staging the data to ADLS, you are protecting your downstream to upstream processes and getting more restartability/maintenance in your e2e flow....
- 3 kudos
- 509 Views
- 6 replies
- 1 kudos
Resolved! Account reset and loss of access to paid Databricks Academy Labs subscription
Hello,I am facing an issue with my Databricks Academy account.During a normal sign-in using my usual email address, I was asked to re-enter my first and last name, as if my account was being created again. After that, my account appeared to be reset,...
- 509 Views
- 6 replies
- 1 kudos
- 409 Views
- 2 replies
- 3 kudos
Resolved! AWS & Databricks Registration Issue
I have created both AWS and Databricks account but I cannot move to further steps in aws marketplace (configure and launch section)
- 409 Views
- 2 replies
- 3 kudos
- 3 kudos
Hello @Prathy!Also, please check out this video: https://www.youtube.com/watch?v=uzjHI0DNbbsRefer to the deck linked in the video’s description (https://drive.google.com/file/d/1ovZd...) and check slide no. 16, titled “Linking AWS to your Databricks ...
- 3 kudos
- 985 Views
- 10 replies
- 2 kudos
Create function issue
Hello - I am following some online code to create a function as follows:-----------------------------------------CREATE OR REPLACE FUNCTION my_catalog.my_schema.insert_data_function(col1_value STRING,col2_value INT)RETURNS BOOLEANCOMMENT 'Inserts dat...
- 985 Views
- 10 replies
- 2 kudos
- 2 kudos
In UC, the functions must be read-only; they cannot modify state (no INSERT, DELETE, MERGE, CREATE, VACUUM, etc). So I tried to create a PROCEDURE and call it; I was able to insert data into the table successfully. Unity Catalog tools are really jus...
- 2 kudos
- 5343 Views
- 4 replies
- 0 kudos
Informatica ETLs
I'm delving into the challenges of ETL transformations, particularly moving from traditional platforms like Informatica to Databricks. Given the complexity of legacy ETLs, I'm curious about the approaches others have taken to integrate these with Dat...
- 5343 Views
- 4 replies
- 0 kudos
- 0 kudos
We ended up using the tool from datayoga.io that converts these in a multi-stage approach. It converted to an intermediate representation. Then, from there it gets optimized (a lot of the Informatica actions can be optimized out or compacted) and fin...
- 0 kudos
- 1123 Views
- 3 replies
- 3 kudos
Resolved! Databricks partner journey for small firms
Hello,We are a team of 5 ( DE/ Architects ) exploring the idea of starting a small consulting company focused on Databricks as a SI partner and wanted to learn from others who have gone through the partnership journey.I would love to understand how t...
- 1123 Views
- 3 replies
- 3 kudos
- 3 kudos
If I’m being completely honest, I haven’t seen any. As you can imagine, partner organizations tend to keep things pretty close to the vest for a variety of reasons. That said, once a new partner is officially enrolled, they are granted access to an e...
- 3 kudos
- 731 Views
- 4 replies
- 0 kudos
Best Development Strategies for Building Reusable Data Engineering Components in Databricks
I’m looking to gather insights from data engineers, architects, and developers who have experience building scalable pipelines in Databricks. Specifically, I want to understand how to design, implement, and manage reusable data engineering components...
- 731 Views
- 4 replies
- 0 kudos
- 0 kudos
The best strategy is to build modular, parameterized, Delta-optimized functions and package them into reusable Python modules, while keeping Databricks notebooks only for orchestration. This creates consistent, scalable, and easily maintainable data ...
- 0 kudos
- 995 Views
- 2 replies
- 3 kudos
How realistic is truly end-to-end LLMOps on Databricks?
Databricks is positioning the platform as a full stack for LLM development — from data ingestion → feature/embedding pipelines → fine-tuning (Mosaic AI) → evaluation → deployment (Model Serving) → monitoring (Lakehouse Monitoring).I’m curious about r...
- 995 Views
- 2 replies
- 3 kudos
- 3 kudos
Thank You @Gecofer for taking the time to share such a clear, experience-backed breakdown of where Databricks shines and where real-world LLM Ops architectures still need supporting components. Your explanation was incredibly practical and resonates ...
- 3 kudos
- 556 Views
- 3 replies
- 3 kudos
Resolved! Software engineering in data bricks
I'm a software engineer and a bit new to databricks. My goal is to create a model serving endpoint, that interfaces with several ML models. Traditionally this would look like:API--> Service --> DataNow using databricks, my understanding is that it w...
- 556 Views
- 3 replies
- 3 kudos
- 3 kudos
Just register model and then deploy service endpoint to serve this model.
- 3 kudos
- 217 Views
- 1 replies
- 1 kudos
Webinar: From PoC to Production: Delivering with Confidence with Databricks
Our final webinar of December is here and we are closing the year with a powerhouse session!SpeakersAs many organisations still get stuck in the PoC phase, we’re bringing clarity, structure, and real delivery practices to help teams move from promi...
- 217 Views
- 1 replies
- 1 kudos
- 1 kudos
Appreciate you sharing this with the community, @bianca_unifeye!
- 1 kudos
