- 769 Views
- 2 replies
- 0 kudos
Getting Genie to Generate SPC (Control) Charts Reliably
Hi everyone!I’m working on getting Genie to accurately generate Statistical Process Control (SPC) charts when prompted. I'm looking for suggestions on how to best approach this. So far, I’ve tried using pre-defined SQL queries to select the data, bu...
- 769 Views
- 2 replies
- 0 kudos
- 0 kudos
Or here is hopefully a more elegant way to phrase my question:To visualise a control diagram in Genie for an end-user, should I a) instruct Genie how to create an SPC chart with SQL on the fly, of b) create a background job (pre-defined SQL query in ...
- 0 kudos
- 507 Views
- 0 replies
- 2 kudos
Calling for Speakers – Manchester Databricks User Group | 19 March 2026
Hi everyoneThe Manchester Databricks User Group is looking for speakers for our in-person meetup on Thursday, 19 March 2026.https://www.meetup.com/manchester-databricks-user-group/We’re keen to hear from Databricks users, practitioners, partners, and...
- 507 Views
- 0 replies
- 2 kudos
- 1609 Views
- 2 replies
- 2 kudos
Resolved! Error in creating external iceberg table
I am new to Databrcicks and was trying to create an Iceberg table. I have configured the Credentials and External Location using the UI under Catalog > External Locations and Credentials. I am able to create a table by using the Browse feature.But wh...
- 1609 Views
- 2 replies
- 2 kudos
- 2 kudos
Thanks I am able to create a Lakehouse Federation and query the Snowflake catalog. So, if I create an Iceberg table in Databricks, one cannot access the path directly from else where like if I want to access it from Snowflake, right?
- 2 kudos
- 2138 Views
- 2 replies
- 3 kudos
Resolved! Ingesting data from APIs
Hi, I need to ingest some data available at API endpoint. I was thinking of this option - 1. make API call from Notebook and save data to ADLS2. use AutoLoader to load data from ADLS location. But then, i have some doubts - like I can directly write ...
- 2138 Views
- 2 replies
- 3 kudos
- 3 kudos
@Anonym40 - its generally a good idea to break the direct API calls to your rest of the data pipeline. By staging the data to ADLS, you are protecting your downstream to upstream processes and getting more restartability/maintenance in your e2e flow....
- 3 kudos
- 1114 Views
- 6 replies
- 1 kudos
Resolved! Account reset and loss of access to paid Databricks Academy Labs subscription
Hello,I am facing an issue with my Databricks Academy account.During a normal sign-in using my usual email address, I was asked to re-enter my first and last name, as if my account was being created again. After that, my account appeared to be reset,...
- 1114 Views
- 6 replies
- 1 kudos
- 862 Views
- 2 replies
- 3 kudos
Resolved! AWS & Databricks Registration Issue
I have created both AWS and Databricks account but I cannot move to further steps in aws marketplace (configure and launch section)
- 862 Views
- 2 replies
- 3 kudos
- 3 kudos
Hello @Prathy!Also, please check out this video: https://www.youtube.com/watch?v=uzjHI0DNbbsRefer to the deck linked in the video’s description (https://drive.google.com/file/d/1ovZd...) and check slide no. 16, titled “Linking AWS to your Databricks ...
- 3 kudos
- 2467 Views
- 10 replies
- 2 kudos
Create function issue
Hello - I am following some online code to create a function as follows:-----------------------------------------CREATE OR REPLACE FUNCTION my_catalog.my_schema.insert_data_function(col1_value STRING,col2_value INT)RETURNS BOOLEANCOMMENT 'Inserts dat...
- 2467 Views
- 10 replies
- 2 kudos
- 2 kudos
In UC, the functions must be read-only; they cannot modify state (no INSERT, DELETE, MERGE, CREATE, VACUUM, etc). So I tried to create a PROCEDURE and call it; I was able to insert data into the table successfully. Unity Catalog tools are really jus...
- 2 kudos
- 6077 Views
- 4 replies
- 0 kudos
Informatica ETLs
I'm delving into the challenges of ETL transformations, particularly moving from traditional platforms like Informatica to Databricks. Given the complexity of legacy ETLs, I'm curious about the approaches others have taken to integrate these with Dat...
- 6077 Views
- 4 replies
- 0 kudos
- 0 kudos
We ended up using the tool from datayoga.io that converts these in a multi-stage approach. It converted to an intermediate representation. Then, from there it gets optimized (a lot of the Informatica actions can be optimized out or compacted) and fin...
- 0 kudos
- 4125 Views
- 3 replies
- 3 kudos
Resolved! Databricks partner journey for small firms
Hello,We are a team of 5 ( DE/ Architects ) exploring the idea of starting a small consulting company focused on Databricks as a SI partner and wanted to learn from others who have gone through the partnership journey.I would love to understand how t...
- 4125 Views
- 3 replies
- 3 kudos
- 3 kudos
If I’m being completely honest, I haven’t seen any. As you can imagine, partner organizations tend to keep things pretty close to the vest for a variety of reasons. That said, once a new partner is officially enrolled, they are granted access to an e...
- 3 kudos
- 2794 Views
- 2 replies
- 3 kudos
How realistic is truly end-to-end LLMOps on Databricks?
Databricks is positioning the platform as a full stack for LLM development — from data ingestion → feature/embedding pipelines → fine-tuning (Mosaic AI) → evaluation → deployment (Model Serving) → monitoring (Lakehouse Monitoring).I’m curious about r...
- 2794 Views
- 2 replies
- 3 kudos
- 3 kudos
Thank You @Gecofer for taking the time to share such a clear, experience-backed breakdown of where Databricks shines and where real-world LLM Ops architectures still need supporting components. Your explanation was incredibly practical and resonates ...
- 3 kudos
- 2725 Views
- 3 replies
- 3 kudos
Resolved! Software engineering in data bricks
I'm a software engineer and a bit new to databricks. My goal is to create a model serving endpoint, that interfaces with several ML models. Traditionally this would look like:API--> Service --> DataNow using databricks, my understanding is that it w...
- 2725 Views
- 3 replies
- 3 kudos
- 3 kudos
Just register model and then deploy service endpoint to serve this model.
- 3 kudos
- 434 Views
- 1 replies
- 1 kudos
Webinar: From PoC to Production: Delivering with Confidence with Databricks
Our final webinar of December is here and we are closing the year with a powerhouse session!SpeakersAs many organisations still get stuck in the PoC phase, we’re bringing clarity, structure, and real delivery practices to help teams move from promi...
- 434 Views
- 1 replies
- 1 kudos
- 1 kudos
Appreciate you sharing this with the community, @bianca_unifeye!
- 1 kudos
- 3686 Views
- 3 replies
- 2 kudos
Using Databricks for Real-Time App Data
I’m exploring how to handle real-time data for an application and I keep seeing Databricks recommended as a strong option — especially with its support for streaming pipelines, Delta Live Tables, and integrations with various event sources. That said...
- 3686 Views
- 3 replies
- 2 kudos
- 2 kudos
Databricks is very effective for real-time app data because it supports streaming data processing using Apache Spark and Delta Lake. It helps handle large data volumes, provides low-latency analytics, and makes it easier to build scalable event-drive...
- 2 kudos
- 15655 Views
- 7 replies
- 2 kudos
Alter table to add/update multiple column comments
I was wondering if there's a way to alter table and add/update comments for multiple columns at once using SQL or API calls. For instance - ALTER TABLE <table_name> CHANGE COLUMN <col1> COMMENT '<comment1>',CHANGE COLUMN <col2> COMMENT 'comment2' ; ...
- 15655 Views
- 7 replies
- 2 kudos
- 2 kudos
The correct SQL syntax for this is:ALTER TABLE your_table_name ALTER COLUMN col1 COMMENT 'comment1', col2 COMMENT 'comment2', col3 COMMENT 'comment3';
- 2 kudos
- 1730 Views
- 3 replies
- 0 kudos
How to Connect Databricks with Web and Mobile Apps
Hi everyone,I’m exploring ways to leverage Databricks for building data-driven web and mobile applications and wanted to get some insights from this community. Databricks is great for processing large datasets, running analytics, and building machine...
- 1730 Views
- 3 replies
- 0 kudos
- 0 kudos
Check Databricks Apps - you pass databricks resources and then use databricks-sdk to interact with them.
- 0 kudos
