- 684 Views
- 1 replies
- 0 kudos
How to create and manage daily partitioned tables in Databricks Unity Catalog for Bronze layer with
I’m working on a project to practice using Databricks, Lakehouse architecture, Medallion architecture, and data lakes. Setup: I have an Azure Data Lake with three containers: bronze, silver, and gold. In the bronze container, I store daily customer C...
- 684 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @OmarSEKkOUTI , you can leverage DLT feature to do so. Please check: https://docs.databricks.com/aws/en/dlt/transform https://docs.databricks.com/aws/en/dlt/stateful-processing Here is the step-by-step tutorial: https://docs.databricks.com/aws/en...
- 0 kudos
- 1412 Views
- 1 replies
- 1 kudos
Resolved! Cleared DE associate exam ..need to clear GenAI associate in next 5 days.
Hi fellow members,Hope you're all doing well.I’m seeking advice from those who’ve recently cleared the Databricks Generative AI Associate certification. I’ve spent 20 years in data and analytics consulting, and I'm currently in the process of resetti...
- 1412 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @gmglitch, If you have an account at the Databricks employee academy, please take the GEN AI certification course. You can go through the below medium articles: https://medium.com/@chandadipendu/databricks-generative-ai-engineer-associate-certifi...
- 1 kudos
- 5258 Views
- 5 replies
- 3 kudos
Failure when deploying a custom serving endpoint LLLM
I'm currently experimenting with vector search using Databricks. Everything runs smoothly when I load the model deployed in Unity Catalog into a notebook session and ask questions using Python. However, when I attempt to serve it, I encounter a gener...
- 5258 Views
- 5 replies
- 3 kudos
- 3 kudos
Get your Ehsaas Program 8171 online registration and CNIC check online now. Enter your National ID card number & get Rs. 25000/12000 grant.8171 web portal
- 3 kudos
- 3050 Views
- 2 replies
- 0 kudos
Workflow UI not showing all jobs that were run
I found a scenario where the workflow UI seems to not list all the jobs that ran.The objective is to keep trying to run a job, using the job rest api, when the service returns a status of "skipped" while another run is currently running, until the jo...
- 3050 Views
- 2 replies
- 0 kudos
- 0 kudos
I'm.facing the same issue I used to see the jobs ran via databricks bundle but now I can't see those jobs ? Can ay please specify wat went wrong ?
- 0 kudos
- 6428 Views
- 9 replies
- 2 kudos
How to run test of default python asset bundle, how run from terminal in general
I created an asset bundle from default python template. I am able to "upload and run file" main.py from within vs-code: 5/23/2025, 9:01:29 AM - Uploading assets to databricks workspace... 5/23/2025, 9:01:31 AM - Creating execution context on cluster ...
- 6428 Views
- 9 replies
- 2 kudos
- 2 kudos
I figured it out from the docs:https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/cluster-config#clusterI don´t put the cluster in code myself because all code runs in Jobs (on job clusters). I only use it for developmen...
- 2 kudos
- 1025 Views
- 1 replies
- 1 kudos
Efficiently Delete/Update/Insert Large Datasets of Records in PostgreSQL from Spark DataFrame
So I am migrating my ETL Process from Pentaho to Databricks I am using pyspark.I have posted all the details here Staging Ground: How to Insert,Update,Delete data using databricks for large records in PostgreSQL from Spark DataFrame - Stack OverflowC...
- 1025 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @skohade1! The link you provided isn't accessible. Could you please share the relevant details directly here? This will help Community members better understand your scenario.
- 1 kudos
- 520 Views
- 1 replies
- 0 kudos
- 520 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @mahima13! Could you please share a bit more about the issue? Are you seeing an error when trying to join, or are you unable to locate the session link?
- 0 kudos
- 963 Views
- 2 replies
- 0 kudos
Databricks Billing support
Hi everyone,I dont know if this is the right channel to use for this type of query but I couldn't get Databricks billing support from anywhere, which is why I am posting here. I am trying to contact Databricks sales team or billing support but I am u...
- 963 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @brycejune, I dont have the support plan, I was only exploring managed MLflow provided by Databricks. Help center however did assign me a Databricks account executive. Hopefully, this might help me with billing.
- 0 kudos
- 918 Views
- 1 replies
- 0 kudos
Resolved! Kryterion suspended my certification exam
Hi Team,I have given the Databricks Certified Associate Developer for Apache Spark - Python Exam on18-05-2025. I was continuously in front of the camera and an alert came and the proctor asked me to show the entire room and bed. And I have shown him ...
- 918 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @vamsikrishna880 Please consider removing your webassessor ID from this post. We handle tickets via our ticket system so that individuals do not need to post their personal contact information in this forum.
- 0 kudos
- 6042 Views
- 10 replies
- 2 kudos
Variables in databricks.yml "include:" - Asset Bundles
HI,We've got an app that we deploy to multiple customers workspaces. We're looking to transition to asset bundles. We would like to structure our resources like: -src/ -resources/ |-- customer_1/ |-- job_1 |-- job_2 |-- customer_2/ |-- job_...
- 6042 Views
- 10 replies
- 2 kudos
- 2 kudos
@_escoto You can achieve this by defining the entire job in the "targets" section for your development target. Resources defined in the top-level "resources" block are deployed to all targets. Resources defined both in the top-level "resources" block...
- 2 kudos
- 583 Views
- 1 replies
- 0 kudos
Data engineer Associate voucher
Hi all, I am new to this databricks and want to learn and do certification for my job search. Is there any free vouchers something like that for exams?
- 583 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @bindu22! Currently, Databricks isn’t offering any Certification discount promotions, but Learning Festival events are held once per quarter — in January, April, July, and October. Participants receive a 50% off voucher. Details for the next Le...
- 0 kudos
- 2652 Views
- 3 replies
- 0 kudos
Databricks Apps is now available in Public Preview
Databricks Apps is a new way to build and deploy internal data and AI applications is now available in Public Preview.Databricks Apps let developers build native apps using frameworks like Dash, Shiny and Streamlit, enabling data applications for non...
- 2652 Views
- 3 replies
- 0 kudos
- 0 kudos
Databricks Apps is Generally Available as of May 13, 2025. Here is the link to the documentation.
- 0 kudos
- 977 Views
- 1 replies
- 0 kudos
Databricks Bundle Deployment Question
Hello, everyone! I’ve been working on deploying Databricks bundles using Terraform, and I’ve encountered an issue. During the deployment, the Terraform state file seems to reference resources tied to another user, which causes permission errors.I’ve ...
- 977 Views
- 1 replies
- 0 kudos
- 0 kudos
Hey @leandro09 ,My opinion this kind of error is often related to Terraform state still tracking a resource that was created or managed by another user, and your current user doesn’t have permissions to update or read it.terraform state listThis will...
- 0 kudos
- 893 Views
- 1 replies
- 0 kudos
Resolved! My Databrick exam got Suspended.
Hello Databrick Support Team, request ID: #00667456I faced issue while taking my Databrick Certified Associate Developer for Apache Spark exam. This is completely unfair that alerts are coming while taking mid of exam due to blinking of eyes and proc...
- 893 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Siddartha01! It looks like this post duplicates the one you recently posted. A response has already been provided to the Original thread. I recommend continuing the discussion in that thread to keep the conversation focused and organised.
- 0 kudos
- 2933 Views
- 0 replies
- 0 kudos
Seeking GitBook Alternatives for Documenting Databricks Pipelines & ML Workflows
We’re scaling our use of Databricks notebooks and ML pipelines, and keeping everything properly documented is becoming a challenge. I’ve used GitBook in past projects, but it’s starting to feel a bit clunky, especially when trying to keep markdown do...
- 2933 Views
- 0 replies
- 0 kudos
