- 627 Views
- 1 replies
- 0 kudos
How to Migrate Legacy Dashboards from hive_metastore to Unity Catalog using Python
Hi all,After updating the legacy dashboard APIs, I’m looking to migrate legacy dashboards from the hive_metastore to Unity Catalog in Databricks. Specifically, I want to programmatically:Migrate SQL queries used in dashboardsRetain or recreate the as...
- 627 Views
- 1 replies
- 0 kudos
- 0 kudos
For your consideration: To migrate legacy dashboards from the Hive Metastore to Unity Catalog in Databricks programmatically while retaining SQL queries, data visualizations, and ensuring compatibility with Unity Catalog schemas and tables using Py...
- 0 kudos
- 5909 Views
- 3 replies
- 4 kudos
ArcGIS Connection
Hi,I am trying to connect to an ArcGIS instance using Data bricks. Is this possible? After connecting, I am trying to read the data into a Data fame.Please help me with this request. If its not possible to connect , please provide an alternative.Than...
- 5909 Views
- 3 replies
- 4 kudos
- 4 kudos
I am trying to set up an ODBC or JDBC direct connection from ArcGIS Pro and ArcGIS Enterprise Server; has anyone done this successfully? I was able to make DSN successful connection, but no tables are being delivered; I did not use a connection stri...
- 4 kudos
- 3699 Views
- 11 replies
- 7 kudos
Facing issues while upgrading DBR version from 9.1 LTS to 15.4 LTS
Dear all,I am upgrading DBR version from 9.1 LTS to 15.4 LTS in Azure Databricks. for that I have created a new cluster with 15.4 DBR attached init script for installing application dependencies. Cluster has started successfully but it takes 30 min. ...
- 3699 Views
- 11 replies
- 7 kudos
- 7 kudos
ust to add, you might also want to check the cluster logs (driver and init script logs) for any hidden errors or timeouts during startup. Sometimes dependencies silently fail to install,even if the cluster appears to be running. If possible, try brea...
- 7 kudos
- 2502 Views
- 3 replies
- 2 kudos
Calling all Chennai residents! Join the Chennai User Group on Community!
Calling all Chennai residents! Join the Chennai User Group on Community! Are you passionate about our vibrant city of Chennai? Do you love connecting with like-minded individuals, expanding your knowledge, and contributing to a thriving Community...
- 2502 Views
- 3 replies
- 2 kudos
- 2 kudos
Thank you, will that be happening in future or any what's up group is available now?
- 2 kudos
- 795 Views
- 1 replies
- 0 kudos
Gcs and databricks community
Hello,I would like to know if it is possible to connect my Databricks community account with a Google cloud storage account via a notebook.I tried to connect it via the json key of my gcs service account but the notebook always gives this error when ...
- 795 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @oricaruso! It looks like this post duplicates the one you posted earlier. A response has already been provided in the original thread. I recommend continuing the discussion there to keep the conversation focused and organized.
- 0 kudos
- 814 Views
- 1 replies
- 0 kudos
How to create and manage daily partitioned tables in Databricks Unity Catalog for Bronze layer with
I’m working on a project to practice using Databricks, Lakehouse architecture, Medallion architecture, and data lakes. Setup: I have an Azure Data Lake with three containers: bronze, silver, and gold. In the bronze container, I store daily customer C...
- 814 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @OmarSEKkOUTI , you can leverage DLT feature to do so. Please check: https://docs.databricks.com/aws/en/dlt/transform https://docs.databricks.com/aws/en/dlt/stateful-processing Here is the step-by-step tutorial: https://docs.databricks.com/aws/en...
- 0 kudos
- 1551 Views
- 1 replies
- 1 kudos
Resolved! Cleared DE associate exam ..need to clear GenAI associate in next 5 days.
Hi fellow members,Hope you're all doing well.I’m seeking advice from those who’ve recently cleared the Databricks Generative AI Associate certification. I’ve spent 20 years in data and analytics consulting, and I'm currently in the process of resetti...
- 1551 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @gmglitch, If you have an account at the Databricks employee academy, please take the GEN AI certification course. You can go through the below medium articles: https://medium.com/@chandadipendu/databricks-generative-ai-engineer-associate-certifi...
- 1 kudos
- 5430 Views
- 5 replies
- 3 kudos
Failure when deploying a custom serving endpoint LLLM
I'm currently experimenting with vector search using Databricks. Everything runs smoothly when I load the model deployed in Unity Catalog into a notebook session and ask questions using Python. However, when I attempt to serve it, I encounter a gener...
- 5430 Views
- 5 replies
- 3 kudos
- 3 kudos
Get your Ehsaas Program 8171 online registration and CNIC check online now. Enter your National ID card number & get Rs. 25000/12000 grant.8171 web portal
- 3 kudos
- 3135 Views
- 2 replies
- 0 kudos
Workflow UI not showing all jobs that were run
I found a scenario where the workflow UI seems to not list all the jobs that ran.The objective is to keep trying to run a job, using the job rest api, when the service returns a status of "skipped" while another run is currently running, until the jo...
- 3135 Views
- 2 replies
- 0 kudos
- 0 kudos
I'm.facing the same issue I used to see the jobs ran via databricks bundle but now I can't see those jobs ? Can ay please specify wat went wrong ?
- 0 kudos
- 6699 Views
- 9 replies
- 2 kudos
How to run test of default python asset bundle, how run from terminal in general
I created an asset bundle from default python template. I am able to "upload and run file" main.py from within vs-code: 5/23/2025, 9:01:29 AM - Uploading assets to databricks workspace... 5/23/2025, 9:01:31 AM - Creating execution context on cluster ...
- 6699 Views
- 9 replies
- 2 kudos
- 2 kudos
I figured it out from the docs:https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/cluster-config#clusterI don´t put the cluster in code myself because all code runs in Jobs (on job clusters). I only use it for developmen...
- 2 kudos
- 1104 Views
- 1 replies
- 1 kudos
Efficiently Delete/Update/Insert Large Datasets of Records in PostgreSQL from Spark DataFrame
So I am migrating my ETL Process from Pentaho to Databricks I am using pyspark.I have posted all the details here Staging Ground: How to Insert,Update,Delete data using databricks for large records in PostgreSQL from Spark DataFrame - Stack OverflowC...
- 1104 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @skohade1! The link you provided isn't accessible. Could you please share the relevant details directly here? This will help Community members better understand your scenario.
- 1 kudos
- 556 Views
- 1 replies
- 0 kudos
- 556 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @mahima13! Could you please share a bit more about the issue? Are you seeing an error when trying to join, or are you unable to locate the session link?
- 0 kudos
- 1067 Views
- 2 replies
- 0 kudos
Databricks Billing support
Hi everyone,I dont know if this is the right channel to use for this type of query but I couldn't get Databricks billing support from anywhere, which is why I am posting here. I am trying to contact Databricks sales team or billing support but I am u...
- 1067 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @brycejune, I dont have the support plan, I was only exploring managed MLflow provided by Databricks. Help center however did assign me a Databricks account executive. Hopefully, this might help me with billing.
- 0 kudos
- 992 Views
- 1 replies
- 0 kudos
Resolved! Kryterion suspended my certification exam
Hi Team,I have given the Databricks Certified Associate Developer for Apache Spark - Python Exam on18-05-2025. I was continuously in front of the camera and an alert came and the proctor asked me to show the entire room and bed. And I have shown him ...
- 992 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @vamsikrishna880 Please consider removing your webassessor ID from this post. We handle tickets via our ticket system so that individuals do not need to post their personal contact information in this forum.
- 0 kudos
- 6436 Views
- 10 replies
- 2 kudos
Variables in databricks.yml "include:" - Asset Bundles
HI,We've got an app that we deploy to multiple customers workspaces. We're looking to transition to asset bundles. We would like to structure our resources like: -src/ -resources/ |-- customer_1/ |-- job_1 |-- job_2 |-- customer_2/ |-- job_...
- 6436 Views
- 10 replies
- 2 kudos
- 2 kudos
@_escoto You can achieve this by defining the entire job in the "targets" section for your development target. Resources defined in the top-level "resources" block are deployed to all targets. Resources defined both in the top-level "resources" block...
- 2 kudos
