cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

prasad_vaze
by New Contributor III
  • 11738 Views
  • 3 replies
  • 0 kudos

Resolved! Unable to add column comment on a View. Any way to update comments on multiple columns in bulk?

I noticed that unlike "Alter Table" there is no "Alter View"  command to add comment on a column in the existing view. This is a regular view created on Tables (and not Materialized view).  If the underlying table column has comment then the View inh...

Get Started Discussions
Data Governance
Unity Catalog
  • 11738 Views
  • 3 replies
  • 0 kudos
Latest Reply
Pinei
New Contributor II
  • 0 kudos

Use COMMENT ONCOMMENT ON | Databricks on AWS

  • 0 kudos
2 More Replies
MOUNIKASIMHADRI
by New Contributor
  • 16360 Views
  • 6 replies
  • 1 kudos

Insufficient Permissions Issue on Databricks

I have encountered a technical issue on Databricks.While executing commands both in Spark and SQL within the Databricks environment, I’ve run into permission-related errors from selecting files from DBFS. "org.apache.spark.SparkSecurityException: [IN...

  • 16360 Views
  • 6 replies
  • 1 kudos
Latest Reply
NandiniN
Databricks Employee
  • 1 kudos

Please refer to some of the other community articles with the no module error https://community.databricks.com/t5/data-engineering/udf-importing-from-other-modules/td-p/58988

  • 1 kudos
5 More Replies
Fz1
by New Contributor III
  • 4402 Views
  • 4 replies
  • 1 kudos

DLT Pipeline unable to find custom Libraries/Wheel packages

We have our DLT pipeline and we need to import our custom libraries packaged in wheel files.We are on Azure DBX and we are using Az DevOps CI/CD to build and deploy the wheel packages on our DBX environment. In the top of our DLT notebook we are impo...

Get Started Discussions
dbfs
dlt
Libraries
python
wheel
  • 4402 Views
  • 4 replies
  • 1 kudos
Latest Reply
Laurence_Fishbu
New Contributor II
  • 1 kudos

You might want to verify the file path and permissions within your CI/CD process—sometimes the context in which the pipeline runs lacks proper DBFS mount visibility. We've encountered similar visibility inconsistencies while working on data aggregati...

  • 1 kudos
3 More Replies
Sudheer2
by New Contributor III
  • 406 Views
  • 1 replies
  • 0 kudos

How to Migrate Legacy Dashboards from hive_metastore to Unity Catalog using Python

Hi all,After updating the legacy dashboard APIs, I’m looking to migrate legacy dashboards from the hive_metastore to Unity Catalog in Databricks. Specifically, I want to programmatically:Migrate SQL queries used in dashboardsRetain or recreate the as...

  • 406 Views
  • 1 replies
  • 0 kudos
Latest Reply
BigRoux
Databricks Employee
  • 0 kudos

For your consideration:   To migrate legacy dashboards from the Hive Metastore to Unity Catalog in Databricks programmatically while retaining SQL queries, data visualizations, and ensuring compatibility with Unity Catalog schemas and tables using Py...

  • 0 kudos
dbsuersu
by New Contributor II
  • 5487 Views
  • 3 replies
  • 4 kudos

ArcGIS Connection

Hi,I am trying to connect to an ArcGIS instance using Data bricks. Is this possible? After connecting, I am trying to read the data into a Data fame.Please help me with this request. If its not possible to connect , please provide an alternative.Than...

  • 5487 Views
  • 3 replies
  • 4 kudos
Latest Reply
GISWhammy
New Contributor II
  • 4 kudos

I am trying to set up an ODBC or JDBC direct connection from ArcGIS Pro  and ArcGIS Enterprise Server; has anyone done this successfully? I was able to make DSN successful connection, but no tables are being delivered; I did not use a connection stri...

  • 4 kudos
2 More Replies
Kuchnhi
by New Contributor III
  • 2808 Views
  • 11 replies
  • 7 kudos

Facing issues while upgrading DBR version from 9.1 LTS to 15.4 LTS

Dear all,I am upgrading DBR version from 9.1 LTS to 15.4 LTS in Azure Databricks. for that I have created a new cluster with 15.4 DBR attached init script for installing application dependencies. Cluster has started successfully but it takes 30 min. ...

  • 2808 Views
  • 11 replies
  • 7 kudos
Latest Reply
SmithPoll
New Contributor III
  • 7 kudos

ust to add, you might also want to check the cluster logs (driver and init script logs) for any hidden errors or timeouts during startup. Sometimes dependencies silently fail to install,even if the cluster appears to be running. If possible, try brea...

  • 7 kudos
10 More Replies
priyam39
by New Contributor
  • 1881 Views
  • 0 replies
  • 0 kudos

Databricks workspace

I have one issue . I have created delta table and vector search index from the delta table. For a particular query if I am doing similarity search then sometimes I am getting the documents and sometimes I am not getting any documents. For example# qu...

  • 1881 Views
  • 0 replies
  • 0 kudos
Sujitha
by Databricks Employee
  • 1967 Views
  • 3 replies
  • 2 kudos

Calling all Chennai residents! Join the Chennai User Group on Community!

Calling all Chennai residents! Join the Chennai User Group on Community!   Are you passionate about our vibrant city of Chennai? Do you love connecting with like-minded individuals, expanding your knowledge, and contributing to a thriving Community...

  • 1967 Views
  • 3 replies
  • 2 kudos
Latest Reply
rmohanrangan
New Contributor II
  • 2 kudos

Thank you, will that be happening in future or any what's up group is available now?

  • 2 kudos
2 More Replies
oricaruso
by New Contributor II
  • 691 Views
  • 1 replies
  • 0 kudos

Gcs and databricks community

Hello,I would like to know if it is possible to connect my Databricks community account with a Google cloud storage account via a notebook.I tried to connect it via the json key of my gcs service account but the notebook always gives this error when ...

  • 691 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Databricks Employee
  • 0 kudos

Hello @oricaruso! It looks like this post duplicates the one you posted earlier. A response has already been provided in the original thread. I recommend continuing the discussion there to keep the conversation focused and organized.

  • 0 kudos
OmarSEKkOUTI
by New Contributor II
  • 559 Views
  • 1 replies
  • 0 kudos

How to create and manage daily partitioned tables in Databricks Unity Catalog for Bronze layer with

I’m working on a project to practice using Databricks, Lakehouse architecture, Medallion architecture, and data lakes. Setup: I have an Azure Data Lake with three containers: bronze, silver, and gold. In the bronze container, I store daily customer C...

  • 559 Views
  • 1 replies
  • 0 kudos
Latest Reply
nikhilj0421
Databricks Employee
  • 0 kudos

Hi @OmarSEKkOUTI , you can leverage DLT feature to do so.  Please check: https://docs.databricks.com/aws/en/dlt/transform https://docs.databricks.com/aws/en/dlt/stateful-processing Here is the step-by-step tutorial: https://docs.databricks.com/aws/en...

  • 0 kudos
gmglitch
by New Contributor II
  • 1194 Views
  • 1 replies
  • 1 kudos

Resolved! Cleared DE associate exam ..need to clear GenAI associate in next 5 days.

Hi fellow members,Hope you're all doing well.I’m seeking advice from those who’ve recently cleared the Databricks Generative AI Associate certification. I’ve spent 20 years in data and analytics consulting, and I'm currently in the process of resetti...

  • 1194 Views
  • 1 replies
  • 1 kudos
Latest Reply
nikhilj0421
Databricks Employee
  • 1 kudos

Hi @gmglitch, If you have an account at the Databricks employee academy, please take the GEN AI certification course. You can go through the below medium articles:  https://medium.com/@chandadipendu/databricks-generative-ai-engineer-associate-certifi...

  • 1 kudos
ismaelhenzel
by Contributor
  • 5033 Views
  • 5 replies
  • 3 kudos

Failure when deploying a custom serving endpoint LLLM

I'm currently experimenting with vector search using Databricks. Everything runs smoothly when I load the model deployed in Unity Catalog into a notebook session and ask questions using Python. However, when I attempt to serve it, I encounter a gener...

ismaelhenzel_0-1715091515103.png
  • 5033 Views
  • 5 replies
  • 3 kudos
Latest Reply
Goiderearsur
New Contributor II
  • 3 kudos

Get your Ehsaas Program 8171 online registration and CNIC check online now. Enter your National ID card number & get Rs. 25000/12000 grant.8171 web portal

  • 3 kudos
4 More Replies
Michael42
by New Contributor III
  • 2909 Views
  • 2 replies
  • 0 kudos

Workflow UI not showing all jobs that were run

I found a scenario where the workflow UI seems to not list all the jobs that ran.The objective is to keep trying to run a job, using the job rest api, when the service returns a status of "skipped" while another run is currently running, until the jo...

  • 2909 Views
  • 2 replies
  • 0 kudos
Latest Reply
Mkd1590
New Contributor II
  • 0 kudos

I'm.facing the same issue I used to see the jobs ran via databricks bundle but now I can't see those jobs ? Can ay please specify wat went wrong ?

  • 0 kudos
1 More Replies
dermoritz
by New Contributor III
  • 5983 Views
  • 9 replies
  • 2 kudos

How to run test of default python asset bundle, how run from terminal in general

I created an asset bundle from default python template. I am able to "upload and run file" main.py from within vs-code: 5/23/2025, 9:01:29 AM - Uploading assets to databricks workspace... 5/23/2025, 9:01:31 AM - Creating execution context on cluster ...

  • 5983 Views
  • 9 replies
  • 2 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 2 kudos

I figured it out from the docs:https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/cluster-config#clusterI don´t put the cluster in code myself because all code runs in Jobs (on job clusters).  I only use it for developmen...

  • 2 kudos
8 More Replies
Sudheer2
by New Contributor III
  • 405 Views
  • 0 replies
  • 0 kudos

Issue with UCX Assessment Installation via Automation Script - Schema Not Found Error

 Hello,I'm encountering an issue while installing UCX Assessment via an automation script in Databricks. When running the script, I get the following error:13:38:06 WARNING [databricks.labs.ucx.hive_metastore.tables] {listing_tables_0} failed-table-c...

  • 405 Views
  • 0 replies
  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels