cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

HeckGunderson
by New Contributor
  • 248 Views
  • 1 replies
  • 0 kudos

Where can I quickly test custom metric queries?

I'm working on adapting some custom metrics to add to the tables' dashboard. Right now when I throw in a test query, I need to refresh metrics and it takes 5-10 minutes to let me know I've probably forgotten a parenthesis somewhere.Where can I test t...

  • 248 Views
  • 1 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hi @HeckGunderson, Have you tried running the code using notebook with your Databricks workspace? https://docs.databricks.com/en/notebooks/index.html Also you can do it via CLI using SQL connector. https://docs.databricks.com/ja/dev-tools/python-sql-...

  • 0 kudos
ismaelhenzel
by Contributor
  • 919 Views
  • 2 replies
  • 2 kudos

Databricks Materialized View - DLT Serverless Incremental

I'm currently working with Delta Live Tables, utilizing materialized views and serverless computing. While testing the incremental updates of materialized views, I've observed that deleting a record from the source table triggers a complete refresh o...

  • 919 Views
  • 2 replies
  • 2 kudos
Latest Reply
ismaelhenzel
Contributor
  • 2 kudos

EDIT: My Delta Lake table contains 136 columns. I initially tested with fewer columns, and both the updates and deletes were applied incrementally without issues. Specifically, I tested with 34 columns, and everything worked fine. However, when I inc...

  • 2 kudos
1 More Replies
pankajmehta1242
by New Contributor
  • 535 Views
  • 2 replies
  • 1 kudos

Can't download resources from Databricks Academy courses

I seem to be unable to download hands-on lab resources from the Databricks Academy courses. No link for such files (like .dbc, zip, slides, etc.) exist. It seems the problem is with the new UI. It was fine before. Please help. 

pankajmehta1242_0-1733316769310.png
  • 535 Views
  • 2 replies
  • 1 kudos
Latest Reply
BigRoux
Databricks Employee
  • 1 kudos

There was a recent change, students are no longer able to download dbc files.  The slides are still available in Academy but you can only view them from within Academy, you cannot download them. Hope this helps, Louis.

  • 1 kudos
1 More Replies
drag7ter
by Contributor
  • 586 Views
  • 3 replies
  • 0 kudos

Parameters in dashboards data section passing via asset bundles

A new functionality allows deploy dashboards with a asset bundles. Here is an example :# This is the contents of the resulting baby_gender_by_county.dashboard.yml file. resources: dashboards: baby_gender_by_county: display_name: "Baby gen...

  • 586 Views
  • 3 replies
  • 0 kudos
Latest Reply
drag7ter
Contributor
  • 0 kudos

variables:  catalog:    description: "Catalog name for the dataset"    default: "dev" parameters:        catalog: ${var.catalog}doesn't replace parameter values prod -> dev in json when it is being deployed"datasets": [    {      "displayName": "my_t...

  • 0 kudos
2 More Replies
martkev
by New Contributor
  • 750 Views
  • 1 replies
  • 0 kudos

how to enable unity catalog on azure databricks?

Hi guys We have an azure databricks workspace upgrade from standard to premium and we want to enable unity catalog such that we can federate with snowflake. the workspace is more than two years old. How to enable unity catalog? I am an admin but unde...

  • 750 Views
  • 1 replies
  • 0 kudos
Latest Reply
Rjdudley
Honored Contributor
  • 0 kudos

Unity Catalog is configured at the account level, and then you add workspaces into it.  In your workspace selector, you should see "Manage account" at the bottom of the list (or go to https://accounts.azuredatabricks.net/).  If you can sign in to tha...

  • 0 kudos
musicman
by New Contributor II
  • 330 Views
  • 2 replies
  • 0 kudos

Getting scale to zero status of endpoint

Hello, I need to get the current scale to zero status of endpoint. How can I do that via python code? 

  • 330 Views
  • 2 replies
  • 0 kudos
Latest Reply
musicman
New Contributor II
  • 0 kudos

Hey, that worked. Thanks for you quick response.Cheers

  • 0 kudos
1 More Replies
VishalB
by New Contributor
  • 394 Views
  • 1 replies
  • 0 kudos

Not able to create or reset the password for Community edition.

I am trying to connect Databricks Community Edition with Power BI Desktop. When Power BI prompts for a username and password, I cannot provide the password because Databricks Community Edition uses a login system based on verification codes rather th...

  • 394 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika_
Databricks Employee
  • 0 kudos

Hello @VishalB!You can find helpful resources for Databricks Community Edition here. If the available resource doesn’t resolve your concern, feel free to submit a ticket with Databricks Support team for further assistance.Thank you.

  • 0 kudos
Shawn_Eary
by Contributor
  • 606 Views
  • 3 replies
  • 1 kudos

Limited Results When trying to Access Delta Shared Tables from C#

This C# code only seems to return about 8 rows when it should return 100:// Per Databricks AI, you must run the following command if you don't // want to get an error about delta.enableDeltionVectors from C#: // ALTER TABLE [myCatalog].setest.billboa...

  • 606 Views
  • 3 replies
  • 1 kudos
Latest Reply
gchandra
Databricks Employee
  • 1 kudos

Can you try with the ODBC driver? https://docs.databricks.com/en/integrations/odbc/index.html  

  • 1 kudos
2 More Replies
ram0021
by New Contributor II
  • 1547 Views
  • 2 replies
  • 1 kudos

You haven't configured the CLI yet

I have coded pyfunc model code in Databricks notebook and deployed and served thr model thr endpoint. I tried to query the endpoint thr databricks notebook itself through below code but getting CLI error. Not sure why i am getting this error since I ...

  • 1547 Views
  • 2 replies
  • 1 kudos
Latest Reply
john_smith
New Contributor II
  • 1 kudos

Try this article which seems to have worked for most such use cases:https://medium.com/featurepreneur/solving-the-cli-configuration-error-in-databricks-d0462a96449f

  • 1 kudos
1 More Replies
trevormccormick
by New Contributor III
  • 509 Views
  • 2 replies
  • 0 kudos

Is there a way to clone an AIBI Dashboard?

We moved some of our processes from notebooks to dashboards, but it looks like I cannot clone a dashboard like I can clone a notebook. 

  • 509 Views
  • 2 replies
  • 0 kudos
Latest Reply
tapash-db
Databricks Employee
  • 0 kudos

Hi, Please follow these steps to clone AIBI dashboard. 1. Open a dashboard and select the draft mode. 2. Click the kebab menu (three vertical dots) and select the clone option.  

  • 0 kudos
1 More Replies
MOUNIKASIMHADRI
by New Contributor
  • 9307 Views
  • 5 replies
  • 1 kudos

Insufficient Permissions Issue on Databricks

I have encountered a technical issue on Databricks.While executing commands both in Spark and SQL within the Databricks environment, I’ve run into permission-related errors from selecting files from DBFS. "org.apache.spark.SparkSecurityException: [IN...

  • 9307 Views
  • 5 replies
  • 1 kudos
Latest Reply
NandiniN
Databricks Employee
  • 1 kudos

Please refer to some of the other community articles with the no module error https://community.databricks.com/t5/data-engineering/udf-importing-from-other-modules/td-p/58988

  • 1 kudos
4 More Replies
bharathjs
by New Contributor II
  • 4381 Views
  • 6 replies
  • 2 kudos

Alter table to add/update multiple column comments

I was wondering if there's a way to alter table and add/update comments for multiple columns at once using SQL or API calls. For instance -  ALTER TABLE <table_name> CHANGE COLUMN <col1> COMMENT '<comment1>',CHANGE COLUMN <col2> COMMENT 'comment2' ; ...

  • 4381 Views
  • 6 replies
  • 2 kudos
Latest Reply
lukew_usafacts
New Contributor II
  • 2 kudos

@filipniziol Is batch update maybe a preview feature or something that was only added in a recent version of the databricks runtime? I'm seeing the same error as @bharathjs  in DBR 14.3, 16.0 ML and serverless V1

  • 2 kudos
5 More Replies
1diazdev
by New Contributor
  • 231 Views
  • 1 replies
  • 0 kudos

forums and groups - Databricks Certified Data Engineer Professional

Hi, I’m exploring more about the Databricks Certified Data Engineer Professional certification and was wondering if there’s a specific community or forum where people with this certification gather to share knowledge and experiences. Could anyone poi...

  • 231 Views
  • 1 replies
  • 0 kudos
Latest Reply
Takuya-Omi
Valued Contributor II
  • 0 kudos

Hi @1diazdev ,This community has a lounge specifically for certified members.https://community.databricks.com/t5/databricks-certified-lounge/gh-p/Databricks-Certified-Lounge I haven’t come across a community specifically focused on Databricks Certifi...

  • 0 kudos
Balazs
by New Contributor III
  • 6349 Views
  • 5 replies
  • 3 kudos

Databricks Asset Bundles and Dashboards

Hi Databricks Team! I saw in the documentation that Databricks Asset Bundles will support Dashboards as well in the future. Could you please share, when we can expect that feature to be available? Is it coming only for the new Lakeview dashboards or ...

  • 6349 Views
  • 5 replies
  • 3 kudos
Latest Reply
erigaud
Honored Contributor
  • 3 kudos

It is now supported with asset bundles, an example in github can be found here : https://github.com/databricks/bundle-examples

  • 3 kudos
4 More Replies
Roger667
by New Contributor
  • 788 Views
  • 1 replies
  • 0 kudos

Converting managed table to external tables

I have some managed tables in catalog which i plan to convert to external tables. But i want preserve the version history of the tables as well. I have tried deep cloning but it builds the external table as version 0. Is there any way i can achieve t...

  • 788 Views
  • 1 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hello @Roger667, When you use the DEEP CLONE command, you can specify the version of the table you want to clone. This allows you to create a clone of the table at a specific version, thus preserving the version history up to that point. Here is an e...

  • 0 kudos