cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MadelynM
by Databricks Employee
  • 3544 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Warehousing & Analytics | Improve performance and increase insights

Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights.  Keynote: Data Warehouse presente...

Screenshot 2024-07-03 at 10.15.26 AM.png
Warehousing & Analytics
AI BI Dashboards
AI BI Genie
Databricks SQL
  • 3544 Views
  • 0 replies
  • 0 kudos
playnicekids
by New Contributor II
  • 149 Views
  • 2 replies
  • 0 kudos

Recommended local development workflow for dashboard CI/CD with environment-specific catalog/schema?

Hi all,I’m trying to implement CI/CD for Databricks AI/BI dashboards using Declarative Automation Bundles, following guidance published by Databricks.The documentation recommends exporting dashboards as .lvdash.json using databricks bundle generate, ...

  • 149 Views
  • 2 replies
  • 0 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 0 kudos

hi @playnicekids , You've hit a known dev-UX gap. dataset_catalog and dataset_schema on the dashboard resource are the intended parameterization mechanism, but they only resolve at bundle deploy time, which is why workspace editing of an unqualified ...

  • 0 kudos
1 More Replies
azl
by New Contributor
  • 215 Views
  • 2 replies
  • 0 kudos

Resolved! How to extract a full node from an xml string using sql

I have an XML string in my table and I want to extract a full node from it using SQL functions, without needing to parse it in full i.e. from '<a><b><c>c1</c></b></a>' I want '<b><c>c1</c></b>' (preferably) or '<c>c1</c>'.What little I can find that ...

  • 215 Views
  • 2 replies
  • 0 kudos
Latest Reply
azl
New Contributor
  • 0 kudos

Thanks very much.  I had over-simplified my example perhaps, and got stuck on the idea of using xml functions, particularly because I'm converting existing SQL from another DB, and wasn't being open-minded enough.The actual data has multiple instance...

  • 0 kudos
1 More Replies
wrosa
by New Contributor
  • 799 Views
  • 2 replies
  • 0 kudos

Metric Views + Window Functions not supported

Hi @Hubert-Dudek I am getting following error: METRIC_VIEW_WINDOW_FUNCTION_NOT _SUPPORTED The metric view is not allowed to use window function (...) With the following definition:- name: Sales net Total- expr: SUM(MEASURE(`Sales net`)) OVER())Howeve...

  • 799 Views
  • 2 replies
  • 0 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 0 kudos

Hi @wrosa, The error you are seeing (METRIC_VIEW_WINDOW_FUNCTION_NOT_SUPPORTED) is expected behavior. Metric views do not allow raw SQL window functions like SUM(...) OVER() directly in a measure's expr definition. This is by design because metric vi...

  • 0 kudos
1 More Replies
nafikazi
by New Contributor III
  • 422 Views
  • 4 replies
  • 2 kudos

Resolved! Steps to become a Databricks Consultant.

Hello professionals and seasoned functional consultants,I recently completed the Databricks Data Engineer Associate certification and have also finished multiple courses from Udemy, Databricks learning events, and Alex The Analyst / Analytics Builder...

  • 422 Views
  • 4 replies
  • 2 kudos
Latest Reply
nafikazi
New Contributor III
  • 2 kudos

@Rishabh-Pandey Thank you. It means a lot.

  • 2 kudos
3 More Replies
Andrea_
by New Contributor
  • 884 Views
  • 2 replies
  • 0 kudos

Change the default font for plots

Hi community, As the title says, I have been checking the documentation, but I could not find clear references to my question.I am working in a project, and I need to change all the plots fonts to match a specific brand. All plots are generated with ...

  • 884 Views
  • 2 replies
  • 0 kudos
Latest Reply
kheliidiyua33
New Contributor II
  • 0 kudos

Manually updating each plot would definitely get messy at scale. Using global font configuration seems like the cleaner approach for maintaining consistent branding across all visual outputs.

  • 0 kudos
1 More Replies
sharath007
by New Contributor II
  • 515 Views
  • 5 replies
  • 1 kudos

Resolved! SQL Warehouse fails to start — RESOURCE_EXHAUSTED Error

I'm unable to start my SQL warehouse (Serverless) due to a RESOURCE_EXHAUSTED error.Error message: Clusters are failing to launch. Cluster launch will be retried. Request to create a cluster failed with an exception: RESOURCE_EXHAUSTED: Cannot create...

  • 515 Views
  • 5 replies
  • 1 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 1 kudos

Hi @sharath007, Just checked internally. This specific RESOURCE_EXHAUSTED: Cannot create the resource, please try again later message for a serverless SQL warehouse normally indicates that the backing serverless compute pool has run out of capacity (...

  • 1 kudos
4 More Replies
iamgoce
by New Contributor III
  • 933 Views
  • 3 replies
  • 2 kudos

External embedding for reports using federated credentials fails

Hi,We are implementing external dashboard embedding in Azure Databricks and want to avoid using client secrets by leveraging **Azure Managed Identity** with **OAuth token federation** for generating the embedded report token.Following OAuth token fed...

  • 933 Views
  • 3 replies
  • 2 kudos
Latest Reply
gsbence
New Contributor II
  • 2 kudos

Did you get any information whether this is on their roadmap?I came across this issue last week and the documentation doesn't have anything about this limitation.

  • 2 kudos
2 More Replies
ShawnRR
by New Contributor II
  • 482 Views
  • 2 replies
  • 0 kudos

Resolved! Is there a Sample Java Program using Databricks Connect Library to query a table In the Free Editio?

Hello,    I was wondering if there was sample code indicating how a java program might leverage Databricks Connect to query the table in the Free Edition of Databricks?   I would like to use Connect as I am trying to avoid JDBC and its overhead and t...

  • 482 Views
  • 2 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

Hi — welcome to Databricks! Unfortunately, Databricks Connect v2 (DBR 13.3+) does not support Java — it only supports Python, Scala, and R. The legacy v1 did support Java, but it's been deprecated and is end-of-support. That said, here are your optio...

  • 0 kudos
1 More Replies
jroots
by New Contributor II
  • 625 Views
  • 3 replies
  • 0 kudos

Resolved! Metric Views Window Period to Date not working

The documentation gives an example of a period to date measure. The intention is to give the sum (in this example) of orders in the current year to date. However, what actually happens is that the measure returns the result for the most recent period...

  • 625 Views
  • 3 replies
  • 0 kudos
Latest Reply
jroots
New Contributor II
  • 0 kudos

Hi Ashwin. Thanks for looking into this. Your description of the behaviour and the options matches my understanding, but from my perspective this is a defect: I don't think there's a reasonable interpretation of "period to date" (which is the documen...

  • 0 kudos
2 More Replies
brianz
by New Contributor
  • 293 Views
  • 2 replies
  • 0 kudos

Not seeing color scale in Databricks table

Hi - I saw in this dbx post that there is color scale as a column display type. https://docs.databricks.com/aws/en/dashboards/manage/visualizations/tablesHowever I don't see color scale as an option on my dbx. I only see tables for Basic, Image, HTML...

  • 293 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @brianz, @balajij8  is right. You can see from the docs that for table visualisations, the Display type list is Basic, Image, HTML, JSON (no Colour scale). For pivot tables, under Styles → Display type for fields added as Values, the options inclu...

  • 0 kudos
1 More Replies
lucca_luna
by New Contributor
  • 642 Views
  • 2 replies
  • 2 kudos

Resolved! Databricks Dashboards: Is there an equivalent to Power BI's SEMANTIC MODEL ?

Hello everyone,I am trying to create a cumulative support ticket chart. I need one line representing the cumulative sum of tickets by creation date, and another line for the cumulative sum by resolution date.While it's easy to achieve this by creatin...

  • 642 Views
  • 2 replies
  • 2 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 2 kudos

Hi @lucca_luna, Great question. The cross-filtering issue you're hitting is because the dashboard treats separate datasets as independent. The workaround is to reshape your data so both date dimensions (creation and resolution) live in a single colum...

  • 2 kudos
1 More Replies
brickster_2018
by Databricks Employee
  • 15813 Views
  • 4 replies
  • 2 kudos

Resolved! Dynamic Allocation vs Cluster Auto-scaling

How is Cluster auto-scaling in Databricks different from Dynamic Allocation in Yarn

  • 15813 Views
  • 4 replies
  • 2 kudos
Latest Reply
de-qrosh
New Contributor III
  • 2 kudos

From spark's documentation dynamic resource can be used on more then just YARN. Is it possible to use it in databricks as well and how does serverless work under the hood in these regards?

  • 2 kudos
3 More Replies
vidya_kothavale
by Contributor
  • 6013 Views
  • 5 replies
  • 3 kudos

Resolved! Issue with MongoDB Spark Connector in Databricks

 I followed the official Databricks documentation("https://docs.databricks.com/en/_extras/notebooks/source/mongodb.html")to integrate MongoDB Atlas with Spark by setting up the MongoDB Spark Connector and configuring the connection string in my Datab...

  • 6013 Views
  • 5 replies
  • 3 kudos
Latest Reply
NaveenBedadala
New Contributor II
  • 3 kudos

try using single-user cluster or non-isolation cluster instead of shared cluster

  • 3 kudos
4 More Replies
Stanciu_Cristi
by New Contributor III
  • 2188 Views
  • 4 replies
  • 6 kudos

Resolved! Genie / Dashboard Workflow

I’m currently working with two workspaces – one for DEV and one for PROD.I’m trying to understand how I can keep the Genie/Dashboard functionalities in sync (mirrored) between these two environments. What is the best way to organize this workflow?Ide...

  • 2188 Views
  • 4 replies
  • 6 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 6 kudos

  Hi ATN, Good question. Based on what I know, dataset_catalog and dataset_schema in the dashboard DAB resource currently apply to datasets that use SQL queries (i.e., the queryLines property), but they do not resolve for datasets that reference metr...

  • 6 kudos
3 More Replies