cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MadelynM
by Databricks Employee
  • 1023 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Warehousing & Analytics | Improve performance and increase insights

Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights.  Keynote: Data Warehouse presente...

Screenshot 2024-07-03 at 10.15.26 AM.png
Warehousing & Analytics
AI BI Dashboards
AI BI Genie
Databricks SQL
  • 1023 Views
  • 0 replies
  • 0 kudos
Priyam1
by New Contributor III
  • 2419 Views
  • 1 replies
  • 0 kudos

databricks notebook cell doesn't show the output intermittently

Recently, it seems that there has been an intermittent issue where the output of a notebook cell doesn't display, even though the code within the cell executes successfully. For instance, there are times when simply printing a dataframe yields no out...

  • 2419 Views
  • 1 replies
  • 0 kudos
Latest Reply
Lakshay
Databricks Employee
  • 0 kudos

Do you see the output in stdout logfile in such a scenario?

  • 0 kudos
Linglin
by New Contributor III
  • 4063 Views
  • 2 replies
  • 0 kudos

How to pass multiple Value to a dynamic Variable in Dashboard underlying SQL

select         {{user_defined_variable}} as my_var,                   count(*) as cntfrom            my_tablewhere         {{user_defined_variable}} = {{value}} for user_defined_variable, I use query based dropdown list to get a column_name I'd like ...

  • 4063 Views
  • 2 replies
  • 0 kudos
primaj
by New Contributor III
  • 10574 Views
  • 14 replies
  • 9 kudos

Introspecting catalogs and schemas JDBC in Pycharm

Hey,I've managed to add my SQL Warehouse as a data source in Pycharm using the JDBC driver and can query the warehouse from an SQL console within Pycharm. This is great, however, what I'm struggling with is getting the catalogs and schemas to show in...

  • 10574 Views
  • 14 replies
  • 9 kudos
Latest Reply
gem7318
New Contributor II
  • 9 kudos

You need to explicitly tell your JetBrains tool to introspect the database using JDBC metadata.I think the reason it (sometimes) works in Datagrip but not PyCharm, IntelliJ, etc is because the default settings can be different across tools and even v...

  • 9 kudos
13 More Replies
Jennifer
by New Contributor III
  • 8259 Views
  • 3 replies
  • 0 kudos

How do I write dataframe to s3 without partition column name on the path

I am currently trying to write a dataframe to s3 likedf.write.partitionBy("col1","col2").mode("overwrite").format("json").save("s3a://my_bucket/")The path becomes `s3a://my_bucket/col1=abc/col2=opq/`But I want to path to be `s3a://my_bucket/abc/opq/`...

  • 8259 Views
  • 3 replies
  • 0 kudos
Latest Reply
Sidhant07
Databricks Employee
  • 0 kudos

Hi @Jennifer , The default behavior of the .partitionBy() function in Spark is to create a directory structure with partition column names. This is similar to Hive's partitioning scheme and is done for optimization purposes. Hence, you cannot directl...

  • 0 kudos
2 More Replies
96286
by Contributor
  • 3894 Views
  • 3 replies
  • 0 kudos

Enabling serverless type for SQL warehouse running on Google Cloud Platform

I am in the process of connecting Looker to one of my Databricks databases. To reduce startup time on my SQL warehouse cluster I would like to change the type from "Pro" to "Serverless". I cannot find a way to do that and "Serverless" is not an optio...

Warehousing & Analytics
GCP
serverless
sql
warehouse
  • 3894 Views
  • 3 replies
  • 0 kudos
Latest Reply
Kayla
Valued Contributor
  • 0 kudos

Echoing glawry - I'd be fascinated to know if this "Ephemeral clusters" are a thing.

  • 0 kudos
2 More Replies
rushank29
by New Contributor II
  • 1542 Views
  • 0 replies
  • 0 kudos

pm4py no visualization

Hi,I am trying to use pm4py library to visualize my data. my code executes perfectly but there is no visualization how can i solve this problem ? There is no error message#processmining # databricks #pm4py

  • 1542 Views
  • 0 replies
  • 0 kudos
Anuroop
by New Contributor II
  • 2445 Views
  • 2 replies
  • 1 kudos

Ticket

Hi Khishore,​Please help me how you raised ticket for the certificate ​issue.​Thanks,Anuroop​

  • 2445 Views
  • 2 replies
  • 1 kudos
Latest Reply
AshR
Contributor
  • 1 kudos

Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training

  • 1 kudos
1 More Replies
557879
by New Contributor
  • 1943 Views
  • 0 replies
  • 0 kudos

Tableau connection error - errorCode=180002

Hi,I am trying to connect to databricks from tableau server and facing this error OAuth error response, generally means someone clicked cancel: access_denied (errorCode=180002)I have added it in "app connections" under account console. Any pointers w...

  • 1943 Views
  • 0 replies
  • 0 kudos
roshambles
by New Contributor II
  • 2092 Views
  • 2 replies
  • 0 kudos

Unable to use Serverless SQL Warehouse

Hello, We have a workspace in West Europe, which we were using with multiple Serverless SQL Warehouses.  Recently it suddenly stopped working and presented with the following error when trying to restart an existing serverless warehouse.  I am an adm...

roshambles_0-1709468629547.png
Warehousing & Analytics
serverless
SQL warehouse
  • 2092 Views
  • 2 replies
  • 0 kudos
Latest Reply
roshambles
New Contributor II
  • 0 kudos

Raised a ticket with Azure support but they haven't been very helpful so far to be honest.  No uncleared bills and serverless seems disabled for all workspaces in the subscription.  Someone mentioned accepting terms and conditions for serverless comp...

  • 0 kudos
1 More Replies
dwfchu
by New Contributor
  • 9315 Views
  • 0 replies
  • 0 kudos

SQL Warehouse external (to Databricks) access patterns and suggestions

Hi All!Has anyone encountered a situation where we need to setup data access for Unity Catalog tables for read access such as external data marts, dashboard tools and etc.We are currently using Databricks to serve data to people in our organisation t...

Warehousing & Analytics
access
JDBC
permissions
  • 9315 Views
  • 0 replies
  • 0 kudos
EWhitley
by New Contributor III
  • 1260 Views
  • 1 replies
  • 1 kudos

Documentation on the "test" capabilities in a DAB?

I see there’s a “test” capability within a DAB, but I’d like to know more about how this should/could be used. Does anyone know of any documentation or examples which might provide insights into its intended use?

  • 1260 Views
  • 1 replies
  • 1 kudos
Latest Reply
AlliaKhosla
Databricks Employee
  • 1 kudos

Hi @EWhitley     You can check and validate whether the Asset Bundle configuration is valid or not by using the below command   databricks bundle validate   If a JSON representation of the bundle configuration is returned, then the validation succeed...

  • 1 kudos
manish05485
by New Contributor II
  • 1924 Views
  • 2 replies
  • 0 kudos

Issue setting metastore in GCP Databricks

While setting up metastore in GCP Databricks, I added the bucket name and then  service account permissons as well. Still my catalog dont have base root location. This deters me from creating table in my catalog. Root storage credential for metastore...

  • 1924 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ayushi_Suthar
Databricks Employee
  • 0 kudos

Hi @manish05485 , Good Day!  Error:Root storage credential for metastore XXXXXX does not exist. Please contact your Databricks representative or consider updating the metastore with a valid storage Error states that the data access configuration for ...

  • 0 kudos
1 More Replies
Octavian1
by Contributor
  • 4268 Views
  • 6 replies
  • 1 kudos

Resolved! api/2.0/sql/history/queries endpoint does not return query execution time

Hi,I cannot see the query execution time in the response to the "api/2.0/sql/history/queries" request.Basically, I get only the following fields:{"next_page_token":...,"has_next_page":...,"res":[  {     "query_id":...,     "status":..,     "query_tex...

  • 4268 Views
  • 6 replies
  • 1 kudos
Latest Reply
Yeshwanth
Databricks Employee
  • 1 kudos

Spot on @feiyun0112  So this confirms that the API is working as expected right?

  • 1 kudos
5 More Replies
youssefmrini
by Databricks Employee
  • 3358 Views
  • 3 replies
  • 0 kudos

Getting started with Databricks lakeview Dashboards

Watch the youtube video : https://www.youtube.com/watch?v=MO7Dk035654

  • 3358 Views
  • 3 replies
  • 0 kudos
Latest Reply
sheilaL
New Contributor II
  • 0 kudos

I am attempting to recreate a legacy dashboard in Lakeview. The bar graph in no way resembles what I created in the SQL visualization editor. Lakeview has far fewer formatting options for one thing.How do I recreate the graph so that it resembles the...

  • 0 kudos
2 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels
Top Kudoed Authors