cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MadelynM
by Databricks Employee
  • 1083 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Warehousing & Analytics | Improve performance and increase insights

Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights.  Keynote: Data Warehouse presente...

Screenshot 2024-07-03 at 10.15.26 AM.png
Warehousing & Analytics
AI BI Dashboards
AI BI Genie
Databricks SQL
  • 1083 Views
  • 0 replies
  • 0 kudos
MetaRossiVinli
by Contributor
  • 2444 Views
  • 1 replies
  • 1 kudos

Resolved! In Python, Streaming read by DLT from Hive Table

I am pulling data from Google BigQuery and writing it to a bronze table on an interval. I do this in a separate continuous job because DLT did not like the BigQuery connector calling collect on a dataframe inside of DLT.In Python, I would like to rea...

  • 2444 Views
  • 1 replies
  • 1 kudos
Latest Reply
MetaRossiVinli
Contributor
  • 1 kudos

The below code is a solution. I was missing that I could read from a table with `spark.readStream.format("delta").table("...")`. Simple. Just missed it. This is different than `dlt.read_stream()` which appears in the examples a lot.This is referenced...

  • 1 kudos
Salty
by New Contributor II
  • 3491 Views
  • 4 replies
  • 2 kudos

Resolved! DBSQL subscriptions method returning `410: Gone`

We've been using the DQBSQL API to perform CRUD on queries and alerts.Part of that process added a slack channel as alert destination using the /subscriptions element on an alert post as below.As of today I am getting a 410 'Gone' error from the API ...

  • 3491 Views
  • 4 replies
  • 2 kudos
Latest Reply
Salty
New Contributor II
  • 2 kudos

Hi @Suteja Kanuri​ , @Vidula Khanna​ thanks for getting back with a solution.The suggested solution looks fine, but for a number of reasons I went with another option to use the Jobs API. This allowed me to preserve more of the automation I had alrea...

  • 2 kudos
3 More Replies
Cricket_Clues
by New Contributor
  • 671 Views
  • 0 replies
  • 0 kudos

IPL Prediction is very challenging task. Due to the nature of the game, it is challenging to correctly predict the winner because even one player&#3...

IPL Prediction is very challenging task. Due to the nature of the game, it is challenging to correctly predict the winner because even one player's performance can significantly affect the outcome. It is also challenging to forecast which club woul...

processed-8495b0b6-8f16-4ddb-a3a6-fa4a74317b49_Xle2DZmp (1)
  • 671 Views
  • 0 replies
  • 0 kudos
MarSier
by New Contributor
  • 2640 Views
  • 2 replies
  • 0 kudos

Resolved! PrivateLink AWS - Databricks, "Cluster terminated. Reason: Security Daemon Registration Exception"

Hi FerArribas,I struggle with PrivateLink connection between Databricks account and my AWS account. I have seen that you had a similar problem. I can create a workspace, but when I try to create a cluster I get an error: "Cluster terminated. Reason: ...

  • 2640 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Marcin Sieradzan​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answ...

  • 0 kudos
1 More Replies
thisisadarshsin
by New Contributor II
  • 3930 Views
  • 2 replies
  • 1 kudos

Loading PowerBi report in databricks..

Hi ,I am trying to load power bi report in databricks,but i am getting..empty while printing report.. i have already installed pip install powerbiclient,and device_auth is also successfull,but report = Report(group_id=group_id, report_id=report_id, ...

image.png image
  • 3930 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Adarsh Singh​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...

  • 1 kudos
1 More Replies
marko
by New Contributor II
  • 17553 Views
  • 5 replies
  • 2 kudos

SQL Warehouse high number of concurrent queries

We are going to be a databricks customer and did some PoC tests. Our one test contains dataset in one partitioned table (15colums) is roughly 250M rows, each partition is ~50K-150K rows. Occasionally we have hundreds (up to one thousand) concurrent u...

  • 17553 Views
  • 5 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hi @Marian Kovac​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...

  • 2 kudos
4 More Replies
kori73
by New Contributor
  • 5388 Views
  • 1 replies
  • 0 kudos

Spark UI SQL/Dataframe tab missing queries

Hi,Recently, I am having some problems viewing the query plans in the Spark UI SQL/Dataframe tab.I would expect to see large query plans in the SQL tab where we can observe the details of the query such as the rows read/written/shuffled. However, I s...

image (10) image (7) (1)
  • 5388 Views
  • 1 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

@Koray Beyaz​ :This issue may be related to a change in the default behavior of the Spark UI in recent versions of Databricks Runtime. In earlier versions, the Spark UI would display the full query plan for SQL and DataFrame operations in the SQL/Dat...

  • 0 kudos
ManuShell
by New Contributor III
  • 7069 Views
  • 10 replies
  • 7 kudos

DataBricks SQL: ODBC url to connect to DataBricks SQL tables

Hello Everyone,We are trying to connect DataBricks SQL warehouse using ODBC url but we are not able to do it. We can see only JDBC url in connection details which works fine.Was anyone able to connect using ODBC url? Can someone please help?

  • 7069 Views
  • 10 replies
  • 7 kudos
Latest Reply
Sumit_Kumar
New Contributor III
  • 7 kudos

Hi,Can you please try to connect once after disabling VPN in your local system (if its enabled)?Thanks.

  • 7 kudos
9 More Replies
RachaelCreager_
by New Contributor II
  • 1455 Views
  • 3 replies
  • 0 kudos

I was setting a password for a new account in the databricks management page, and when I attempted to add a password of 50 characters, the prompt said...

I was setting a password for a new account in the databricks management page, and when I attempted to add a password of 50 characters, the prompt said "password must be no more than 50 characters" (bold added by me for emphasis). It would only accept...

  • 1455 Views
  • 3 replies
  • 0 kudos
Latest Reply
RachaelCreager_
New Contributor II
  • 0 kudos

@Vidula Khanna​ This question isn't related to Training -- none of the prompts in that ticket page are relevant. It's related to the Databricks Account Management Page password-setting prompt.

  • 0 kudos
2 More Replies
Andrei_Radulesc
by Contributor III
  • 3515 Views
  • 4 replies
  • 0 kudos

Resolved! Run Terraform from CLI by non-admin users

We have a team of multiple people, and they need to do Databricks Terraform config from the CLI. We'd like to do this without having all people be account admins in Databricks.What is the best way to do that?Right now, we have Terraform set up so tha...

  • 3515 Views
  • 4 replies
  • 0 kudos
Latest Reply
Andrei_Radulesc
Contributor III
  • 0 kudos

I think the Service Principal definitely works for workspaces created from scratch with the Service Principal. I've tested that in my test environment, and have not encountered these kinds of authentication problem.The issue I am seeing is with works...

  • 0 kudos
3 More Replies
Barb
by New Contributor III
  • 1502 Views
  • 2 replies
  • 0 kudos

Why aren't my databricks "recents" saving?

Hi all,My databricks "recents" (recent notebooks) are only saving for a given 'session'. If I close databricks, and come back in, all of my recents are cleared both on the login screen and the one I get when I click the "recents" icon on the left me...

  • 1502 Views
  • 2 replies
  • 0 kudos
Latest Reply
JayZ
New Contributor II
  • 0 kudos

Did you ever find a solution to this? My recents aren't working either.

  • 0 kudos
1 More Replies
197250
by New Contributor II
  • 1847 Views
  • 2 replies
  • 1 kudos

PowerBI service refresh Databricks dataset

I have a number of datasets that are published to Power BI service. When I published these from Power BI Desktop, I was able to enable period refresh. This morning however, the periodic refresh failed with a 403 Authentication Failed error. I can't e...

  • 1847 Views
  • 2 replies
  • 1 kudos
Latest Reply
Vartika
Databricks Employee
  • 1 kudos

Hi @Michael Anckaert​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.T...

  • 1 kudos
1 More Replies
Kanna1706
by New Contributor III
  • 2339 Views
  • 3 replies
  • 2 kudos

Resolved! About SQL workspace option

I can't find SQL workspace option in my free community edition.

  • 2339 Views
  • 3 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hi @Machireddy Nikitha​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best an...

  • 2 kudos
2 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels
Top Kudoed Authors