cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MadelynM
by Databricks Employee
  • 3009 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Warehousing & Analytics | Improve performance and increase insights

Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights.  Keynote: Data Warehouse presente...

Screenshot 2024-07-03 at 10.15.26 AM.png
Warehousing & Analytics
AI BI Dashboards
AI BI Genie
Databricks SQL
  • 3009 Views
  • 0 replies
  • 0 kudos
MarSier
by New Contributor
  • 3221 Views
  • 2 replies
  • 0 kudos

Resolved! PrivateLink AWS - Databricks, "Cluster terminated. Reason: Security Daemon Registration Exception"

Hi FerArribas,I struggle with PrivateLink connection between Databricks account and my AWS account. I have seen that you had a similar problem. I can create a workspace, but when I try to create a cluster I get an error: "Cluster terminated. Reason: ...

  • 3221 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Marcin Sieradzan​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answ...

  • 0 kudos
1 More Replies
thisisadarshsin
by New Contributor II
  • 4786 Views
  • 2 replies
  • 1 kudos

Loading PowerBi report in databricks..

Hi , I am trying to load power bi report in databricks,but i am getting..empty while printing report.. i have already installed pip install powerbiclient,and device_auth is also successfull,but report = Report(group_id=group_id, report_id=report_id, ...

image.png image
  • 4786 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Adarsh Singh​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...

  • 1 kudos
1 More Replies
marko
by New Contributor II
  • 22124 Views
  • 5 replies
  • 2 kudos

SQL Warehouse high number of concurrent queries

We are going to be a databricks customer and did some PoC tests. Our one test contains dataset in one partitioned table (15colums) is roughly 250M rows, each partition is ~50K-150K rows. Occasionally we have hundreds (up to one thousand) concurrent u...

  • 22124 Views
  • 5 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hi @Marian Kovac​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...

  • 2 kudos
4 More Replies
kori73
by New Contributor
  • 6590 Views
  • 1 replies
  • 0 kudos

Spark UI SQL/Dataframe tab missing queries

Hi,   Recently, I am having some problems viewing the query plans in the Spark UI SQL/Dataframe tab.   I would expect to see large query plans in the SQL tab where we can observe the details of the query such as the rows read/written/shuffled. Howeve...

image (10) image (7) (1)
  • 6590 Views
  • 1 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

@Koray Beyaz​ :This issue may be related to a change in the default behavior of the Spark UI in recent versions of Databricks Runtime. In earlier versions, the Spark UI would display the full query plan for SQL and DataFrame operations in the SQL/Dat...

  • 0 kudos
ManuShell
by New Contributor III
  • 10614 Views
  • 10 replies
  • 7 kudos

DataBricks SQL: ODBC url to connect to DataBricks SQL tables

Hello Everyone,   We are trying to connect DataBricks SQL warehouse using ODBC url but we are not able to do it. We can see only JDBC url in connection details which works fine.   Was anyone able to connect using ODBC url? Can someone please help?

  • 10614 Views
  • 10 replies
  • 7 kudos
Latest Reply
Sumit_Kumar
New Contributor III
  • 7 kudos

Hi,Can you please try to connect once after disabling VPN in your local system (if its enabled)?Thanks.

  • 7 kudos
9 More Replies
RachaelCreager_
by New Contributor II
  • 1838 Views
  • 3 replies
  • 0 kudos

I was setting a password for a new account in the databricks management page, and when I attempted to add a password of 50 characters, the prompt said...

I was setting a password for a new account in the databricks management page, and when I attempted to add a password of 50 characters, the prompt said "password must be no more than 50 characters" (bold added by me for emphasis). It would only accept...

  • 1838 Views
  • 3 replies
  • 0 kudos
Latest Reply
RachaelCreager_
New Contributor II
  • 0 kudos

@Vidula Khanna​ This question isn't related to Training -- none of the prompts in that ticket page are relevant. It's related to the Databricks Account Management Page password-setting prompt.

  • 0 kudos
2 More Replies
Andrei_Radulesc
by Contributor III
  • 4564 Views
  • 4 replies
  • 0 kudos

Resolved! Run Terraform from CLI by non-admin users

We have a team of multiple people, and they need to do Databricks Terraform config from the CLI. We'd like to do this without having all people be account admins in Databricks.What is the best way to do that?Right now, we have Terraform set up so tha...

  • 4564 Views
  • 4 replies
  • 0 kudos
Latest Reply
Andrei_Radulesc
Contributor III
  • 0 kudos

I think the Service Principal definitely works for workspaces created from scratch with the Service Principal. I've tested that in my test environment, and have not encountered these kinds of authentication problem.The issue I am seeing is with works...

  • 0 kudos
3 More Replies
Barb
by New Contributor III
  • 2119 Views
  • 2 replies
  • 0 kudos

Why aren't my databricks "recents" saving?

Hi all,My databricks "recents" (recent notebooks) are only saving for a given 'session'. If I close databricks, and come back in, all of my recents are cleared both on the login screen and the one I get when I click the "recents" icon on the left me...

  • 2119 Views
  • 2 replies
  • 0 kudos
Latest Reply
JayZ
New Contributor II
  • 0 kudos

Did you ever find a solution to this? My recents aren't working either.

  • 0 kudos
1 More Replies
197250
by New Contributor II
  • 2269 Views
  • 2 replies
  • 1 kudos

PowerBI service refresh Databricks dataset

I have a number of datasets that are published to Power BI service. When I published these from Power BI Desktop, I was able to enable period refresh. This morning however, the periodic refresh failed with a 403 Authentication Failed error. I can't e...

  • 2269 Views
  • 2 replies
  • 1 kudos
Latest Reply
Vartika
Databricks Employee
  • 1 kudos

Hi @Michael Anckaert​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.T...

  • 1 kudos
1 More Replies
Kanna1706
by New Contributor III
  • 2989 Views
  • 3 replies
  • 2 kudos

Resolved! About SQL workspace option

I can't find SQL workspace option in my free community edition.

  • 2989 Views
  • 3 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hi @Machireddy Nikitha​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best an...

  • 2 kudos
2 More Replies
shweta1105
by New Contributor III
  • 3306 Views
  • 6 replies
  • 0 kudos
  • 3306 Views
  • 6 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @shweta srivastava​ Thank you for posting your question in our community! We are happy to assist you.Elevate our community by acknowledging exceptional contributions. Your participation in marking the best answers is a testament to our collective ...

  • 0 kudos
5 More Replies
Carkis7
by New Contributor II
  • 7117 Views
  • 4 replies
  • 6 kudos

Databricks SQL Option

Hello Everyone,   I want you to ask how can I get the SQL option on Databricks, because I am doing the Data Analyst courses and I do not have that option, just Data Engineer and Machine Learning.    I am connecting through Microsoft Azure..   Waiting...

  • 7117 Views
  • 4 replies
  • 6 kudos
Latest Reply
Hemant
Valued Contributor II
  • 6 kudos

@Luis Carcaño​  You can switch your persona from data science and engineering to SQL, but this is only possible if you have a premium Databricks workspace. To do so, please create a new workspace with a premium tier.

  • 6 kudos
3 More Replies
bd
by New Contributor III
  • 2696 Views
  • 1 replies
  • 0 kudos

Resolved! How to debug Autoloader with `pathGlobFilter` option producing empty dataframe

When I try setting the `pathGlobFilter` on my Autoloader job, it appears to filter out everything. The bucket/directory setup is like`s3a://my_bucket/level_1_dir/level_2_dir/<some_name>/one/two/<the_files_i_want_to_load>`So what I want is to be able ...

  • 2696 Views
  • 1 replies
  • 0 kudos
Latest Reply
bd
New Contributor III
  • 0 kudos

the thing that actually worked for me was to skip the `pathGlobFilter` and do this filtering in the `load` invocation: `stream.load(f"{MY_S3_PATH}{include_patterns}"). This portion of the docs could use some editing, imo.

  • 0 kudos