cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MadelynM
by Databricks Employee
  • 3065 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Warehousing & Analytics | Improve performance and increase insights

Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights.  Keynote: Data Warehouse presente...

Screenshot 2024-07-03 at 10.15.26 AM.png
Warehousing & Analytics
AI BI Dashboards
AI BI Genie
Databricks SQL
  • 3065 Views
  • 0 replies
  • 0 kudos
shweta1105
by New Contributor III
  • 3336 Views
  • 6 replies
  • 0 kudos
  • 3336 Views
  • 6 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @shweta srivastava​ Thank you for posting your question in our community! We are happy to assist you.Elevate our community by acknowledging exceptional contributions. Your participation in marking the best answers is a testament to our collective ...

  • 0 kudos
5 More Replies
Carkis7
by New Contributor II
  • 7168 Views
  • 4 replies
  • 6 kudos

Databricks SQL Option

Hello Everyone,   I want you to ask how can I get the SQL option on Databricks, because I am doing the Data Analyst courses and I do not have that option, just Data Engineer and Machine Learning.    I am connecting through Microsoft Azure..   Waiting...

  • 7168 Views
  • 4 replies
  • 6 kudos
Latest Reply
Hemant
Valued Contributor II
  • 6 kudos

@Luis Carcaño​  You can switch your persona from data science and engineering to SQL, but this is only possible if you have a premium Databricks workspace. To do so, please create a new workspace with a premium tier.

  • 6 kudos
3 More Replies
bd
by New Contributor III
  • 2733 Views
  • 1 replies
  • 0 kudos

Resolved! How to debug Autoloader with `pathGlobFilter` option producing empty dataframe

When I try setting the `pathGlobFilter` on my Autoloader job, it appears to filter out everything. The bucket/directory setup is like`s3a://my_bucket/level_1_dir/level_2_dir/<some_name>/one/two/<the_files_i_want_to_load>`So what I want is to be able ...

  • 2733 Views
  • 1 replies
  • 0 kudos
Latest Reply
bd
New Contributor III
  • 0 kudos

the thing that actually worked for me was to skip the `pathGlobFilter` and do this filtering in the `load` invocation: `stream.load(f"{MY_S3_PATH}{include_patterns}"). This portion of the docs could use some editing, imo.

  • 0 kudos
Prudhvi_Raj
by New Contributor III
  • 3142 Views
  • 6 replies
  • 1 kudos

Resolved! ***[Urgent] Not received Certificate Databricks Associate Data Engineering

Hi Nadia, ​ I have written Databricks Associate Data Engineering certification exam and cleared with 93.33%, its already been 48 hours and I have not received any certificate yet. Please treat this as urgent.​My Mail id: prudhviraj2744@gmail...

  • 3142 Views
  • 6 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Adella Sai Prudhvi Raj​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.You...

  • 1 kudos
5 More Replies
PareDesa_10157
by New Contributor II
  • 2816 Views
  • 1 replies
  • 1 kudos

Loading model file on databrick

Hello,I am having hard time loading certain model of python (scispacy model)I want to load the model on the location so i can call it on the code running in databrick python notebookwanted to load the model file (zipped)How can I load it on the clust...

  • 2816 Views
  • 1 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Paresh Desai​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...

  • 1 kudos
brickster_2018
by Databricks Employee
  • 14322 Views
  • 3 replies
  • 1 kudos

Resolved! Dynamic Allocation vs Cluster Auto-scaling

How is Cluster auto-scaling in Databricks different from Dynamic Allocation in Yarn

  • 14322 Views
  • 3 replies
  • 1 kudos
Latest Reply
shan_chandra
Databricks Employee
  • 1 kudos

Additional reads on the same topic:https://databricks.com/blog/2018/05/02/introducing-databricks-optimized-auto-scaling.htmlhttps://spark.apache.org/docs/latest/job-scheduling.html#dynamic-resource-allocation

  • 1 kudos
2 More Replies
Mado
by Valued Contributor II
  • 3554 Views
  • 2 replies
  • 2 kudos

Resolved! How to get cluster metrics by Power BI?

Assume that I have a few clusters in Databricks and I want to make a report in Power BI that shows cluster metrics. For example:   How many hours clusters were running categorized by usernameCostCPU load   Is there any way that I can send this inform...

  • 3554 Views
  • 2 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hi @Mohammad Saber​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...

  • 2 kudos
1 More Replies
Mado
by Valued Contributor II
  • 5719 Views
  • 8 replies
  • 3 kudos

How to get Databricks table usage by Power BI?

Assume that I have a few tables in Databricks and I want to make a report in Power BI that shows the No. of table views for a specific user.   I mean, how many times has a user queried a specific table? This is the information I want to send from Dat...

  • 5719 Views
  • 8 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Mohammad Saber​  I'm sorry you could not find a solution to your problem in the answers provided.Our community strives to provide helpful and accurate information, but sometimes an immediate solution may only be available for some issues.I sugges...

  • 3 kudos
7 More Replies
sensanjoy
by Contributor II
  • 15379 Views
  • 10 replies
  • 4 kudos

Resolved! Databricks SQL restful API to query delta table

As of today, can we use any Databricks SQL Restful API to query Delta Tables stored in ADLS from any external UI?There is some information mentioned over this link https://docs.databricks.com/sql/api/index.html? but not sure how to use them!!Checked ...

  • 15379 Views
  • 10 replies
  • 4 kudos
Latest Reply
apingle
Contributor
  • 4 kudos

I just saw this today.. https://www.databricks.com/blog/2023/03/07/databricks-sql-statement-execution-api-announcing-public-preview.html

  • 4 kudos
9 More Replies
prem0305
by New Contributor
  • 1727 Views
  • 2 replies
  • 0 kudos

hi,i am student and just created databricks communit accont for practice but once i log out i am not able to login with my credentials again.email: pr...

hi,i am student and just created databricks communit accont for practice but once i log out i am not able to login with my credentials again.email: prem.fsda@gmail.comkindly helpthankyou

  • 1727 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @PREM RANJAN​ I hope you are doing great!Sorry for the inconvenience. Please specify that the issue is related to Databricks Community or Community -Edition or share the screenshot. Kindly, do let me know on a priority basis.Have a great day.Thank...

  • 0 kudos
1 More Replies
Afeez_Raheem
by New Contributor III
  • 7039 Views
  • 6 replies
  • 7 kudos

Resolved! Inability to refresh PBI report( in Power BI Service) connected to Databricks.

This issue pertains to our Power BI report connecting to Azure Databricks data source. Here is the issue. We are able to successfully connect (to Databricks) and refresh the dataset on Power BI Desktop, but the visuals stop displaying as soon as the ...

  • 7039 Views
  • 6 replies
  • 7 kudos
Latest Reply
Afeez_Raheem
New Contributor III
  • 7 kudos

@Ajay Pandey​ His question did drive me to test a few things out, so it was helpful. Thank you

  • 7 kudos
5 More Replies
vinaykumar
by New Contributor III
  • 8463 Views
  • 4 replies
  • 6 kudos

SQL Query execution plan explain and optimize the performance for query run.

When we executing SQL query in databricks SQL warehouse editor what will be best practices to optimize the execution plan and get result faster

  • 8463 Views
  • 4 replies
  • 6 kudos
Latest Reply
Anonymous
Not applicable
  • 6 kudos

Hi @vinay kumar​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks...

  • 6 kudos
3 More Replies
SIRIGIRI
by Contributor
  • 675 Views
  • 0 replies
  • 0 kudos

@C P​ @Javier Javier​ @akash kumar​ @sasikumar sagabala​ @Rajesh Jakkula​ @Pratiksha Salwe​ @akash kumar​ @Arjun Krishna S R​ @Dohar Silalahi​ @Sparkl...

@C P​ @Javier Javier​ @akash kumar​ @sasikumar sagabala​ @Rajesh Jakkula​ @Pratiksha Salwe​ @akash kumar​ @Arjun Krishna S R​ @Dohar Silalahi​ @SparklePandas​ 

  • 675 Views
  • 0 replies
  • 0 kudos