cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MadelynM
by Databricks Employee
  • 1241 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Warehousing & Analytics | Improve performance and increase insights

Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights.  Keynote: Data Warehouse presente...

Screenshot 2024-07-03 at 10.15.26 AM.png
Warehousing & Analytics
AI BI Dashboards
AI BI Genie
Databricks SQL
  • 1241 Views
  • 0 replies
  • 0 kudos
User16753724663
by Valued Contributor
  • 12551 Views
  • 5 replies
  • 3 kudos

Resolved! Unable to use CX_Oracle library in notebook

While using cx_oracle python library, it returns the below error:error message: Cannot locate a 64-bit Oracle Client library: "libclntsh.so: cannot open shared object file: No such file or directoryThe cx_oracle library is dependent on native librari...

  • 12551 Views
  • 5 replies
  • 3 kudos
Latest Reply
ovbieAmen
New Contributor II
  • 3 kudos

Hi @AshvinManoj  I used your script and still get same error.   sudo echo 'LD_LIBRARY_PATH="/dbfs/databricks/instantclient_23_6"' >> /databricks/spark/conf/spark-env.shsudo echo 'ORACLE_HOME="/dbfs/databricks/instantclient_23_6"' >> /databricks/spark...

  • 3 kudos
4 More Replies
mbhakta
by New Contributor II
  • 5470 Views
  • 3 replies
  • 2 kudos

Change Databricks Connection on Power BI (service)

We're creating a report with Power BI using data from our AWS Databricks workspace. Currently, I can view the report on Power BI (service) after publishing. Is there a way to change the data source connection, e.g. if I want to change the data source...

  • 5470 Views
  • 3 replies
  • 2 kudos
Latest Reply
J_C
New Contributor II
  • 2 kudos

In the Power BI transform data view, you should be able to access the M-Query code and actually change the server and the host directly. My recommendation is to create a couple of parameters to keep this info for all your queries. Then you can just c...

  • 2 kudos
2 More Replies
AE10
by New Contributor III
  • 1174 Views
  • 4 replies
  • 9 kudos

Embed dashboards in websites and applications

I am embedding a dashboard in my react application using an iframe.https://www.databricks.com/blog/how-embed-aibi-dashboards-your-websites-and-applicationshttps://docs.databricks.com/en/dashboards/index.html#embed-a-dashboard1. How can i let my users...

  • 1174 Views
  • 4 replies
  • 9 kudos
Latest Reply
Preeti_Singh
New Contributor II
  • 9 kudos

Hi , Has anyone gotten this working? I am facing the same issue when trying to get the embedded URL working from an iframe in my React application. I think I have all the necessary permissions in place, but still, the Databricks sign-in page opens in...

  • 9 kudos
3 More Replies
anardinelli
by Databricks Employee
  • 422 Views
  • 0 replies
  • 2 kudos

How do I dimension my DBSQL warehouse correctly?

What is the optimal number of cluster/nodes in a warehouse? Depends on your workload. Our DBSQL guide suggests a size range on two main things: time to execute your query and bytes spilled from it. This link can help you understand better optimizatio...

  • 422 Views
  • 0 replies
  • 2 kudos
bradleyjamrozik
by New Contributor III
  • 2443 Views
  • 3 replies
  • 0 kudos

ODBC Connection Does Not Disconnect

I have an on-premises Power BI Report Server that uses the Simba Spark ODBC Driver (2.8) to connect to Databricks. It can connect to a serverless warehouse successfully and run its queries, but it never seems to disconnect the session, and so the war...

  • 2443 Views
  • 3 replies
  • 0 kudos
Latest Reply
gmiguel
Contributor
  • 0 kudos

Hi @bradleyjamrozik ,The problem is that the current designed behavior of Power BI can lead to the connection not being closed under certain conditions.In short, since Databricks is Async, if an error occurs while fetching data, the connection may no...

  • 0 kudos
2 More Replies
Akshay_Petkar
by Contributor III
  • 924 Views
  • 2 replies
  • 1 kudos

Best Approach for Migrating from EMR to Databricks

I am preparing to migrate from EMR to Databricks and would like to know the best practices for this process. Is there a direct connector, such as a JDBC connector, available to facilitate the migration? Alternatively, would it be more effective to ex...

  • 924 Views
  • 2 replies
  • 1 kudos
Latest Reply
thelogicplus
Contributor
  • 1 kudos

@Akshay_Petkar if you're planning to migrate from your current technology to Databricks, Travinto Technologies' Code Converter Tool is here to make the process seamless. This powerful tool enables you to migrate data, ETL workflows, and reports acros...

  • 1 kudos
1 More Replies
San2
by New Contributor
  • 2714 Views
  • 1 replies
  • 0 kudos

recover a deleted workspace

I cancel my subscription plan (account created via accounts.databricks.com), without noticing that by doing this, all of my workspaces will be deleted. Is this possible to recover those workspace, and if possible, what should I do to recover them? 

  • 2714 Views
  • 1 replies
  • 0 kudos
Latest Reply
steyler-db
Databricks Employee
  • 0 kudos

Hello San2.   To recover a workspace, could you please raise a case with support? They will be helping you to recover these workspaces, otherwise you can reach your account team, who will help you for further steps, for more details you see disaster ...

  • 0 kudos
Ismail1
by New Contributor III
  • 3472 Views
  • 3 replies
  • 0 kudos

Migrating from Databases Postgres MySQL to Databricks.

Hi all, working on this project, my team plans to migrate some data from some databases to Databricks. We plan to run this migration by submitting queries to a warehouse through python on a local machine.Now I was wondering what would be the best app...

  • 3472 Views
  • 3 replies
  • 0 kudos
Latest Reply
thelogicplus
Contributor
  • 0 kudos

@Ismail1  if you're planning to migrate from your current technology to Databricks, Travinto Technologies' Code Converter Tool is here to make the process seamless. This powerful tool enables you to migrate data, ETL workflows, and reports across pla...

  • 0 kudos
2 More Replies
martindlarsson
by New Contributor III
  • 741 Views
  • 3 replies
  • 1 kudos

Warning in dbt task

We are using dbt core and running our transformations in a dbt task. Since a few months ago we have started to see a warning message in our runs. This  started happening after an update of dbt core and it seems that Databricks needs to update the def...

  • 741 Views
  • 3 replies
  • 1 kudos
Latest Reply
martindlarsson
New Contributor III
  • 1 kudos

Both of you missed the sentence "Databricks needs to update the definition of the generated profiles file."The warning is regarding the structure of the profiles.yml which is generated by Databrick. This is not anything I as a user can change accept ...

  • 1 kudos
2 More Replies
kgilson
by New Contributor
  • 335 Views
  • 1 replies
  • 0 kudos

Databricks Apps connection to Azure SQL server

Hello,I am new to Databricks and was asked to evaluate the new Apps function as a way to publish dashboards.  We do not use Databricks today.  We have an Azure SQL database we use as a home grown warehouse.  The question is can I connect directly to ...

  • 335 Views
  • 1 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

To connect your Azure SQL database to Databricks Apps, you will need to pull the data from the existing database into Databricks. Databricks Apps are designed to leverage the data and features within the Databricks platform, which means that the data...

  • 0 kudos
sruthianki
by New Contributor II
  • 484 Views
  • 3 replies
  • 0 kudos

Migrating huge table from synapse to databricks

Hi ,We are looking for a option to copy tables more than 50 TB to be copied from syanpse to databricks on weekly basis , please suggest of there are any feasible ways for samewe are using connector but it is taking too long to copyhttps://learn.micro...

  • 484 Views
  • 3 replies
  • 0 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 0 kudos

There is no databricks documentation on this as it is only involved for a very tiny bit:"CREATE TABLE catalog.schema.table USING PARQUET LOCATION 'url_to_the_parquet_files'.All the rest is done in Azure Data Factory, or you can even use the built-in ...

  • 0 kudos
2 More Replies
vaishalisai
by New Contributor II
  • 418 Views
  • 2 replies
  • 0 kudos

Account client not able to get workspace client

So I did U2M authentication for account-level operations -databricks auth login --host <account-login-url> --account-id <account-id>then I tried to run code-workspaces = account_client.workspaces.list()workspace_obj=account_client.get_workspace_clien...

  • 418 Views
  • 2 replies
  • 0 kudos
Latest Reply
vaishalisai
New Contributor II
  • 0 kudos

I am doing using a service principal so my .databrickscfg has -[databricks-demo]client_id = -----client_secret = ----host = https://accounts.cloud.databricks.com/account_id = ----   

  • 0 kudos
1 More Replies
mtr_nx
by New Contributor II
  • 559 Views
  • 2 replies
  • 0 kudos

Dashboarding Tooltips - How-To's?

Hi Folks, I am looking for any documentation on how Databricks Dashboards handle creating tooltips. Specifically I am interested in dashboards created in the SQL Warehouses (not Workspace Clusters, since using libraries like plotly can have custom to...

  • 559 Views
  • 2 replies
  • 0 kudos
Latest Reply
mtr_nx
New Contributor II
  • 0 kudos

Thank you for sharing this. Unfortunately it doesn't really contain much information on how to manage the tooltips that pop up when you hover over a bar or line in a chart/figure. That's what I am looking to customize in (or at least remove from) my ...

  • 0 kudos
1 More Replies
ianclari
by New Contributor
  • 379 Views
  • 1 replies
  • 0 kudos

Does PowerBI Online dashboard refresh require an on-premises data gateway?

Hi Team good day.I'd like to check on the pattern where dashboards are developed in PowerBI Desktop which are then published to PowerBI Online, using data from Databricks on AWS. In order to refresh the dashboards in PowerBI Online (whether on schedu...

  • 379 Views
  • 1 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

To refresh dashboards in PowerBI Online using data from Databricks on AWS, an on-premises data gateway is not required. This is different from the scenario with Redshift, where an on-premises data gateway is necessary. For Databricks on AWS, you can ...

  • 0 kudos
as5
by New Contributor II
  • 3735 Views
  • 1 replies
  • 3 kudos

SQL Warehouse - increasing concurrent queries limit

Hello everyone,I would like to inquire about the possibility of increasing the default limit of concurrent queries on the cluster which is set to 10.While researching this topic, I noticed that there is no official documentation available regarding t...

Warehousing & Analytics
ConcurrentQueries
warehouse
  • 3735 Views
  • 1 replies
  • 3 kudos
Latest Reply
drag7ter2
New Contributor II
  • 3 kudos

Did you get an answer how to set spark.databricks.maxConcurrentRuns and spark.databricks.maxConcurrentQueries parameters in sql warehouse serverless cluster?

  • 3 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels
Top Kudoed Authors