cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MadelynM
by Databricks Employee
  • 3080 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Warehousing & Analytics | Improve performance and increase insights

Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights.  Keynote: Data Warehouse presente...

Screenshot 2024-07-03 at 10.15.26 AM.png
Warehousing & Analytics
AI BI Dashboards
AI BI Genie
Databricks SQL
  • 3080 Views
  • 0 replies
  • 0 kudos
AZHAR-QUADRI
by New Contributor
  • 2547 Views
  • 1 replies
  • 0 kudos

How to create my First Dashboard in Lakeview

Hello Community . I am a newbie here having an experience in tableau and power bi . I wanted to explore Dashboard creation in  Lakeview . I have created a free trial databricks account . Although there are plenty of articles and videos on how to crea...

  • 2547 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @AZHAR-QUADRI ,You probably created workspace in a standard tier, that's why you can't see side bar. Recreate your workspace as a premium tier.

  • 0 kudos
Hubert-Dudek
by Esteemed Contributor III
  • 13115 Views
  • 2 replies
  • 0 kudos

Optimizing SQL Databricks Warehouse Timeout Settings

Did you know the default timeout setting for SQL #databricks Warehouse is two days?The default timeout can be too long for most use cases. You can easily change this for your session or in the general SQL warehouse configuration.

ezgif-1-a917957651.gif
  • 13115 Views
  • 2 replies
  • 0 kudos
Latest Reply
rj_22588
New Contributor II
  • 0 kudos

Hi @Hubert-Dudek we have a java service which uses JDBC Template for connecting to databricks warehouse. We recently set a high connection idle timeout and maxLifeTime for our hikari pool connection. We are now seeing error related to invalid session...

  • 0 kudos
1 More Replies
Martin_Pham
by New Contributor III
  • 2908 Views
  • 3 replies
  • 1 kudos

Resolved! SQLWarehouse Case INsensitive

Does SQL Warehouse now have a feature that allows me to query all data without distinguishing between uppercase and lowercase?

  • 2908 Views
  • 3 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @Martin_Pham ,At the current moment SQL Warehouses don't have this option. But according to one of the employees at databricks, this feature is coming soon: https://community.databricks.com/t5/warehousing-analytics/sqlwarehouse-case-insensitive/td...

  • 1 kudos
2 More Replies
jon1
by New Contributor II
  • 1943 Views
  • 2 replies
  • 0 kudos

How to ensure all resources are released when closing a Connection via DataBricks JDBC Driver?

Hi there,I'm building a Sink that uses the Databricks JDBC Driver version 2.6.27. It appears that regardless of using a try-with-resources block and explicitly closing the Connection, the driver's internals are not releasing IdleConnectionEvictor thr...

  • 1943 Views
  • 2 replies
  • 0 kudos
Latest Reply
RakeshSen01
New Contributor II
  • 0 kudos

Still not fixed got 14k instances of com.databricks.client.jdbc42.internal.apache.http.impl.client.IdleConnectionEvictor 14,037 (0%) 673,776 B (0%) n/a And due to that application got to crashed. can you please help out as this is blocking to release...

  • 0 kudos
1 More Replies
swathiG
by New Contributor III
  • 2245 Views
  • 3 replies
  • 1 kudos

Load backup file

Hi Team,There is a requirement to load a backup file into a database inside a SQL Warehouse. However, I don't see any option to directly load abackup file.I have tried reading the backup file using a notebook, but I’m unable to interpret the contents...

swathiG_0-1723483143998.png
  • 2245 Views
  • 3 replies
  • 1 kudos
Latest Reply
swathiG
New Contributor III
  • 1 kudos

@szymon_dybczak  could you please suggest some other options for how I can proceed to load data from the database?

  • 1 kudos
2 More Replies
AndreasFuchs
by New Contributor
  • 3476 Views
  • 0 replies
  • 0 kudos

Cost Tracing by accessed unity catalog catalog schema, sharing of sql warehouse

Hi community,we have several databricks workspaces per different teams and in each workspace several use case covered.How can we trace the costs per individual use cost for SQL Warehosue / serverless in case we use one SQL warehouse per workspace to ...

  • 3476 Views
  • 0 replies
  • 0 kudos
ilya22239
by New Contributor
  • 878 Views
  • 1 replies
  • 0 kudos

Issue with connecting to Redshift with security groups

I trying to connect databricks workspace to Redshift with security groups. Before I set up security groups it worked fine but now I can't connect to it because of inbound rules. What databricks IP's I should add to inbound rules to make it work?

  • 878 Views
  • 1 replies
  • 0 kudos
Latest Reply
Retired_mod
Esteemed Contributor III
  • 0 kudos

Hi @ilya22239, To connect your Databricks workspace to Redshift, you need to whitelist Databricks cluster IP addresses in your Redshift security group. Start by identifying Databricks IPs, which are dynamic and may require a range or dynamic solution...

  • 0 kudos
Anonymous3
by New Contributor
  • 1141 Views
  • 1 replies
  • 0 kudos

How to migrate Legacy Dashboard from one workspace to another workspace?

Is it possible to migrate Databricks Legacy Dashboards along with associated components such as queries and datasets from one workspace to another? I have attempted to export the Legacy Dashboards along with the queries and datasets, but upon importi...

  • 1141 Views
  • 1 replies
  • 0 kudos
Latest Reply
holly
Databricks Employee
  • 0 kudos

Hello, to migrate between workspaces you'll need a different strategy based on the asset type Legacy dashboards you have completed, but for anyone reading you can use the 'export' functionalityQueries: you can either put them together in a folder and...

  • 0 kudos
dweben
by New Contributor II
  • 868 Views
  • 0 replies
  • 0 kudos

Databricks azure dashboard chart issue

Hi all,Just started using Db Dashboards on Azure. While generating a line chart with a x-axis value based on a date data type I've applied a filter which removes some of the data. The above is without filtering, the below is with filtering. You can o...

dweben_0-1722274099938.png dweben_1-1722274250694.png
  • 868 Views
  • 0 replies
  • 0 kudos
Akshay_Petkar
by Valued Contributor
  • 720 Views
  • 0 replies
  • 0 kudos

Issue with Column Name Conflict While Importing .gz File into Spark DataFrame

I'm encountering an issue while importing a .gz file containing JSON data into a Spark DataFrame in Databricks. The error indicates a column name conflict. Could you please advise on how to resolve this issue and handle duplicate column names during ...

  • 720 Views
  • 0 replies
  • 0 kudos
PM0
by New Contributor
  • 1306 Views
  • 0 replies
  • 0 kudos

Rate limit Usage

We are having Databricks tables and we have an API which query that data, the query will be dynamic and API would allow user to query anything. However users can query lot of data and consume lot of DBU but generic rate limiting wont help, as any sin...

  • 1306 Views
  • 0 replies
  • 0 kudos
pauloquantile
by New Contributor III
  • 15950 Views
  • 6 replies
  • 1 kudos

PowerBI "Token expired while fetching results: TEAuthTokenExpired."

Hi everyone,We are at the moment stumbeling upon a big challenge with loading data into PowerBI. I need some advice!To give a bit of conext: we introduced Databricks instead of Azure Synapse for a client of ours. We are currently busy with moving all...

pauloquantile_0-1693824616520.png
  • 15950 Views
  • 6 replies
  • 1 kudos
Latest Reply
viralpatel
New Contributor II
  • 1 kudos

@Retired_mod Is there any further update from Databricks which can be helpful here OR what @pauloquantile mentioned is the only workaround solution?

  • 1 kudos
5 More Replies
Spoon_Man
by New Contributor II
  • 1378 Views
  • 2 replies
  • 2 kudos

Converting an Entity Attribute Value Data Model to Struct datatype

I'm new to databricks and I have a source data model that stores the data as Name-Value pairs (i.e. normalised) in two columns in the table.EntityIDNameValue1Field1SomeValue11Field2SomeValue21Field3SomeValue32Field1SomeValue12Field3SomeValue3The defi...

  • 1378 Views
  • 2 replies
  • 2 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 2 kudos

Your first approach didn't work, because named_struct needs it's arguments on odd postition to be foldable.So you can think of it in following way, at compile time compiler needs to "see" this value. That's why even if you prepared proper expression ...

  • 2 kudos
1 More Replies
Executivecars
by New Contributor
  • 1328 Views
  • 2 replies
  • 0 kudos

Looking for Chauffeur service Melbourne? Visit Executive cars for Chauffeur service Melbourne. ✓24/7 Operation ✓100+ Vehicles ✓ Chauffeur Cars Melbour...

Looking for Chauffeur service Melbourne? Visit Executive cars for Chauffeur service Melbourne. ✓24/7 Operation ✓100+ Vehicles ✓ Chauffeur Cars Melbourne.

  • 1328 Views
  • 2 replies
  • 0 kudos
Latest Reply
FiveLittleFish
New Contributor II
  • 0 kudos

If you're in Melbourne and need reliable chauffeur services, Executive Cars seems like a great option with its extensive fleet and round-the-clock availability. Safety and reliability are crucial in the transportation industry. Speaking of which, hav...

  • 0 kudos
1 More Replies