Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
how to create a workspace with community edition?workspace is not being created after login to community edition.
Hey @satyambaranwalc , Communithy Edition has been depricated. You want to use the NEW and IMPROVED Free Edition. You can sign up here: https://www.databricks.com/learn/free-edition Hope this helps, Louis.
Dear community,We are running nightly businessvaults. Last year it stopped to finish on classic wh and after testing until completion when switching to serverless wh it stayed that way but costs have increased a lot. I have been testing numerous spar...
Hey @Ties , When a query reaches 100% completion but fails to commit, it usually points to a metadata bottleneck, file system contention, or a massive data skew. While the job is hanging at 100%, go to the Spark UI -> Executors tab -> Driver -> Threa...
Hi all!Need help configuring ODBC connection on a Mac. I'm receiving the error "The web server failed to start, please verify if port 8020 is being used by another connection or annother application".I've downloaded and installed Databricks ODBC con...
Could you please provide the macOS ODBC driver? I’ve been trying to download it from the official website, but the download links are not working.
Hi,I have created a function that I have applied as a row filter function to multiple tables.The function takes one input parameter (a column value from the table). It then uses session_user() to look up a user in our users table. If the user is foun...
Hi! Sorry for the late reply, lots of holidays No, the user table does not have a row filter in it. The structure is like this:schema1.users: contains a list of users obviously, and it has a column with a customer id for the customer they are allowed...
Hello,we have already spent surprisingly many DBUs, although we have only uploaded a few tiny tables (9 Tables with approx. 10 lines).We had the idea to change the warehouse from serverless starter warehouse to classic 2x small in order to save DBUs....
Hello @jasmin_mbi! Did the suggestion shared above help resolve the issue with creating a classic SQL warehouse? If yes, please consider marking the response as the accepted solution.
I created a Dataflow Gen2 to get data from Databricks. I can see the preview data very quickly (around 5 seconds). But when I run the dataflow, it takes 8 hours and then cancels with a timeout. I’m trying to get 8 tables with the same schema. Six of...
Do you think the Databricks cluster that Microsoft Fabric is connected to needs more capacity?
Good morning, is there any parameter or configuration that causes all my data to be consulted without case distinction? insensitive?
Is there a way to show values in columns instead of rows in pivot table function?I have fields I want to show as rows, and when I want to add multiple fields under values, they show as rows instead of columns.I want each values field to show as colum...
Hello @amekojc , Yes — Databricks AI/BI pivot tables do support showing multiple measure values as columns, not just as a single stacked “values” row. How to set it up Create a Pivot visualization and add your dimension fields under Rows, and optio...
We're experiencing connectivity issues between Power BI (refreshing a dataset) and Databricks.On the Databricks side, we're using a SQL Warehouse (serverless), which reports queries timing out:Query has been timed out due to inactivity.On the Power B...
From everything you've said, it's most likely some kind of Cloud issue with regional availability or network connectivity between Power BI and Databricks. If you want to pursue further I would suggest you log a support ticket with your cloud provider...
On the Databricks documentation they take the TPCH classical tables to create some example https://docs.databricks.com/aws/en/metric-views/create/It's pretty easy to create a metric view using orders and do a measure like SUM(totalprice). Now let's s...
Hi @alxsbn , The Metric View joins are designed for "Many-to-One" relationships. Because orders and lineitem have a One-to-Many relationship (one order has multiple line items), you cannot join lineitem onto an orders-based Metric View and aggregate...
I want to upload excel file to make a table by using UI in databricks.since databricks doesn't accept excel files. So I tried to change the datatype of all the data in excel to string first.Then transform it to csv uft-8, and click the [create ]butt...
If your workspace has Genie spaces enabled, you can upload Excel (.xlsx) directly to Genie and analyze it there; it’s designed for quick validation and NLQ over uploaded files and UC tables. Otherwise, you can use the following approaches: Option A: ...
For one of my client, we are building the entire semantic layer for Data (BI) reporting who uses Snowflake. Is there a way to quickly integrate AI/BI Genie on top of Snowflake ?
Hey @TJ-Leap-Forward , Yes — you can stand up Databricks AI/BI Genie on top of Snowflake quickly by federating Snowflake into Unity Catalog and then building Genie spaces over those governed datasets, without migrating data out of Snowflake. This wo...
I have trouble understanding why, for every report in a dashboard that refers to the same data source, the query re-runs each time Ideally I would want queries being used to fuel the tables for the dashboard run exactly once, and then have the filter...
Your expectation is reasonable, but most dashboards are designed to recompute queries per visual. The best workaround is to precompute the base dataset in a table or view, and have all visuals query that instead. This reduces query load and ensures c...
Hi everyone. I'm keen to understand what impacts the "Optimizing query & pruning files" times seen in the Query Profile History for a sQL Warehouse query. We're querying against delta tables and cannot find any information about what or when a query ...
Hey @Louis_Frolio, thank you for the detailed response - really useful. We'll work through what looks most relevant to us. Question 1: Can you confirm of the `compilation_time_ms` in the metrics from the list query endpoint corresponds to the “Optimi...
Hi everyone,I’m trying to create a table in Unity Catalog from a folder that lives inside a Volume, but I can’t get Terraform to create it successfully.Below is the simplified/anonymous version of my Terraform setup.I have:* A Unity Catalog* A Schema...
It will not work because it will detect that the locations overlap. I tried it in some experiments, like displaying delta_log in volumes, but it didn't work. In fact, it is secure this way as the Delta files in volume would bypass Unity Catalog ACL f...
