Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
I have this:connectionString='mongodb+srv://user:pw@something.jghu.mongodb.net/?retryWrites=true&w=majority&appName=dbricks&tls=true' database='dealflow' collection='activities' frame = spark.read.format("mongodb") \ .option("spark.mongodb.read....
hey @attie_bc I guess you are using All-pourpouse cluster, have you triedcurl https://www.google.comMaybe your cluster doesn’t have internet access? If that’s the case, DNS resolution for your MongoDB Atlas SRV connection string will fail, which woul...
I am currently building a dashboard in Databricks AI/BI and would like to implement a parameter-based chart selection feature. The goal is to allow users to choose a metric from a dropdown (such as Sales, Cost, or Profit), and based on that selection...
Here is something to consider: To implement a parameter-based chart selection feature in a Databricks AI/BI dashboard, follow these steps: Utilize Dashboard Parameters to Drive Dynamic Updates: Databricks dashboards support the use of parameters to ...
Hi. I have a local MongoDB running on an EC2 instance in the same AWS VPC as my Databricks cluster but cannot get Databricks to talk to MongoDB. I've followed the guide at https://docs.databricks.com/aws/en/connect/external-systems/mongodb and have a...
Hey @Kirki maybe its late but I will try to help you or others to create these connectionsFirst thing make sure you have installed inside your cluster the connector org.mongodb.spark:mongo-spark-connector_2.12:3.0.1You can use directly in your spark....
I've got a custom Dash app I've written and am attempting to deploy. It runs fine on my local machine (while accessing my DB SQL Warehouse), but when I try deploying to Databricks, it cannot connect to the data for some reason. I was basically follow...
We can wait till you check the permissions @bferrell @bferrell Best regards,Isi
With the recent addition of dashboard tabs in databricks, I could not find a way to have filters apply to multiple tabs within the same dashboard - so far I have had to manually create and apply filters to each of my tabs individually.
Hello @brld! Currently, dashboards do not support applying filters automatically across multiple tabs. You could try using a global parameter, this parameter will be available to all widgets using the same dataset or query. However, the filter compon...
If I create an external table on AWS Databricks, will it be a Delta table? If not, is there a way to make it a Delta table, or is there no Delta capability for external tables?
Hi Akshay, I believe you can try this for your use case -> CREATE TABLE IF NOT EXISTS catalog.schema.my_external_table ( id INT, name STRING, age INT ) USING delta LOCATION '<location>' This will create a delta table.
When creating a dashboard with multiple pages connected to one dataset. It seems that only visual elements on the same page that the filter is on takes effect. Is there a way to filter all visual elements regardless of which page the filter is on?I h...
Hi folks, We are currently working on global filters, which will allow you to set a filter value or parameter value across multiple pages. Keep an eye out for that feature, coming soon!
Do we have same functionality if we use Databricks with Fabric as it provides with Azure?
We aim to implement Databricks Mirroring through the Fabric APIs for automation. However, the Mirroring API specifically states that it is not compatible with Databricks. Are there alternative APIs that could be used to achieve this functionality?
I am looking to monitor my SQL Warehouse, especially the 'Running Clusters' metric that is available in the monitoring tab of the warehouse. This shows the start and shut down time as well as the number of running clusters:The issue I have run into i...
Hey @Dave_Nithio To monitor the “Running Clusters” metric for your SQL Warehouse, you can use the Databricks Cluster Events API. This API retrieves a list of events related to cluster activity, such as start and shutdown times, and provides paginated...
Hello All!I have a python script which utilizes the databricks SQL for python package in order to pull a databricks table into a pandas dataframe which is used to create a table in a Spotfire report. The table contains ~1.28 million rows, with 155 co...
Hey @barchiel33 ,After reviewing your context further, I believe the most effective approach would be to set up an automated pipeline within Databricks that periodically extracts data based on the frequency you need (daily, weekly, hourly, etc.), cre...
Hi!I have a multi-page dashboard based on a handful of tables sharing a common run_id field.I created a dropdown filter widget on the first page to filter datasets based on the table's run_id field.It worked fine for this page, but how to reuse it fo...
I have the same problem here. filters are not applied while switching pages
I have a delta table with columns like below format. I am querying Databricks using databricks-jdbc 2.7.1 driver. I want to convert the result set to a nested java object.Order_actualPickupAddress_residential -> stringOrder_pickupRequestDetails -> ar...
Here are some suggestions/ideas to consider: To map hundreds of nested fields from a Databricks Delta table to complex Java objects like the Order object described, consider the following approaches: 1. Using Libraries for Object Mapping Utilize ...
Application connects to Databricks serverless SQL warehouse via Databricks JDBC driver. It executes SQL select statements only. We see small number of statements failed each day with the following error detail: java.sql.SQLException: [Databricks][JDB...
Interesting issue, looks like a Cluster Load issue. Recommend filing a support ticket with Databticks to investigate, in case if you haven't already
What’s the best and seamless way to connect Quick Books data to Databricks? Is there any recommended third-party tool or direct connection using JDBC/ODBC?
Hi Akshay, You can use third-party tools that specialize in integrating with external platforms like Databricks. Tools such as CData, QODBC, or similar database connectors provide JDBC and ODBC drivers for QB. These drivers allow you to query Quick...
In the databricks Tutorial (https://docs.databricks.com/gcp/en/sql/get-started/sample-dashboards) , it says we can right click the widget and choose "Download as CSV". However, in my databricks dashboard, when I right click the widgets, there is no ...
I find the reason is that my Admin didn't enable "SQL result download" option. Now it is solved. Thanks ALL.
