- 1658 Views
- 5 replies
- 7 kudos
From Associate to Professional: My Learning Plan to ace all Databricks Data Engineer Certifications
In today’s data-driven world, the role of a data engineer is critical in designing and maintaining the infrastructure that allows for the efficient collection, storage, and analysis of large volumes of data. Databricks certifications holds significan...
- 1658 Views
- 5 replies
- 7 kudos
- 7 kudos
@ms_ccg You are correct. I got that error too. Seems like Databricks has removed some of these. I would suggest you to search for those separately via Databricks Academy or external resources. Let me know if you need any help.
- 7 kudos
- 530 Views
- 0 replies
- 1 kudos
📊 Simplifying CDC with Databricks Delta Live Tables & Snapshots 📊
In the world of data integration, synchronizing external relational databases (like Oracle, MySQL) with the Databricks platform can be complex, especially when Change Data Feed (CDF) streams aren’t available. Using snapshots is a powerful way to mana...
- 530 Views
- 0 replies
- 1 kudos
- 295 Views
- 0 replies
- 2 kudos
September 2024 - Databricks SQL fixes
Added customization options for number formats in dashboard widgets, including currencies and percentages.The width of the Values column in pivot tables now auto-adjusts based on the width of the cell value names.The time displayed in dashboard widge...
- 295 Views
- 0 replies
- 2 kudos
- 285 Views
- 1 replies
- 0 kudos
SQL code for appending a notebook result into an existing database table
I am attempting to append the results from a notebook query results table into an existing databricks database table. By chance would someone share an example of the sql code with me?
- 285 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @wheersink ,So let's say you created following table with some sample values.%sql CREATE TABLE dev.default.employee ( id INT, name STRING, age INT, department STRING ); INSERT INTO dev.default.employee VALUES (1, 'John Doe', 30, 'Financ...
- 0 kudos
- 991 Views
- 1 replies
- 2 kudos
🚀 Boost Your Data Pipelines with Dynamic, Data-Driven Databricks Workflows (For Each Task)! 💡
Unlock the power of the For Each task in Databricks to seamlessly iterate over collections—whether it's a list of table names or any value—and dynamically run tasks with specific parameter values. This powerful feature lets you automate repetitive pr...
- 991 Views
- 1 replies
- 2 kudos
- 2 kudos
Thanks for sharing @Ajay-Pandey
- 2 kudos
- 533 Views
- 0 replies
- 2 kudos
Databricks August Update
August 2024 | Databricks on AWS
- 533 Views
- 0 replies
- 2 kudos
- 586 Views
- 0 replies
- 2 kudos
Code patterns / best practices in SparkSQL, pyspark and Scala
Hi all,I am looking for collections of Code patterns for:SparkSQLpySparkScalaI'm sure there are at least a few repos in Github with snippets and will share them as I find them in this thread. If you come across any good collections, please post your...
- 586 Views
- 0 replies
- 2 kudos
- 974 Views
- 0 replies
- 2 kudos
Cross-filtering for AI/BI dashboards
AI/BI dashboards now support cross-filtering, which allows you to click on an element in one chart to filter and update related data in other charts.Cross-filtering allows users to interactively explore relationships and patterns across multiple visu...
- 974 Views
- 0 replies
- 2 kudos
- 356 Views
- 0 replies
- 2 kudos
SHOW CREATE TABLE for materialized views and streaming tables
Added support for SHOW CREATE TABLE for materialized views and streaming tables. This will show the complete CREATE command used at creation time, including properties and schedulesCatalog Explorer "Overview" tab now shows the full CREATE command for...
- 356 Views
- 0 replies
- 2 kudos
- 1065 Views
- 0 replies
- 2 kudos
My Journey with Schema Management in Databricks
When I first started handling schema management in Databricks, I realized that a little bit of planning could save me a lot of headaches down the road. Here’s what I’ve learned and some simple tips that helped me manage schema changes effectively. On...
- 1065 Views
- 0 replies
- 2 kudos
- 1227 Views
- 0 replies
- 2 kudos
LakeFlow Connect
LakeFlow Connect introduces simple ingestion connectors for databases, enterprise applications, and file sources. Set up efficient, low-maintenance pipelines in just a few clicks or via an API. Current sources include Salesforce, Workday, and SQL Ser...
- 1227 Views
- 0 replies
- 2 kudos
- 1651 Views
- 2 replies
- 3 kudos
Resolved! Timeout handling with JDBC connection to SQL Warehouse
We have tried to build a connection test logic to our software to try out the reachability of the SQL Warehouse, yet the connection parameters do not seem to function in expected manner.When the SQL Warehouse is running, the connection test functions...
- 1651 Views
- 2 replies
- 3 kudos
- 3 kudos
Hello, To create the connection you would need an endpoint, I would suggest you to give Serverless warehouse a try so that you don not have to wait, and for the suggestion on the product you may also submit a feedback and share the details of use cas...
- 3 kudos
- 508 Views
- 0 replies
- 1 kudos
Databricks java.util.NoSuchElementException: None.get Error on "SHOW TABLES IN" command
This is not a question, this is just the solution to a problem we encountered in case someone from the community finds it useful.Recently we encountered an issue, where our users' jobs started failing out of nowhere on the following command, with the...
- 508 Views
- 0 replies
- 1 kudos
- 2003 Views
- 0 replies
- 2 kudos
- 2003 Views
- 0 replies
- 2 kudos
- 305 Views
- 0 replies
- 1 kudos
Terraform support for AI/BI dashboards
AI/BI dashboards can now be managed through Terraform.Dashboard using serialized_dashboard attribute: data "databricks_sql_warehouse" "starter" { name = "Starter Warehouse" } resource "databricks_dashboard" "dashboard" { display_name = "...
- 305 Views
- 0 replies
- 1 kudos
- 2206 Views
- 3 replies
- 4 kudos
Introducing Databricks LakeFlow: A New Solution for Data Engineering
Hello Everyone!!!I hope everyone knows about the exciting new launch from Databricks: LakeFlow. This innovative tool makes data engineering simpler and more efficient. Let’s understand what LakeFlow offers and how it can help data teams. Let’s unders...
- 2206 Views
- 3 replies
- 4 kudos
- 4 kudos
Hi @nihalataskeen Thankyou and I have signed up in the waitlist. Any idea when can we might get access to this??
- 4 kudos
