cancel
Showing results for 
Search instead for 
Did you mean: 
Community Articles
Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Rishabh-Pandey
by Esteemed Contributor
  • 6541 Views
  • 1 replies
  • 1 kudos

Databricks on Databricks: Kicking off the Journey to Governance with Unity Catalog

In the world of data engineering and analytics, governance is paramount. Databricks has taken a significant step forward in this arena with the introduction of Unity Catalog, a unified governance solution for all data and AI assets. This journey to e...

  • 6541 Views
  • 1 replies
  • 1 kudos
Latest Reply
Anushree_Tatode
Databricks Employee
  • 1 kudos

Hi Rishabh ,Unity Catalog is a major advancement in data governance, enhancing how we manage and secure data and AI assets in Databricks. Exciting to see these improvements!Thanks,Anushree 

  • 1 kudos
Brahmareddy
by Esteemed Contributor
  • 1398 Views
  • 1 replies
  • 2 kudos

How to detect the Risks in Claims Data Using Databricks and PySpark

As a data engineer with experience in Databricks and other data engineering tools, I know that processing claims data and detecting risks early can really help in insurance claims processing. In this article, I’ll show you how to use Databricks and P...

  • 1398 Views
  • 1 replies
  • 2 kudos
Latest Reply
Anushree_Tatode
Databricks Employee
  • 2 kudos

Hi, Thanks for sharing this! Kudos for breaking it down so clearly. I’m sure, it will help other community members. Thanks,Anushree

  • 2 kudos
Ajay-Pandey
by Esteemed Contributor III
  • 980 Views
  • 0 replies
  • 2 kudos

September 2024 - Databricks SQL fixes

Added customization options for number formats in dashboard widgets, including currencies and percentages.The width of the Values column in pivot tables now auto-adjusts based on the width of the cell value names.The time displayed in dashboard widge...

  • 980 Views
  • 0 replies
  • 2 kudos
wheersink
by New Contributor
  • 1243 Views
  • 1 replies
  • 0 kudos

SQL code for appending a notebook result into an existing database table

I am attempting to append the results from a notebook query results table into an existing databricks database table.  By chance would someone share an example of the sql code with me?   

  • 1243 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @wheersink ,So let's say you created following table with some sample values.%sql CREATE TABLE dev.default.employee ( id INT, name STRING, age INT, department STRING ); INSERT INTO dev.default.employee VALUES (1, 'John Doe', 30, 'Financ...

  • 0 kudos
Ajay-Pandey
by Esteemed Contributor III
  • 2120 Views
  • 1 replies
  • 2 kudos

🚀 Boost Your Data Pipelines with Dynamic, Data-Driven Databricks Workflows (For Each Task)! 💡

Unlock the power of the For Each task in Databricks to seamlessly iterate over collections—whether it's a list of table names or any value—and dynamically run tasks with specific parameter values. This powerful feature lets you automate repetitive pr...

AjayPandey_0-1724212332991.gif
Community Articles
automation
bigdata
Databricks
dataengineering
Workfow
  • 2120 Views
  • 1 replies
  • 2 kudos
Latest Reply
Rishabh-Pandey
Esteemed Contributor
  • 2 kudos

Thanks for sharing @Ajay-Pandey 

  • 2 kudos
Danny_Lee
by Valued Contributor
  • 1299 Views
  • 0 replies
  • 2 kudos

Code patterns / best practices in SparkSQL, pyspark and Scala

Hi all,I am looking for collections of Code patterns for:SparkSQLpySparkScalaI'm sure there are at least a few repos in Github with snippets and will share them as I find them in this thread.  If you come across any good collections, please post your...

  • 1299 Views
  • 0 replies
  • 2 kudos
Ajay-Pandey
by Esteemed Contributor III
  • 903 Views
  • 0 replies
  • 2 kudos

SHOW CREATE TABLE for materialized views and streaming tables

Added support for SHOW CREATE TABLE for materialized views and streaming tables. This will show the complete CREATE command used at creation time, including properties and schedulesCatalog Explorer "Overview" tab now shows the full CREATE command for...

Community Articles
materialized views
Streaming tables
  • 903 Views
  • 0 replies
  • 2 kudos
Ajay-Pandey
by Esteemed Contributor III
  • 3164 Views
  • 0 replies
  • 2 kudos

LakeFlow Connect

LakeFlow Connect introduces simple ingestion connectors for databases, enterprise applications, and file sources. Set up efficient, low-maintenance pipelines in just a few clicks or via an API. Current sources include Salesforce, Workday, and SQL Ser...

Community Articles
Databricks
ingestion
LakeFlow
  • 3164 Views
  • 0 replies
  • 2 kudos
harripy
by New Contributor III
  • 4160 Views
  • 2 replies
  • 3 kudos

Resolved! Timeout handling with JDBC connection to SQL Warehouse

We have tried to build a connection test logic to our software to try out the reachability of the SQL Warehouse, yet the connection parameters do not seem to function in expected manner.When the SQL Warehouse is running, the connection test functions...

  • 4160 Views
  • 2 replies
  • 3 kudos
Latest Reply
NandiniN
Databricks Employee
  • 3 kudos

Hello, To create the connection you would need an endpoint, I would suggest you to give Serverless warehouse a try so that you don not have to wait, and for the suggestion on the product you may also submit a feedback and share the details of use cas...

  • 3 kudos
1 More Replies
pavlosskev
by New Contributor III
  • 1956 Views
  • 0 replies
  • 1 kudos

Databricks java.util.NoSuchElementException: None.get Error on "SHOW TABLES IN" command

This is not a question, this is just the solution to a problem we encountered in case someone from the community finds it useful.Recently we encountered an issue, where our users' jobs started failing out of nowhere on the following command, with the...

pavlosskev_0-1722501323223.png
  • 1956 Views
  • 0 replies
  • 1 kudos
Ajay-Pandey
by Esteemed Contributor III
  • 900 Views
  • 0 replies
  • 1 kudos

Terraform support for AI/BI dashboards

AI/BI dashboards can now be managed through Terraform.Dashboard using serialized_dashboard attribute: data "databricks_sql_warehouse" "starter" { name = "Starter Warehouse" } resource "databricks_dashboard" "dashboard" { display_name = "...

  • 900 Views
  • 0 replies
  • 1 kudos
nihalataskeen
by New Contributor III
  • 4182 Views
  • 3 replies
  • 4 kudos

Introducing Databricks LakeFlow: A New Solution for Data Engineering

Hello Everyone!!!I hope everyone knows about the exciting new launch from Databricks: LakeFlow. This innovative tool makes data engineering simpler and more efficient. Let’s understand what LakeFlow offers and how it can help data teams. Let’s unders...

nihalataskeen_0-1721208704206.png nihalataskeen_1-1721208784471.png nihalataskeen_2-1721208855689.png
  • 4182 Views
  • 3 replies
  • 4 kudos
Latest Reply
SharathE
New Contributor III
  • 4 kudos

Hi @nihalataskeen Thankyou and I have signed up in the waitlist. Any idea when can we might get access to this??

  • 4 kudos
2 More Replies
Ajay-Pandey
by Esteemed Contributor III
  • 1170 Views
  • 0 replies
  • 0 kudos

Databricks User interface updates

AI/BI dashboards:Improvements:The assistant can now help you edit chart axis titles and control the visibility of chart data labels.You can now assign multiple measures to pivot tables.Added more relative datetime options, such as Last 10 seconds and...

  • 1170 Views
  • 0 replies
  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels