Page Title

Welcome to the Databricks Community

Learn, network, and celebrate with data practitioners from around the world.

cancel
Showing results for 
Search instead for 
Did you mean: 
94754members
44883posts

Community Activity

scalar function in databricks

Hi Expert,here is sql server scalar function how to convert in databricks functionSQLCREATE function [dbo].[gettrans](@PickupCompany nvarchar(2),@SupplyCountry int, @TxnSource nvarchar(10),@locId nvarchar(50), @ExternalSiteId nvarchar(50))RETURNS INT...

Shree23 by New Contributor III
  • 2 Views
  • 0 replies
  • 0 kudos

Exporting delta table to one CSV

Process to export a delta table is taking ~2hrs.Delta table has 66 partitions with total size of ~6gb, 4million rows and 270 columns.Used below commanddf.coalesce(1).write.csv("path")what are my options to reduce the time?

561064 by New Contributor II
  • 56 Views
  • 5 replies
  • 0 kudos

DBT Jobs || API call returns "Internal Error"

Hey there,I am currently using the Databricks API to trigger a specific DBT job. For this, I am calling the API in a Web Activity on Azure datafactory and sending as headers the token and for the body I am sending the Job ID and the necessary vars I ...

dcc by New Contributor
  • 49 Views
  • 1 replies
  • 0 kudos

DLT pipeline evolution schema error

Hello everyone, I am currently working on my first dlt pipeline, and I stumped on a problem which I am struggling to solve.I am working on several tables where I have a column called "my_column" with an array of json with two keys : 1 key : score, 2n...

TiagoMag by New Contributor
  • 40 Views
  • 1 replies
  • 0 kudos
Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.

Top Kudoed Authors

Latest from our Blog

Overwatch: The Observability Tool for Databricks

What is Overwatch? Overwatch is an observability tool which helps you to monitor spending on your clouds and track usage in various dimensions. It works by collecting job and audit log data, then join...

0 Comments

UC Catalog Cloning: An Automated Approach

Authors: Ehsan Olfat (@esiol) and Vasco Lopes (@vmgl)   Introduction Databricks Unity Catalog (UC) is the first unified governance solution for data and AI in the Lakehouse. It enables secure manageme...

0 Comments