cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Ritika-08
by • Databricks Partner
  • 453 Views
  • 1 replies
  • 0 kudos
  • 453 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Community Manager
  • 0 kudos

Hello @Ritika-08! Could you please share a few more details about the swag you’re referring to, such as which program or event it was associated with?

  • 0 kudos
dofre
by • New Contributor II
  • 2813 Views
  • 1 replies
  • 1 kudos

Left Outer Join returns an Inner Join in Delta Live Tables

In our Delta Live Table pipeline I am simply joining two streaming tables to a new streaming table.We use the following code: @Dlt.create_table() def fact_event_faults(): events = dlt.read_stream('event_list').withWatermark('TimeStamp', '4 hours'...

4bba99f9-1293-42f9-ab53-f869af77a877.jpg
Get Started Discussions
Delta Live Table
structured streaming
  • 2813 Views
  • 1 replies
  • 1 kudos
Latest Reply
ragonzalez
Databricks Partner
  • 1 kudos

did you ever get this resolved? struggling with a similar problem

  • 1 kudos
Mey
by • New Contributor II
  • 2462 Views
  • 3 replies
  • 3 kudos

Resolved! CDC / Event Driven Data Ingestion

Hello Guys,I am planning to implement Event Driven Data Ingestion from Bronze -> Silver -> Gold layer in my project. Currently we are having batch processing approach for our data ingestion pipelines. We have decided to move away from batch process t...

  • 2462 Views
  • 3 replies
  • 3 kudos
Latest Reply
KartikBhatnagar
New Contributor III
  • 3 kudos

Hi Mey,Please also consider databrick file arrival trigger for your event driven data ingestion journey.https://docs.databricks.com/aws/en/jobs/file-arrival-triggersRegards, Kartik  

  • 3 kudos
2 More Replies
Brahmareddy
by • Esteemed Contributor II
  • 1595 Views
  • 2 replies
  • 4 kudos

A Smarter Approach to Data Quality Monitoring

For a long time, data quality has been one of the most painful parts of data engineering.Most of us have written rules and thresholds that looked correct but didn’t reflect how data was actually used. We ended up with too many alerts that didn’t matt...

  • 1595 Views
  • 2 replies
  • 4 kudos
Latest Reply
KartikBhatnagar
New Contributor III
  • 4 kudos

agentic data quality monitoring is a focused approach for what really matters...

  • 4 kudos
1 More Replies
patojo94
by • New Contributor II
  • 5379 Views
  • 2 replies
  • 2 kudos

Stream failure JsonParseException

Hi all! I am having the following issue with a couple of pyspark streams. I have some notebooks running each of them an independent file structured streaming using  delta bronze table  (gzip parquet files) dumped from kinesis to S3 in a previous job....

Get Started Discussions
Photon
streaming aggregations
  • 5379 Views
  • 2 replies
  • 2 kudos
Latest Reply
sarahmorgan
New Contributor II
  • 2 kudos

Thanks for the detail answer I've been searching for. If you play at online casinos, you should check out the best online casinos that payout that offer the best gaming experiences.

  • 2 kudos
1 More Replies
whatthefee
by • New Contributor
  • 946 Views
  • 1 replies
  • 1 kudos

Resolved! Suddenly unable to load csv in Community Edition

Hi there, I have be experimenting with some notebooks in the community edition workspace. I have a notebook which loads a .csv file from the same location where the notebook is saved. I have a separate notebook where this was working before, but sudd...

whatthefee_0-1770522803156.png whatthefee_0-1770523075333.png
  • 946 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Hey @whatthefee , quick clarification here. You’re on Free Edition, not Community Edition (Community Edition has been retired). Can you confirm whether those screenshots are from Free Edition, or from the legacy Community Edition environment (which w...

  • 1 kudos
Pranav_jha
by • Databricks Partner
  • 18139 Views
  • 17 replies
  • 6 kudos

Unable to Login - Account Verification Loop

I'm having trouble logging in to my Databricks account at databricks.com. Here's what happens:I enter my email address and password.I receive an account verification code via email.I enter the verification code on the login page.Instead of logging me...

  • 18139 Views
  • 17 replies
  • 6 kudos
Latest Reply
dbs_user
New Contributor II
  • 6 kudos

I have same problems. I selected sign up and click Microsoft account (in my case) then it redirects me to MFA then it works. I was using "Sign in" and it keeps asking password and MFA but when I typed, it does not work. It is weird.

  • 6 kudos
16 More Replies
Thomas_Aimiuwu
by • New Contributor III
  • 1168 Views
  • 3 replies
  • 4 kudos

Resolved! External Location Credential External,External table

can External Location Credential or External and External table be created in free databricks edition 

  • 1168 Views
  • 3 replies
  • 4 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 4 kudos

Hi @Thomas_Aimiuwu ,Yes, it should be possible. Check below LinkedIn article:Adding Free Storage to your Free Databricks Account | LinkedIn

  • 4 kudos
2 More Replies
tarunnagar
by • Contributor
  • 3940 Views
  • 5 replies
  • 0 kudos

Best Development Strategies for Building Reusable Data Engineering Components in Databricks

I’m looking to gather insights from data engineers, architects, and developers who have experience building scalable pipelines in Databricks. Specifically, I want to understand how to design, implement, and manage reusable data engineering components...

  • 3940 Views
  • 5 replies
  • 0 kudos
Latest Reply
wesleyfelipe
Contributor
  • 0 kudos

Hi Tarunnagar!I've worked on a few projects where we leveraged shared libraries to accelerate and standardize notebook development. Such libraries were developed in Python and were available for users on their workspaces via Databricks Git Folders. B...

  • 0 kudos
4 More Replies
gokkul
by • Databricks Partner
  • 1420 Views
  • 1 replies
  • 1 kudos

Resolved! How to use databricks model serving endpoint with databricks application ?

Hi DB Community ,I have a databricks streamlit application that is viewing and inserting data into lakebase postgres database tables . Now I want to modernise this and implement databricks gen ai models . So instead of giving/selecting inputs , users...

  • 1420 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @gokkul ,Check below databricks apps cookbook docs. The idea is to use databricks sdk inside databricks apps (or any other application) to invoke a model. So your app can ask user for an input and then pass it internally to serving_endpoints.query...

  • 1 kudos
liu
by • Databricks Partner
  • 865 Views
  • 1 replies
  • 2 kudos

Resolved! Renaming a folder causes associated Jobs to lose the notebook paths

Renaming a folder causes associated Jobs to lose the notebook paths. Is this a deliberate design choice based on some purpose, or just a system limitation?

  • 865 Views
  • 1 replies
  • 2 kudos
Latest Reply
pradeep_singh
Honored Contributor III
  • 2 kudos

it’s expected. Jobs reference notebooks by absolute workspace path today, so when you rename or move a folder, that path changes and the job won’t automatically update—runs will fail until you edit the task to point at the new path.What you can do .U...

  • 2 kudos
Vipinjha1985
by • New Contributor
  • 671 Views
  • 1 replies
  • 1 kudos

Resolved! Unable to Access Code in Databricks Community Edition

Hi, I have been using Databricks Community Edition for a long time, but I’m currently unable to see my code in my Community account. Could you please help me check if my code can be restored?

  • 671 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @Vipinjha1985 ,Unfortunately, Databricks Community Editon has been shutdown at January 1, 2026. So there's no way to restore your content. From now on you should use Free Edition.PSA: Community Edition retires on January 1, 2026.... - Databricks C...

  • 1 kudos
Sathya_7
by • New Contributor II
  • 2731 Views
  • 4 replies
  • 0 kudos

Resolved! [Simba][ThriftExtension] (14) Unexpected response from server during a HTTP connection: SSL_connect:

Hi everyone,I’m trying to create an ODBC connection to Databricks using the Simba ODBC driverand I’m getting the following error when testing the connection:FAILED![Simba][ThriftExtension] (14) Unexpected response from server during a HTTP connection...

  • 2731 Views
  • 4 replies
  • 0 kudos
Latest Reply
Sathya_7
New Contributor II
  • 0 kudos

Hi everyone,Sorry for the confusion in my earlier message — I mistakenly mentioned SSO.To clarify, the authentication method I’m actually using is Username and Password. 

  • 0 kudos
3 More Replies
tarunnagpal
by • Databricks Partner
  • 3748 Views
  • 3 replies
  • 3 kudos

Snowflake to Databricks migration

We are working on a proposal for our existing customer to migrate approximately 500 tables and the associated business logic from Snowflake to Databricks. The business logic is currently implemented using stored procedures, which need to be converted...

  • 3748 Views
  • 3 replies
  • 3 kudos
Latest Reply
thelogicplus
Contributor III
  • 3 kudos

@tarunnagpal @MariuszK  if you want to migrate snowflake to databrick use Travinto Conversion tool   or if you want to create your own automation use How to Automate Snowflake to databricks  from TheLogicplus.com

  • 3 kudos
2 More Replies
Phani1
by • Databricks MVP
  • 6542 Views
  • 8 replies
  • 0 kudos

Talend ETL code to Databricks

Hi Team,What is the best way to transfer Talend ETL code to Databricks and what are the best methods/practices for migrating Talend ETL's to Databricks (notebook, code conversion/migration strategy, workflow's etc)?Regards,Janga

  • 6542 Views
  • 8 replies
  • 0 kudos
Latest Reply
pradeep_singh
Honored Contributor III
  • 0 kudos

Bladebridge had a support for Talend to Databricks conversion but since its acquired by databricks and rebranded as Lakebridge we dont have that support anymore ( Lakebridge for some reason doesn support Talend ). You might want to contact your Datab...

  • 0 kudos
7 More Replies
Labels