cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

cheerwthraj
by New Contributor
  • 4296 Views
  • 2 replies
  • 0 kudos

Best practices for tableau to connect to Databricks

Having problem in connecting to Databrikcs with service principal from tableau . Wanted to how how tableau extracts refreshing connecting to databricks , is it via individual Oauth or service principal

  • 4296 Views
  • 2 replies
  • 0 kudos
Latest Reply
saikumar246
Databricks Employee
  • 0 kudos

Hi @cheerwthraj,  To connect Tableau to Databricks and refresh extracts, you can use either OAuth or service principal authentication. For best practices, please refer to the below link, https://docs.databricks.com/en/partners/bi/tableau.html#best-pr...

  • 0 kudos
1 More Replies
Ved88
by Databricks Partner
  • 1116 Views
  • 2 replies
  • 1 kudos

Resolved! cluster and workflow issue

  com.databricks:spark-xml_2.12:0.18.0 com.crealytics:spark-excel_2.12:3.4.3_0.20.4 in prerequisites_maven.yml and i created cluster and ran from this updated cluster notebook running but jobs failing  UnknownException: (java.util.ServiceConfiguratio...

  • 1116 Views
  • 2 replies
  • 1 kudos
Latest Reply
youssefmrini
Databricks Employee
  • 1 kudos

You can now natively read Excel files https://docs.databricks.com/aws/en/query/formats/excel

  • 1 kudos
1 More Replies
dpavanbo
by New Contributor
  • 730 Views
  • 1 replies
  • 1 kudos

Resolved! cannot see "User Provisioning " in settings in Databricks Account management console

Hi Team , I came across below issues , need help to resolve  the issue's .Issue 1 :-   cannot see "User Provisioning " in settings in Databricks Account management console.Issue 2: - Account Admin -Toggle - Failed to provision user. Please ensure the...

  • 730 Views
  • 1 replies
  • 1 kudos
Latest Reply
sarahbhord
Databricks Employee
  • 1 kudos

  Hey dpavanbo!  1. In the account console, go to Security > User provisioning. If you see “Automatic identity management,” that’s expected on Azure; it replaces traditional SCIM UI and handles JIT on first sign‑in. 2. Automatic identity management: ...

  • 1 kudos
Ritika-08
by Databricks Partner
  • 349 Views
  • 1 replies
  • 0 kudos
  • 349 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Community Manager
  • 0 kudos

Hello @Ritika-08! Could you please share a few more details about the swag you’re referring to, such as which program or event it was associated with?

  • 0 kudos
dofre
by New Contributor II
  • 2591 Views
  • 1 replies
  • 1 kudos

Left Outer Join returns an Inner Join in Delta Live Tables

In our Delta Live Table pipeline I am simply joining two streaming tables to a new streaming table.We use the following code: @Dlt.create_table() def fact_event_faults(): events = dlt.read_stream('event_list').withWatermark('TimeStamp', '4 hours'...

4bba99f9-1293-42f9-ab53-f869af77a877.jpg
Get Started Discussions
Delta Live Table
structured streaming
  • 2591 Views
  • 1 replies
  • 1 kudos
Latest Reply
ragonzalez
Databricks Partner
  • 1 kudos

did you ever get this resolved? struggling with a similar problem

  • 1 kudos
Mey
by New Contributor II
  • 1718 Views
  • 3 replies
  • 3 kudos

Resolved! CDC / Event Driven Data Ingestion

Hello Guys,I am planning to implement Event Driven Data Ingestion from Bronze -> Silver -> Gold layer in my project. Currently we are having batch processing approach for our data ingestion pipelines. We have decided to move away from batch process t...

  • 1718 Views
  • 3 replies
  • 3 kudos
Latest Reply
KartikBhatnagar
New Contributor III
  • 3 kudos

Hi Mey,Please also consider databrick file arrival trigger for your event driven data ingestion journey.https://docs.databricks.com/aws/en/jobs/file-arrival-triggersRegards, Kartik  

  • 3 kudos
2 More Replies
Brahmareddy
by Esteemed Contributor II
  • 1238 Views
  • 2 replies
  • 4 kudos

A Smarter Approach to Data Quality Monitoring

For a long time, data quality has been one of the most painful parts of data engineering.Most of us have written rules and thresholds that looked correct but didn’t reflect how data was actually used. We ended up with too many alerts that didn’t matt...

  • 1238 Views
  • 2 replies
  • 4 kudos
Latest Reply
KartikBhatnagar
New Contributor III
  • 4 kudos

agentic data quality monitoring is a focused approach for what really matters...

  • 4 kudos
1 More Replies
patojo94
by New Contributor II
  • 5103 Views
  • 2 replies
  • 2 kudos

Stream failure JsonParseException

Hi all! I am having the following issue with a couple of pyspark streams. I have some notebooks running each of them an independent file structured streaming using  delta bronze table  (gzip parquet files) dumped from kinesis to S3 in a previous job....

Get Started Discussions
Photon
streaming aggregations
  • 5103 Views
  • 2 replies
  • 2 kudos
Latest Reply
sarahmorgan
New Contributor II
  • 2 kudos

Thanks for the detail answer I've been searching for. If you play at online casinos, you should check out the best online casinos that payout that offer the best gaming experiences.

  • 2 kudos
1 More Replies
AnneEst
by Databricks Partner
  • 741 Views
  • 1 replies
  • 1 kudos

Resolved! Databricks Spatial SQL - examples and tutorials?

Hello,I recently learned about Databricks being now able to handle geospatial data. With my background in geospatial, that got me curious for sure I was wondering if anybody has used examples, maybe a tutorial, to learn about geospatial in databricks...

  • 741 Views
  • 1 replies
  • 1 kudos
Latest Reply
pradeep_singh
Honored Contributor III
  • 1 kudos

HI @AnneEst I havent played around with spatial data but if I had to i would start with these two blogs . https://www.databricks.com/blog/introducing-spatial-sql-databricks-80-functions-high-performance-geospatial-analyticshttps://www.databricks.com/...

  • 1 kudos
whatthefee
by New Contributor
  • 594 Views
  • 1 replies
  • 1 kudos

Resolved! Suddenly unable to load csv in Community Edition

Hi there, I have be experimenting with some notebooks in the community edition workspace. I have a notebook which loads a .csv file from the same location where the notebook is saved. I have a separate notebook where this was working before, but sudd...

whatthefee_0-1770522803156.png whatthefee_0-1770523075333.png
  • 594 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Hey @whatthefee , quick clarification here. You’re on Free Edition, not Community Edition (Community Edition has been retired). Can you confirm whether those screenshots are from Free Edition, or from the legacy Community Edition environment (which w...

  • 1 kudos
Pranav_jha
by Databricks Partner
  • 16470 Views
  • 17 replies
  • 6 kudos

Unable to Login - Account Verification Loop

I'm having trouble logging in to my Databricks account at databricks.com. Here's what happens:I enter my email address and password.I receive an account verification code via email.I enter the verification code on the login page.Instead of logging me...

  • 16470 Views
  • 17 replies
  • 6 kudos
Latest Reply
dbs_user
New Contributor II
  • 6 kudos

I have same problems. I selected sign up and click Microsoft account (in my case) then it redirects me to MFA then it works. I was using "Sign in" and it keeps asking password and MFA but when I typed, it does not work. It is weird.

  • 6 kudos
16 More Replies
Thomas_Aimiuwu
by New Contributor III
  • 846 Views
  • 3 replies
  • 4 kudos

Resolved! External Location Credential External,External table

can External Location Credential or External and External table be created in free databricks edition 

  • 846 Views
  • 3 replies
  • 4 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 4 kudos

Hi @Thomas_Aimiuwu ,Yes, it should be possible. Check below LinkedIn article:Adding Free Storage to your Free Databricks Account | LinkedIn

  • 4 kudos
2 More Replies
tarunnagar
by Contributor
  • 3032 Views
  • 5 replies
  • 0 kudos

Best Development Strategies for Building Reusable Data Engineering Components in Databricks

I’m looking to gather insights from data engineers, architects, and developers who have experience building scalable pipelines in Databricks. Specifically, I want to understand how to design, implement, and manage reusable data engineering components...

  • 3032 Views
  • 5 replies
  • 0 kudos
Latest Reply
wesleyfelipe
Contributor
  • 0 kudos

Hi Tarunnagar!I've worked on a few projects where we leveraged shared libraries to accelerate and standardize notebook development. Such libraries were developed in Python and were available for users on their workspaces via Databricks Git Folders. B...

  • 0 kudos
4 More Replies
gokkul
by Databricks Partner
  • 1040 Views
  • 1 replies
  • 1 kudos

Resolved! How to use databricks model serving endpoint with databricks application ?

Hi DB Community ,I have a databricks streamlit application that is viewing and inserting data into lakebase postgres database tables . Now I want to modernise this and implement databricks gen ai models . So instead of giving/selecting inputs , users...

  • 1040 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @gokkul ,Check below databricks apps cookbook docs. The idea is to use databricks sdk inside databricks apps (or any other application) to invoke a model. So your app can ask user for an input and then pass it internally to serving_endpoints.query...

  • 1 kudos
liu
by Databricks Partner
  • 610 Views
  • 1 replies
  • 2 kudos

Resolved! Renaming a folder causes associated Jobs to lose the notebook paths

Renaming a folder causes associated Jobs to lose the notebook paths. Is this a deliberate design choice based on some purpose, or just a system limitation?

  • 610 Views
  • 1 replies
  • 2 kudos
Latest Reply
pradeep_singh
Honored Contributor III
  • 2 kudos

it’s expected. Jobs reference notebooks by absolute workspace path today, so when you rename or move a folder, that path changes and the job won’t automatically update—runs will fail until you edit the task to point at the new path.What you can do .U...

  • 2 kudos
Labels