- 6619 Views
- 6 replies
- 1 kudos
Cannot import editable installed module in notebook
Hi,I have the following directory structure:- mypkg/ - setup.py - mypkg/ - __init__.py - module.py - scripts/ - main # notebook From the `main` notebok I have a cell that runs:%pip install -e /path/to/mypkgThis command appears to succ...
- 6619 Views
- 6 replies
- 1 kudos
- 1 kudos
Sorry to triple post but I have another update: it seems to work for standalone clusters, but it refuses to build the wheel (I get a write permission error) on the job clusters.
- 1 kudos
- 4616 Views
- 2 replies
- 0 kudos
Best practices for tableau to connect to Databricks
Having problem in connecting to Databrikcs with service principal from tableau . Wanted to how how tableau extracts refreshing connecting to databricks , is it via individual Oauth or service principal
- 4616 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @cheerwthraj, To connect Tableau to Databricks and refresh extracts, you can use either OAuth or service principal authentication. For best practices, please refer to the below link, https://docs.databricks.com/en/partners/bi/tableau.html#best-pr...
- 0 kudos
- 1461 Views
- 2 replies
- 1 kudos
Resolved! cluster and workflow issue
com.databricks:spark-xml_2.12:0.18.0 com.crealytics:spark-excel_2.12:3.4.3_0.20.4 in prerequisites_maven.yml and i created cluster and ran from this updated cluster notebook running but jobs failing UnknownException: (java.util.ServiceConfiguratio...
- 1461 Views
- 2 replies
- 1 kudos
- 1 kudos
You can now natively read Excel files https://docs.databricks.com/aws/en/query/formats/excel
- 1 kudos
- 953 Views
- 1 replies
- 1 kudos
Resolved! cannot see "User Provisioning " in settings in Databricks Account management console
Hi Team , I came across below issues , need help to resolve the issue's .Issue 1 :- cannot see "User Provisioning " in settings in Databricks Account management console.Issue 2: - Account Admin -Toggle - Failed to provision user. Please ensure the...
- 953 Views
- 1 replies
- 1 kudos
- 1 kudos
Hey dpavanbo! 1. In the account console, go to Security > User provisioning. If you see “Automatic identity management,” that’s expected on Azure; it replaces traditional SCIM UI and handles JIT on first sign‑in. 2. Automatic identity management: ...
- 1 kudos
- 434 Views
- 1 replies
- 0 kudos
I placed an swag but did not reiceve it just want to lnow the status
I want to know the status of my swag
- 434 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Ritika-08! Could you please share a few more details about the swag you’re referring to, such as which program or event it was associated with?
- 0 kudos
- 2787 Views
- 1 replies
- 1 kudos
Left Outer Join returns an Inner Join in Delta Live Tables
In our Delta Live Table pipeline I am simply joining two streaming tables to a new streaming table.We use the following code: @Dlt.create_table() def fact_event_faults(): events = dlt.read_stream('event_list').withWatermark('TimeStamp', '4 hours'...
- 2787 Views
- 1 replies
- 1 kudos
- 1 kudos
did you ever get this resolved? struggling with a similar problem
- 1 kudos
- 2358 Views
- 3 replies
- 3 kudos
Resolved! CDC / Event Driven Data Ingestion
Hello Guys,I am planning to implement Event Driven Data Ingestion from Bronze -> Silver -> Gold layer in my project. Currently we are having batch processing approach for our data ingestion pipelines. We have decided to move away from batch process t...
- 2358 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi Mey,Please also consider databrick file arrival trigger for your event driven data ingestion journey.https://docs.databricks.com/aws/en/jobs/file-arrival-triggersRegards, Kartik
- 3 kudos
- 1532 Views
- 2 replies
- 4 kudos
A Smarter Approach to Data Quality Monitoring
For a long time, data quality has been one of the most painful parts of data engineering.Most of us have written rules and thresholds that looked correct but didn’t reflect how data was actually used. We ended up with too many alerts that didn’t matt...
- 1532 Views
- 2 replies
- 4 kudos
- 4 kudos
agentic data quality monitoring is a focused approach for what really matters...
- 4 kudos
- 5343 Views
- 2 replies
- 2 kudos
Stream failure JsonParseException
Hi all! I am having the following issue with a couple of pyspark streams. I have some notebooks running each of them an independent file structured streaming using delta bronze table (gzip parquet files) dumped from kinesis to S3 in a previous job....
- 5343 Views
- 2 replies
- 2 kudos
- 2 kudos
Thanks for the detail answer I've been searching for. If you play at online casinos, you should check out the best online casinos that payout that offer the best gaming experiences.
- 2 kudos
- 835 Views
- 1 replies
- 1 kudos
Resolved! Suddenly unable to load csv in Community Edition
Hi there, I have be experimenting with some notebooks in the community edition workspace. I have a notebook which loads a .csv file from the same location where the notebook is saved. I have a separate notebook where this was working before, but sudd...
- 835 Views
- 1 replies
- 1 kudos
- 1 kudos
Hey @whatthefee , quick clarification here. You’re on Free Edition, not Community Edition (Community Edition has been retired). Can you confirm whether those screenshots are from Free Edition, or from the legacy Community Edition environment (which w...
- 1 kudos
- 17867 Views
- 17 replies
- 6 kudos
Unable to Login - Account Verification Loop
I'm having trouble logging in to my Databricks account at databricks.com. Here's what happens:I enter my email address and password.I receive an account verification code via email.I enter the verification code on the login page.Instead of logging me...
- 17867 Views
- 17 replies
- 6 kudos
- 6 kudos
I have same problems. I selected sign up and click Microsoft account (in my case) then it redirects me to MFA then it works. I was using "Sign in" and it keeps asking password and MFA but when I typed, it does not work. It is weird.
- 6 kudos
- 1118 Views
- 3 replies
- 4 kudos
Resolved! External Location Credential External,External table
can External Location Credential or External and External table be created in free databricks edition
- 1118 Views
- 3 replies
- 4 kudos
- 4 kudos
Hi @Thomas_Aimiuwu ,Yes, it should be possible. Check below LinkedIn article:Adding Free Storage to your Free Databricks Account | LinkedIn
- 4 kudos
- 3800 Views
- 5 replies
- 0 kudos
Best Development Strategies for Building Reusable Data Engineering Components in Databricks
I’m looking to gather insights from data engineers, architects, and developers who have experience building scalable pipelines in Databricks. Specifically, I want to understand how to design, implement, and manage reusable data engineering components...
- 3800 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi Tarunnagar!I've worked on a few projects where we leveraged shared libraries to accelerate and standardize notebook development. Such libraries were developed in Python and were available for users on their workspaces via Databricks Git Folders. B...
- 0 kudos
- 1331 Views
- 1 replies
- 1 kudos
Resolved! How to use databricks model serving endpoint with databricks application ?
Hi DB Community ,I have a databricks streamlit application that is viewing and inserting data into lakebase postgres database tables . Now I want to modernise this and implement databricks gen ai models . So instead of giving/selecting inputs , users...
- 1331 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @gokkul ,Check below databricks apps cookbook docs. The idea is to use databricks sdk inside databricks apps (or any other application) to invoke a model. So your app can ask user for an input and then pass it internally to serving_endpoints.query...
- 1 kudos
- 832 Views
- 1 replies
- 2 kudos
Resolved! Renaming a folder causes associated Jobs to lose the notebook paths
Renaming a folder causes associated Jobs to lose the notebook paths. Is this a deliberate design choice based on some purpose, or just a system limitation?
- 832 Views
- 1 replies
- 2 kudos
- 2 kudos
it’s expected. Jobs reference notebooks by absolute workspace path today, so when you rename or move a folder, that path changes and the job won’t automatically update—runs will fail until you edit the task to point at the new path.What you can do .U...
- 2 kudos
