- 843 Views
- 1 replies
- 1 kudos
Resolved! Best Approaches to Build a Data‑Driven Fleet Management System on Databricks?
Hi everyone,I’m planning a project to build a fleet management analytics platform using Databricks and I’d love some community guidance. The goal is to ingest vehicle telematics, GPS data, maintenance logs, and fuel consumption into a unified Lakehou...
- 843 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi James, This is a solid use case for the Lakehouse. Here's how I'd approach it based on patterns we use at Databricks. Real-time vs batch ingestion Batch (main path): Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables / DLT) is a st...
- 1 kudos
- 612 Views
- 2 replies
- 2 kudos
Resolved! Documentation Typo
Hi Databricks team! I noticed that there is a typo in the Hadoop Distributed File System(HDFS) documentation. The specific typo: "Datablocks are replicated across multiple datanotes and accessed by the NameNode.” Where “datanotes” should be corrected...
- 612 Views
- 2 replies
- 2 kudos
- 2 kudos
@zhibinwang - FYI. This is now fixed. Please be informed that the page: https://www.databricks.com/glossary/hadoop-distributed-file-system-hdfs is now redirected to : https://www.databricks.com/blog/what-is-hdfs as part of a migration. Content remai...
- 2 kudos
- 648 Views
- 4 replies
- 1 kudos
Community Edition access blocked — verification sent to inactive email
Hello, I am seeking assistance with accessing my former Databricks Community Edition account.During my Master’s studies at the University of Nottingham (2023), I used Databricks Community Edition for coursework. The account was registered using my un...
- 648 Views
- 4 replies
- 1 kudos
- 1 kudos
Hello, I just wanted to follow up on this issue, as I have not yet received a response after some time.I would greatly appreciate any guidance from a Databricks engineer or moderator, as I am currently unable to access my Community Edition account to...
- 1 kudos
- 3562 Views
- 5 replies
- 1 kudos
Getting error while creating external delta table in Databricks
I am getting below error while creating external delta table in Databricks, even there is a external location created.[NO_PARENT_EXTERNAL_LOCATION_FOR_PATH] No parent external location was found for path 'abfss://destination@datalakeprojectsid.dfs.co...
- 3562 Views
- 5 replies
- 1 kudos
- 1 kudos
There are different things to check to resolve it: how is Databricks connecting to the storage, Is it Managed Identity & Azure Role Assignment, Access Keys, or Service Principals with secrets. It is advisable to use Managed Identity & Azure Role Assi...
- 1 kudos
- 1252 Views
- 5 replies
- 7 kudos
Resolved! Why I can't create a new catalog anymore in Free edition anymore,?
I am new with Databricks and using the FREE edition of Databricks since last November 2025. I was able to create new catalog in December '25. But today, while trying to create a new catalog in the FREE edition, I am getting this erorr:Metastore stora...
- 1252 Views
- 5 replies
- 7 kudos
- 398 Views
- 2 replies
- 0 kudos
Big Data Solutions
hi all,I am here looking for Big Data solution for organization. I also searched this on many different website and found many solutions. We are bit confused to which one to choose. One of my friend suggest me this platform, and i am hoping i will ge...
- 398 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello @athang !Welcome to the forum.Databricks is a strong solution in the big data landscape. It covers a wide range of capabilities, including BI serving, data lake/warehouse architecture (Lakehouse), data engineering, data science, machine learni...
- 0 kudos
- 1199 Views
- 5 replies
- 0 kudos
Resolved! Request for Access to Notebooks from Databricks Community Edition After Migration
Hello Databricks Community Team,I hope you are doing well.I have been a long-time user of the Databricks Community Edition and have actively used it over the years to build and maintain several notebooks for learning and experimentation.Recently, I u...
- 1199 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi @Advika , Do we any have any utility to migrate to notebooks from Community edition to free edition.I have some extensive work in the community edition, Could you please help to check and help us if there is any alternative solution to recover the...
- 0 kudos
- 533 Views
- 1 replies
- 0 kudos
DQX Open Dashboard Setup - Quality Dashboard
Hi Databricks Community,I'm trying to set up the DQX quality open-dashboard(inbuilt) to monitor my quarantined/failed records but encountering issues.**Setup Details:**- DQX version: 0.12.0- Existing DQX structure at: /Workspace/supply_chain_dqx/- Qu...
- 533 Views
- 1 replies
- 0 kudos
- 0 kudos
Hey @Loganath! Please try the steps here for installation in the Databricks cluster or notebook. This is how you can avoid using the CLI. You can install a specific version of DQX in your Databricks workspace via Databricks CLI by running: databrick...
- 0 kudos
- 592 Views
- 1 replies
- 0 kudos
Infinite loading specific to Arc Browser
Hi all,I previously reported issues where the Databricks Workspace UI (Jobs DAG, Compute, SQL Editor, Notebooks) was stuck on infinite loading.I previously encountered similar symptons, and at that time, the issue eventually resolved itself spontaneo...
- 592 Views
- 1 replies
- 0 kudos
- 0 kudos
Hey @JIWON! Agreed — this is almost certainly an Arc-specific quirk, not Chromium itself. Known Arc pain points match your symptoms so you are not alone! We've seen the following fixes come in handy in previous, similar situations: Clear site data fo...
- 0 kudos
- 571 Views
- 2 replies
- 3 kudos
Resolved! Is there support for Confluent Kafka in databricks free edition
I want to do a streaming POC using trial version of Confluent Kafka.Will databricks free edition support it?
- 571 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @Suresh_Ulhasnag ,Yes it's supported. You can have a look at my github repo: https://github.com/cloud-data-engineer/data/blob/main/dlt_telco/docs/README.mdIn bronze layer I am connecting to Confluent Kafka: https://github.com/cloud-data-engineer/d...
- 3 kudos
- 621 Views
- 2 replies
- 2 kudos
Resolved! recover workspace notebooks
Hi, My study notebooks that were in the Databricks Community workspace have been deleted.Are there any birds I can follow to retrieve them?
- 621 Views
- 2 replies
- 2 kudos
- 2 kudos
Hey @silaslnsilva — there was a Community notification noting that Databricks Community Edition would be retired at the end of 2025. Prior to retirement, users were given a quick “migrate” link to move their assets over to Free Edition. Unfortunately...
- 2 kudos
- 771 Views
- 4 replies
- 6 kudos
Resolved! whitelist for outbound network access?
Hi all,It is documented, that the free edition has limitations as to which external hosts and domains can be accessed.Is there a known (white) list of hosts/domains which can be accessed?As an example i can access pypi.org but not wikipedia.org.
- 771 Views
- 4 replies
- 6 kudos
- 6 kudos
So why is wikipedia.org accessible with a free edition hosted in eu-west-1 (-> @szymon_dybczak), but not with a free edition hosted in us-east-2 (-> me)?
- 6 kudos
- 915 Views
- 2 replies
- 1 kudos
Resolved! dbfs directory listing has changed
Today withdatabricks -p FREE fs ls dbfs: -li getDIRECTORY 0 1970-01-01T01:00:00Z VolumesDIRECTORY 0 1970-01-01T01:00:00Z WorkspaceDIRECTORY 0 1970-01-01T01:00:00Z databricks-datasetsBut until recently i got significantly more output includeing someth...
- 915 Views
- 2 replies
- 1 kudos
- 1 kudos
While i got a perfectly sound answer, i want to mention that i probably confused the outputs of databricks fs ls (remote) and df (local).
- 1 kudos
- 396 Views
- 1 replies
- 1 kudos
Resolved! Using the apt package manager
With DB free edition is there any hope tu use the apt tool for doing e.g. apt update?
- 396 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @fehrin1 ,It won't work in serverless. It would require root user or sudo permissions and that's not an option in Serverless.
- 1 kudos
- 395 Views
- 2 replies
- 1 kudos
Resolved! root user in free edition web console?
Hi all,With DB free edition i am logged in as a spark-xxxx user after opening web console.Is it possible to work as root user and how?I have access to a commercial DB instance and here i am in fact root with opening the web console. How is this contr...
- 395 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @fehrin1 ,Unfortunately ,this is not possible in Serverless. You can't login as root or use sudo command.
- 1 kudos
