- 1099 Views
- 2 replies
- 1 kudos
Resolved! Implementing DQ Checks (Null, Duplicate, Date, Numeric) Using DQX
Currently implementing a Data Quality framework using the DQX framework with a metadata-driven architecture. The solution incorporates various data quality checks such as null checks, duplicate detection, date validation, and numeric validations.Coul...
- 1099 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi, I've dug out a couple of articles, that I think may be a good starting point for you but I think one of the key things to think about is how to store and manage your rules. Most teams start with Yaml based configuration and use their source contr...
- 1 kudos
- 3119 Views
- 6 replies
- 3 kudos
Resolved! Multiple UI pages stuck on infinite loading (Jobs DAG, Compute, SQL Editor, Notebooks) in AWS ap-nor
Hi,I’m trying to work in Databricks, but too many things in the workspace UI are not working properly. Almost everything is stuck on infinite loading.Here are the symptoms:Jobs DAG (Tasks tab) infinite loadingI can see the job Runs history.However, w...
- 3119 Views
- 6 replies
- 3 kudos
- 3 kudos
I had the same issue where all notebooks would not load. When switching browsers and opening the same notebook, it worked. However, I still wanted to use my previous browser. Not sure if this is a solution that will work for others, but after clearin...
- 3 kudos
- 1381 Views
- 4 replies
- 3 kudos
Resolved! Complex Json file Flatten Dynamically
Hi ,We have multiple complex JSON files and need to flatten them, especially handling array data types. Whenever an array is present, we need to create a new child table and establish a relationship between the master and child tables. This will foll...
- 1381 Views
- 4 replies
- 3 kudos
- 3 kudos
Thanks for the quick response! I'm going to dive in and start building the implementation now.
- 3 kudos
- 841 Views
- 4 replies
- 1 kudos
Resolved! I am waiting the Verify code but not happens
I am waiting the Verify code but not happens .Is the free edition Down?
- 841 Views
- 4 replies
- 1 kudos
- 1550 Views
- 4 replies
- 3 kudos
Resolved! Databricks workspace issue
Hello Databricks Support Team,I am unable to access my Databricks workspace due to a login redirect loop.When I sign in, my Databricks account is displayed correctly. However, when I click on the account/workspace, I am redirected back to the Databri...
- 1550 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @mouni2, Based on your description, your original account was likely a Databricks Community Edition account. Community Edition was retired on January 1, 2026, and existing Community Edition workspaces are no longer accessible. This is the most com...
- 3 kudos
- 1162 Views
- 3 replies
- 0 kudos
Unity Catalog Error: PERMISSION_DENIED: Can not move tables across arclight catalogs (Free Edition)
Subject: Unity Catalog Error: PERMISSION_DENIED: Can not move tables across arclight catalogs (Free Edition)Body: Hi everyone,I'm trying to set up a Spark Declarative Pipeline (SDP) using a streaming table on Databricks Free Edition, but I'm hitting ...
- 1162 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Schusmeicer, The "Can not move tables across arclight catalogs" error you are seeing is specific to how Unity Catalog is managed on the Databricks Free Edition. "Arclight" is the internal infrastructure name for the Free Edition's managed Unity C...
- 0 kudos
- 1604 Views
- 13 replies
- 3 kudos
nookup in web console
In the DB free web console on nslookup de.wikipedia.org i getREFUSEDIs this a hard restriction of the free edition or can i work around this?In some documentation i found that the free edition has external access to a limited set of sites only, is th...
- 1604 Views
- 13 replies
- 3 kudos
- 3 kudos
Hi @fehrin1, This is expected behavior on the Databricks Free Edition. The Free Edition documentation confirms that "outbound internet access is restricted to a limited set of trusted domains." https://docs.databricks.com/aws/en/getting-started/free-...
- 3 kudos
- 2589 Views
- 2 replies
- 0 kudos
Resolved! Max. file size in a managed volume
Tried to move a ~30GB file (I know it's too large for data science) from the ephemeral storage to a managed volume, but after a while the output returned "Input/output error"; later discovered that only ~14.8GB was downloaded. Is there a maximum size...
- 2589 Views
- 2 replies
- 0 kudos
- 0 kudos
Hey @0000abcd , short answer: there isn’t a Databricks-imposed single-file size cap for files in managed volumes; the practical limit is whatever the underlying cloud object storage supports. You can write very large files via Spark, the Files REST ...
- 0 kudos
- 1137 Views
- 1 replies
- 1 kudos
Resolved! Best Approaches to Build a Data‑Driven Fleet Management System on Databricks?
Hi everyone,I’m planning a project to build a fleet management analytics platform using Databricks and I’d love some community guidance. The goal is to ingest vehicle telematics, GPS data, maintenance logs, and fuel consumption into a unified Lakehou...
- 1137 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi James, This is a solid use case for the Lakehouse. Here's how I'd approach it based on patterns we use at Databricks. Real-time vs batch ingestion Batch (main path): Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables / DLT) is a st...
- 1 kudos
- 779 Views
- 2 replies
- 2 kudos
Resolved! Documentation Typo
Hi Databricks team! I noticed that there is a typo in the Hadoop Distributed File System(HDFS) documentation. The specific typo: "Datablocks are replicated across multiple datanotes and accessed by the NameNode.” Where “datanotes” should be corrected...
- 779 Views
- 2 replies
- 2 kudos
- 2 kudos
@zhibinwang - FYI. This is now fixed. Please be informed that the page: https://www.databricks.com/glossary/hadoop-distributed-file-system-hdfs is now redirected to : https://www.databricks.com/blog/what-is-hdfs as part of a migration. Content remai...
- 2 kudos
- 780 Views
- 4 replies
- 1 kudos
Community Edition access blocked — verification sent to inactive email
Hello, I am seeking assistance with accessing my former Databricks Community Edition account.During my Master’s studies at the University of Nottingham (2023), I used Databricks Community Edition for coursework. The account was registered using my un...
- 780 Views
- 4 replies
- 1 kudos
- 1 kudos
Hello, I just wanted to follow up on this issue, as I have not yet received a response after some time.I would greatly appreciate any guidance from a Databricks engineer or moderator, as I am currently unable to access my Community Edition account to...
- 1 kudos
- 3894 Views
- 5 replies
- 1 kudos
Getting error while creating external delta table in Databricks
I am getting below error while creating external delta table in Databricks, even there is a external location created.[NO_PARENT_EXTERNAL_LOCATION_FOR_PATH] No parent external location was found for path 'abfss://destination@datalakeprojectsid.dfs.co...
- 3894 Views
- 5 replies
- 1 kudos
- 1 kudos
There are different things to check to resolve it: how is Databricks connecting to the storage, Is it Managed Identity & Azure Role Assignment, Access Keys, or Service Principals with secrets. It is advisable to use Managed Identity & Azure Role Assi...
- 1 kudos
- 1602 Views
- 5 replies
- 7 kudos
Resolved! Why I can't create a new catalog anymore in Free edition anymore,?
I am new with Databricks and using the FREE edition of Databricks since last November 2025. I was able to create new catalog in December '25. But today, while trying to create a new catalog in the FREE edition, I am getting this erorr:Metastore stora...
- 1602 Views
- 5 replies
- 7 kudos
- 500 Views
- 2 replies
- 0 kudos
Big Data Solutions
hi all,I am here looking for Big Data solution for organization. I also searched this on many different website and found many solutions. We are bit confused to which one to choose. One of my friend suggest me this platform, and i am hoping i will ge...
- 500 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello @athang !Welcome to the forum.Databricks is a strong solution in the big data landscape. It covers a wide range of capabilities, including BI serving, data lake/warehouse architecture (Lakehouse), data engineering, data science, machine learni...
- 0 kudos
- 1547 Views
- 5 replies
- 0 kudos
Resolved! Request for Access to Notebooks from Databricks Community Edition After Migration
Hello Databricks Community Team,I hope you are doing well.I have been a long-time user of the Databricks Community Edition and have actively used it over the years to build and maintain several notebooks for learning and experimentation.Recently, I u...
- 1547 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi @Advika , Do we any have any utility to migrate to notebooks from Community edition to free edition.I have some extensive work in the community edition, Could you please help to check and help us if there is any alternative solution to recover the...
- 0 kudos
