Databricks Community

Mystagon · 01-23-2024

Hey I need some help / suggestions troubleshooting this, I have two DataBricks Workspaces Common and Lakehouse. There difference between them is: Major Differences:- Lakehouse is using Unity Catalog- Lakehouse is using External Locations whereas cre...

Mystagon

For this particular ingestion we had no control over the directory structure as it was coming in from another team. With the right folder structure it is pretty fast but not as fast as Non-UC workspaces.Also note directory listings using volumes ins...

Mystagon · 01-23-2024

Hey Harvey, I getting around the same performance problems as you:From around 25 minutes in a normal workspace to an 1 hour and 20mins in UC workspace. Which is roughly 3x slower.Did you manage to solve this? I've also noticed dbutil.fs.ls() is much ...

Databricks Community

User Stats

User Activity

Performance Issues with Unity Catalog

Re: Performance Issues with Unity Catalog

Re: DLT Performance question with Unity Catalog