Databricks Community

OODataEng · 06-15-2025

Hello,I have a table with approximately 300 million records. It weighs 3.4 GB and consists of 305 files.I wanted to create liquid clustering for it and chose a date column as the key for clustering. When I created a new table with the above details b...

OODataEng · 06-14-2025

Hello, I have a permission issue when trying to access Azure DevOps and run a job using a Service Principal.I’ve read about the whole credentials topic, and indeed, when I create a PAT (Personal Access Token) through my personal user account, I can s...

OODataEng · 06-16-2025

I will try it again, Thank you!

OODataEng · 06-16-2025

I really appreciate your detailed response.I tried changing the key to a column with higher cardinality—a column that includes both date and time (timestamp)—to achieve a more even distribution.Now the size has dropped to 4.3 GiB, and the number of f...

OODataEng · 06-15-2025

I tried it with 1 column as a clustered key and also with 3 columns, both scenarios the size of the table increased

OODataEng · 06-15-2025

Hicreate table x cluster by (col1,col2,col3)as select * from table yand than I run optimize command on table x Thank you

Databricks Community

User Stats

User Activity

Liquid clustering performance issue

Git cerdentials for serivce principal running jobs

Re: Git cerdentials for serivce principal running jobs

Re: Liquid clustering performance issue

Re: Liquid clustering performance issue

Re: Liquid clustering performance issue