Databricks Community

noorbasha534

DearsHas anyone successfully used at scale the lakehouse monitoring & expectations features together to measure data quality of data tables - example, to conduct freshness checks, consistency checks etc.Appreciate if you could share the lessons learn...

noorbasha534

Dear allI like to know the best practices around libraries installation on Databricks compute - all-purpose, job.The need is to screen the libraries, conduct vulnerability tests, and then let them be installed through a centralized CI/CD process. How...

noorbasha534

Hi all,I understand ANALYZE table for stats collection does not interfere with write & update operations on a delta table. Please confirm.I like to execute ANALYZE table command post data loads of delta tables but at times the loads could be extended...

noorbasha534

@filipniziol thanks again for your time. The thing is we like to block access to these URLs as at times we found developers & data scientists downloading packages that were marked as vulnerable by Maven.

noorbasha534

@filipniziol thanks for your time in replying. your answer is satisfactory & resolves my queries.

noorbasha534

@szymon_dybczak May I know what would be the best way to do this for around 2000 tables. I notice out of 15000 tables, 2000 delta tables receive files in bronze layer very rarely. We usually run streaming for 15000 tables through-out the day. Now, I ...

Databricks Community

User Stats

User Activity

Lakehouse Monitoring & Expectations

Libraries installation governance

ANALYZE table for stats collection

Re: Libraries installation governance

Re: ANALYZE table for stats collection

Re: File Arrival Trigger