Databricks Community

Hi @seefoods, databricks asset bundles don’t automatically detect resources in subdirectories unless they’re explicitly listed or a recursive pattern is used in the config.To resolve this, you can update the include section with a pattern like resour...

Please check out our new docs page! This has some information which may help you, including information about our new SET MANAGED command. We are also looking to make this process smoother over time, so if you have any feedback, please let us know. h...

Hi @suk This is a common issue with Databricks pipelines where dependencies aren't properly managed, causing scripts to execute in random order. Use Databricks Workflows with Task DependenciesConfigure explicit task dependencies: 

If i create notebook and run it , explicitly cluster will not be created but it will work in the backend , am i right?

looks like some problem withing my dataframe itself.If i skip some of the expensive field calculations then it is able to write to dbfs.

@cloudengineer By default workspace admins can create interactive clusters. Non-admin users should be granted access either to a compute policy or should be provisioned access onto a existing clusters. If there is a requirement to enable cluster crea...

I confirm that ashraf1395 solution works. All approaches I tried (of creating an empty table) created a materialized view (which you can't merge). It's disappointing though, since there is no quick param in a "create_table" command to create a simple...

@uday_satapathy Hi Uday. Do you know if this method works for many users? In case I need to share the script so a teammate may use it.

@data_learner1  Unity Catalog logs all data access and metadata operations (including schema changes) into the audit logs — which are stored in the system catalog tables, such as:system.access.auditYou mentioned you only have read access — and likely...