Databricks Community

Greg_Galloway · 10-18-2021

We know that Databricks with VNET injection (our own VNET) allows is to connect to ADLS Gen2 over private endpoints. This is what we typically do.We have a customer who created Databricks with EnableNoPublicIP=Yes (secure cluster connectivity) and Vn...

Greg_Galloway · 01-10-2023

If you don't want any Delta Live Tables, then just use the Jobs tab under the Workflows tab. Or there are plenty of other ways of just running a notebook in whatever orchestration tool you use (e.g. Azure Data Factory, etc.) @Ruben Hartenstein

Greg_Galloway · 01-09-2023

@Ruben Hartenstein I don't see any @dlt.table mentions in your code. I'm assuming that error means the pipeline evaluated your code and didn't find any DLT tables in it. Maybe study a few of the samples as a template?

Greg_Galloway · 01-05-2023

@Ruben Hartenstein notice the difference in the icons in your screenshot (they are notebooks) vs. the icons in the Arvind's post. You need to use this menu option to create an arbitrary file, not a notebook:

Greg_Galloway · 10-20-2022

I like the approach @Arvind Ravish shared since you can't currently use %run in DLT pipelines. However, it took a little testing to be clear on how exactly to make it work. First, ensure in the Admin Console that the repos feature is configured as f...

Greg_Galloway · 10-27-2021

Thanks @Gobinath Viswanathan . We'll move to VNET injection for now. Hopefully at some point the Databricks UI will provide additional control to make this scenario workable without bringing our own VNET.

Databricks Community

User Stats

User Activity

Use of private endpoints for storage in workspace with EnableNoPublicIP=Yes and VnetInjection=No

Re: DLT and Modularity (best practices?)

Re: DLT and Modularity (best practices?)

Re: DLT and Modularity (best practices?)

Re: DLT and Modularity (best practices?)

Re: Use of private endpoints for storage in workspace with EnableNoPublicIP=Yes and VnetInjection=No