Databricks Community

mukul1409

I would like to understand the current approach for Iceberg interoperability in Databricks. Databricks supports Iceberg using Unity Catalog, but many teams also use Iceberg tables managed outside Databricks. Are there recommended patterns today for s...

mukul1409

Hi @Ajay-Pandey only solution for you 1. Create an all-purpose cluster called for example: continuous-job-cluster and Disable auto-termination or set it to a large value.2. Configure job to use existing_cluster_id In Jobs UI or DAB YAML: exi...

mukul1409

Thanks @Advika 

mukul1409

Hi @slangenborg According to the official Databricks Jobs REST API documentation, notebook tasks use the notebook environment only implicitly when no environment_key is provided. The API lets you explicitly configure environments only via an environ...

mukul1409

The correct solution is not SQL based.Delta tables are defined by the contents of the delta log directory, not by CREATE TABLE statements. That is why SHOW CREATE TABLE cannot reconstruct partitions, properties or constraints.The only reliable migrat...

mukul1409

Hi @nkrish Databricks notebooks cannot run a Windows based C sharp executable. Databricks compute runs on Linux and does not support executing native Windows exe files. Because of this, a C sharp exe cannot be called directly from a Databricks notebo...

Databricks Community

User Stats

User Activity

Iceberg interoperability between Databricks and external catalogs

Re: Databricks Job cluster for continuous run

Re: 🌟 Community Pulse: Your Weekly Roundup! December 22, 2025 – January 04, 2026

Re: DAB Job - Serverless Cluster using configured base environment

Re: Migrate on-premise delta tables to Databricks (Azure)

Re: Calling exe from notebook