topic Re: In databricks deployment .py files getting converted to notebooks in Get Started Discussions

In databricks deployment .py files getting converted to notebooks

amit_jbs — Tue, 16 Apr 2024 07:19:01 GMT

A critical issue has arisen that is impacting our deployment planning for our client. We have encountered a challenge with our Azure CI/CD pipeline integration, specifically concerning the deployment of Python files (.py). Despite our best efforts, when deploying these files through the pipeline, they are being converted into normal notebooks. As a result, we are forced to manually recreate the .py files and copy-paste the code to run the notebooks.

We have extensively searched for a solution to this issue across various resources, but unfortunately, we have not found clear and comprehensive documentation that provides a step-by-step guide to address this specific situation.

If someone can provide guidance or a solution it would be greatly appreciated.

Re: In databricks deployment .py files getting converted to notebooks

-werners- — Wed, 17 Apr 2024 08:30:57 GMT

What is your pipeline? We propagate notebooks using Azure Devops Repos with PRs and merges. like that files do not get converted.

Re: In databricks deployment .py files getting converted to notebooks

Dazza — Thu, 25 Apr 2024 15:36:18 GMT

Experiencing a similar issue that we are looking to resolve except the files are .sql. We have a process that has 1 orchestration notebook , calling multiple .sql files. These .sql files are being converted to regular databricks notebooks when deploying so we are having to promote them to production in a manual manner right now - which is not ideal. Any insight/support here on this same issue would be appreciated

Re: In databricks deployment .py files getting converted to notebooks

amarantevitor94 — Thu, 05 Dec 2024 17:13:26 GMT

Did you manage to find the solution? If so, could you share it?

I have the same problem, and if I find the solution, I'll share it here.

Re: In databricks deployment .py files getting converted to notebooks

AGivenUser — Wed, 12 Mar 2025 22:23:22 GMT

We had the same problem but you can deploy the python files as 'RAW' file types with Databricks CLI.
Ref on usage from ADO Pipelines: https://learn.microsoft.com/en-us/azure/databricks/dev-tools/ci-cd/auth-with-azure-devops

Re: In databricks deployment .py files getting converted to notebooks

AGivenUser — Wed, 12 Mar 2025 22:25:28 GMT

Another option is Databricks Asset Bundles.

Re: In databricks deployment .py files getting converted to notebooks

briancuster63 — Sat, 07 Jun 2025 21:56:27 GMT

I'm using databricks asset bundles and am still experiencing the same problem as above. Does anyone know how to get around this using VS Code and asset bundles?