topic Re: How to export a Databricks repos in dbc format with databricks CLI in Data Engineering

How to export a Databricks repos in dbc format with databricks CLI

RantoB — Wed, 10 Nov 2021 15:49:04 GMT

Hi,

How can I export a Databricks repository in dbc format with databricks CLI ?

It is possible to make

databricks workspace export_dir path/to/dir .

but not

databricks repos export_dir path/to/dir .

Thanks for you answers

Re: How to export a Databricks repos in dbc format with databricks CLI

Prabakar — Wed, 10 Nov 2021 16:11:01 GMT

Hi @Bertrand BURCKER the repos cli does not support the export command.

Below are the supported commands by repos.

Commands:

create -- Creates a repo.

delete -- Deletes a repo.

get -- Lists information about a repo.

list -- Lists all available repos in the workspace.

update -- Updates information about a repo.

You can get this information by running

databricks repos --help

Please refer to https://docs.databricks.com/dev-tools/cli/repos-cli.html#repos-cli

Re: How to export a Databricks repos in dbc format with databricks CLI

RantoB — Wed, 10 Nov 2021 16:13:33 GMT

Thanks for your answer.

But then, how can I export a sub-directory which is within a repos in dbc format with cli ?

Re: How to export a Databricks repos in dbc format with databricks CLI

Prabakar — Wed, 10 Nov 2021 16:27:15 GMT

I haven't tried it, but I believe the below might work. Please try it out and let us know.

As per the doc, https://docs.databricks.com/dev-tools/cli/workspace-cli.html#export-a-directory-from-a-workspace-to-your-local-filesystem

You can export a directory using the below command.

databricks workspace export_dir --overwrite /Users/someone@example.com/my-folder /Users/me/Downloads/my-folder

You can use the same command and try to export the repos directory. The only change will be on the path.

databricks workspace export_dir --overwrite /Repos/someone@example.com/my-folder /Users/me/Downloads/my-folder

Re: How to export a Databricks repos in dbc format with databricks CLI

RantoB — Wed, 10 Nov 2021 16:31:33 GMT

I already checked that.

First I don't know why my workspace is temporarily unavailable since always !

Second, I want actually to export from the repos and not from the workspace.

Re: How to export a Databricks repos in dbc format with databricks CLI

-werners- — Thu, 11 Nov 2021 07:56:06 GMT

why dont you export from your git provider since you use repos?

In git you actually already have an export (assuming you have commited/pushed your code).

Re: How to export a Databricks repos in dbc format with databricks CLI

RantoB — Thu, 11 Nov 2021 12:29:01 GMT

I would like to export in DBC format and I connot do so from my git provider.

Re: How to export a Databricks repos in dbc format with databricks CLI

Prabakar — Thu, 11 Nov 2021 14:20:40 GMT

@Bertrand BURCKER Is your requirement to do it only from the CLI? Or to export the repos?

If it is to export the repos, you can export it as DBC format from the UI.

Re: How to export a Databricks repos in dbc format with databricks CLI

RantoB — Thu, 11 Nov 2021 14:23:19 GMT

I would like to export in DBC format with CLI.