Rewrite Notebooks Programatically

Avinash_Narala — Mon, 26 Feb 2024 06:24:56 GMT

Hello,

I want to refactor the notebook programatically. So, written the code as follows:

import requests

import base64

# Databricks Workspace API URLs

workspace_url = f"{host}/api/2.0/workspace"

export_url = f"{workspace_url}/export"

import_url = f"{workspace_url}/import"

# Databricks personal access token

token = "***********************"

# Notebook path

notebook_path = "/Workspace/Users/Avinash/Old_Notebook"

new_notebook_path = "/Workspace/Users/Avinash/New_notebook"

# Function to export notebook content

def export_notebook():

export_payload = {

"path": notebook_path,

"format": "SOURCE"

}

response = requests.get(export_url, headers=headers, json=export_payload)

response.raise_for_status()

return response.json()["content"]

# Function to refactor notebook content

def refactor_notebook(content😞

# Example: Replace all occurrences of 'old_variable' with 'new_variable'

new_content = content.replace("hive_metastore", "test_catalog_ph")

return new_content

# Function to import modified notebook content

def import_notebook(new_content):

import_payload = {

"path": new_notebook_path,

"content": new_content,

# "overwrite": True

}

response = requests.post(import_url, headers=headers, json=import_payload)

if response.status_code != 200:

print(response.content)

response.raise_for_status()

# Main script

if __name__ == "__main__":

# Export notebook content

notebook_content = export_notebook()

decoded_content = base64.b64decode(notebook_content).decode('utf-8')

# print(decoded_content)

# Refactor notebook content

new_notebook_content = refactor_notebook(decoded_content)

encoded_content=(base64.b64encode(new_notebook_content.encode('utf-8')))

#print(encoded_content)

#print(base64.b64decode(encoded_content).decode('utf-8'))

# Import modified content back to Databricks

import_notebook(encoded_content)

print("Notebook refactoring complete.")

I am able to rewrite the content by exporting the notebook as Json. But unable to import the notebook from the Json to my workspace and getting the error as:

HTTPError: 400 Client Error: Bad Request for url.

Can you please help me with this

Re: Rewrite Notebooks Programatically

Avinash_Narala — Tue, 27 Feb 2024 04:34:54 GMT

Hello Kaniz,

I've implemented steps(1-4) as you instructed, but the issue I am facing is while importing my notebook.

In detaiI, I can export my notebook as json an can work with the json(replacing some specific words), but while uploading that json as notebook I am not able to do it.

I tried in two ways,

1.overwrite the existing notebook.

2.creating new notebook.

So, If you provide How can I create a notebook in my databricks workspace with the json content I have. It will be really helpful .

Thank you.

Re: Rewrite Notebooks Programatically

Avinash_Narala — Thu, 07 Mar 2024 05:48:56 GMT

Hi @Retired_mod,

any update on this?

Re: Rewrite Notebooks Programatically

Avinash_Narala — Thu, 07 Mar 2024 06:11:06 GMT

Same error message:

Attaching the error message

Re: Rewrite Notebooks Programatically

Avinash_Narala — Thu, 07 Mar 2024 09:36:35 GMT

Hi @Retired_mod,

Attaching the response.content

topic Re: Rewrite Notebooks Programatically in Data Engineering

Rewrite Notebooks Programatically

Re: Rewrite Notebooks Programatically

Re: Rewrite Notebooks Programatically

Re: Rewrite Notebooks Programatically

Re: Rewrite Notebooks Programatically