cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

examples on python sdk for install libraries

houstonamoeba
New Contributor III

Hi Everyone,

I'm planning to use databricks python cli "install_libraries"

can some one pls post examples on function install_libraries

https://github.com/databricks/databricks-cli/blob/main/databricks_cli/libraries/api.py

1 ACCEPTED SOLUTION

Accepted Solutions

houstonamoeba
New Contributor III

okay, i figured it out , here is the example

from databricks_cli.sdk.api_client import ApiClient

from databricks_cli.libraries.api import LibrariesApi

awsapi_client = ApiClient(

    host="********************",

    token="*******************",

)

awslibrary_api = LibrariesApi(awsapi_client)

awslibrary_api.install_libraries('0510-140152-aaaaaaaa', {'pypi': {'package': 'mlflow==2.2.2'}} )

View solution in original post

7 REPLIES 7

pvignesh92
Honored Contributor

@saiprasad ambati prabhakar​ Are you having any issues while installing that?

i dont have any issues with installation, im looking for examples to use the python function install_libraries , i want to install libraries via python sdk

artsheiko
Valued Contributor III
Valued Contributor III

databricks libraries install --cluster-id 1234-567890-lest123 --jar dbfs:/test-dir/test.jar

Doc : https://docs.databricks.com/dev-tools/cli/libraries-cli.html

hi @Artem Sheiko​ , im looking for python sdk example to install libraries in the cluster, pls let me know if you have any

here is the github link im following

https://github.com/databricks/databricks-cli/blob/main/databricks_cli/libraries/api.py

brina
New Contributor II

Hello! I was able to install a library using python sdk - Task configuration. Please see the code below! Hope it helps! 🙂 

from databricks.sdk.service.jobs import Task
from databricks.sdk.service.compute import ( Library,
PythonPyPiLibrary,
)

Task(...<other config>,
     libraries=[Library(pypi=PythonPyPiLibrary(package="package_name==version"))],
)

 

houstonamoeba
New Contributor III

okay, i figured it out , here is the example

from databricks_cli.sdk.api_client import ApiClient

from databricks_cli.libraries.api import LibrariesApi

awsapi_client = ApiClient(

    host="********************",

    token="*******************",

)

awslibrary_api = LibrariesApi(awsapi_client)

awslibrary_api.install_libraries('0510-140152-aaaaaaaa', {'pypi': {'package': 'mlflow==2.2.2'}} )

Loop-Insist
New Contributor II

Here you go using Python SDK

from databricks.sdk import WorkspaceClient
from databricks.sdk.service import compute
w = WorkspaceClient(host="yourhost", token="yourtoken")

# Create an array of Library objects to be installed
libraries_to_install = [
compute.Library(pypi=compute.PythonPyPiLibrary(package="packagename==version")) # Specify the PyPi package
]

w.libraries.install(cluster_id="yourclusterid", libraries=libraries_to_install)
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!