cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Import folder (no .whl or .jar files) and run the `python3 setup.py bdist_wheel` for lib install

Dicer
Valued Contributor

I want to import the ibapi python module in Azure Databricks Notebook.

Before this, I downloaded the the TWS API folder from https://interactivebrokers.github.io/#

 

I need to go through the following steps to install the API:

  1. Download and install TWS Gateway or Client
  2. Download and install Python to C:\Program Files\python... 
  3. Setup additional PATH environment variables (see pip warnings)
  4. Install wheel, i.e. type in the command line: py -m pip install wheel
  5. Download "API Latest" (or latest version that contains python) from http://interactivebrokers.github.io/ and install into the folder X as proposed (but for python the directory shouldn't matter)
  6. Go to X/.../source/pythonclient/ (cd in command line)
  7. Build a wheel, i.e. py setup.py bdist_wheel
  8. Look up the whl file in folder ./dist: should be something like ibapi-9.7x.x..
  9. Install the wheel, i.e. py -m pip install --user --upgrade dist/ibapi-9.73.7-py3-none-any.whl

Reference: https://stackoverflow.com/questions/57618117/installing-the-ibapi-package/59829707#59829707

 

I checked the Databricks Install library methods. It seems the closest solution is to import JAR or Python Whl files.

However, the API folder does not have JAR or .whl files.

 

May I know whether there is any method that allows me to do the following things in Databricks?

- import the entire folder

- cd the folder and run py setup.py bdist wheel  bash script. (For this operation, write privilege folder right is needed)

 

Thank you!

 

1 ACCEPTED SOLUTION

Accepted Solutions

arpit
Valued Contributor
Valued Contributor

You can try to upload the folder in the workspace location and try to cd in the desired folder and try to install in via notebook. But it would be a notebook scope installation. If you are looking for a cluster scoped installation then you would need jar or wl file.

View solution in original post

1 REPLY 1

arpit
Valued Contributor
Valued Contributor

You can try to upload the folder in the workspace location and try to cd in the desired folder and try to install in via notebook. But it would be a notebook scope installation. If you are looking for a cluster scoped installation then you would need jar or wl file.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!