- 8797 Views
- 4 replies
- 3 kudos
Best way to install and manage a private Python package that has a continuously updating Wheel
I'm trying to setup a Workspace Library that is used internally within our organization. This is a Python package, where the source is available on a private GitHub repository, and not accessible on PyPi or the wider internet / surface web. I managed...
- 8797 Views
- 4 replies
- 3 kudos
- 3 kudos
@Eshwaran Venkat​ You can use the Databricks CLI to automate the process of cloning the private GitHub repository and building/uploading the Python package to DBFS as a wheel file. You can schedule this process to run periodically, such as once a day...
- 3 kudos
- 4291 Views
- 4 replies
- 2 kudos
Resolved! Support for kwargs parameter in `/2.1/jobs/create` endpoint for `python_wheel_task`
If I create a job from the web UI and I select Python wheel, I can add kwargs parameters. Judging from the generated JSON job description, they appear under a section named `namedParameters`.However, if I use the REST APIs to create a job, it appears...
- 4291 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi there, the documentation is not up-to-date, you should be able to create such a task with namedParameters instead of parameters. Here is a small example:{ "name": "test_entry_point", "tasks": [ { "task_key": "test_entry_point", "description":...
- 2 kudos