topic Automatically importing packages in notebooks in Warehousing & Analytics

Automatically importing packages in notebooks

Kaz — Wed, 04 Oct 2023 09:19:01 GMT

Within our team, there are certain (custom) python packages we always use and import in the same way. When starting a new notebook or analysis, we have to import these packages every time. Is it possible to automatically make these imports available for all notebooks on a cluster?

Re: Automatically importing packages in notebooks

-werners- — Wed, 04 Oct 2023 11:52:48 GMT

is it an option to put the imports in a separate notebook and call that notebook using %run?

Re: Automatically importing packages in notebooks

Kaz — Wed, 04 Oct 2023 12:44:04 GMT

Definitely already an improvement! But it would be even better if we don't have to type the %run in each notebook.

Re: Automatically importing packages in notebooks

-werners- — Thu, 05 Oct 2023 13:42:42 GMT

I don't see how that is possible as the imports are part of the program. Somewhere you will have to type them.
Even if it were possible, I would advise against it. Imports should be stated explicitly and be traceable in case something does not work as expected f.e.

Re: Automatically importing packages in notebooks

Tharun-Kumar — Fri, 06 Oct 2023 04:40:05 GMT

@Kaz

You can install these libraries using the Libraries section in the Compute.

All of the libraries mentioned here would be installed whenever the cluster is spun up.