topic Re: How to access the virtual environment directory where the databricks notebooks are running? in Data Engineering

How to access the virtual environment directory where the databricks notebooks are running?

Juniper_AIML — Tue, 15 Feb 2022 16:54:12 GMT

How to get access to a separate virtual environment space and its storage location on databricks so that we can move our created libraries into it without waiting for their installation each time the cluster is brought up.

What we want basically is a CLI access to the virtual env directory where the databricks notebooks are running.

Re: How to access the virtual environment directory where the databricks notebooks are running?

Anonymous — Wed, 16 Feb 2022 16:41:27 GMT

Hello, @Aman Gaurav! My name is Piper, and I'm a moderator for Databricks. Thank you for your question and welcome to the community. We'll give your peers a chance to respond and then we'll circle back if we need to.

Thanks in advance for your patience. 🙂

Re: How to access the virtual environment directory where the databricks notebooks are running?

Atanu — Tue, 08 Mar 2022 13:49:43 GMT

@Aman Gaurav could you please elaborate about the virtual environment directory . you can leverage our DBFS CLI (https://docs.databricks.com/dev-tools/cli/dbfs-cli.html) for library installation. But not sure that's the use case you are looking for.

Re: How to access the virtual environment directory where the databricks notebooks are running?

Anonymous — Thu, 28 Apr 2022 17:28:48 GMT

Hey there @Aman Gaurav

Thank you for posting your question.

Just wanted to check in if you were able to resolve your issue or do you need more help? We'd love to hear from you.

Thanks!