topic How to access databricks feature store outside databricks? in Machine Learning

How to access databricks feature store outside databricks?

Nithin — Wed, 05 Jan 2022 05:21:25 GMT

We are building the feature store using databricks API. Few of the machine learning engineers are using Jupyter notebooks. Is it possible to use feature store outside databricks?

Re: How to access databricks feature store outside databricks?

Atanu — Wed, 12 Jan 2022 04:25:20 GMT

Thanks true.

Re: How to access databricks feature store outside databricks?

CHANDAN_NANDY — Wed, 12 Jan 2022 05:46:54 GMT

I see databricks plugin in Visual Studio. Is that of any use? I am interested because if I get the things in Visual Studio I will be able to use GitCopilot there. That's amazing.

Re: How to access databricks feature store outside databricks?

akankshii — Wed, 09 Mar 2022 06:08:39 GMT

from databricks import feature_store

from databricks.feature_store import FeatureStoreClient,feature_table

we used to use them in databricks notebooks trying to replicate the same in pycharm however it doesn't seem to work . some say u can patch code using below link

Tips and Tricks for using Python with Databricks Connect - DEV Community

what's your suggestion on this and i read your above response it says accessible through jobs what does that mean ... did u mean trigger it through job (adf) and databricks notebook's code run on databricks cluster . How about running a job through IDE .

please explain

Re: How to access databricks feature store outside databricks?

Elroczy — Mon, 21 Mar 2022 17:02:12 GMT

@Kaniz Fatma I have a question regarding accessing feature tables created in databricks via DBFS.

I see that the data has to reside in dbfs to read and run the feature store on top of it. In my environment, dbfs is locked for security reasons. Is there a workaround or another way to write and read access the feature table maybe from an azure blob container?

Re: How to access databricks feature store outside databricks?

jose_gonzalez — Mon, 25 Apr 2022 18:54:46 GMT

Hi @Uc A ,

Just a friendly follow-up. Do you still need help or @Kaniz Fatma 's response help you to find the solution? Please let us know.

Re: How to access databricks feature store outside databricks?

datariel — Thu, 28 Apr 2022 15:58:00 GMT

Hi @Kaniz Fatma and @Jose Gonzalez ,

turning back to the original question, and considering that one of the main benefits of the Feature Store is the removal of the online/offline skew, how could I access to the features from a client application like a web app for instance, external to Databricks? Is there any way?

Thanks!

Re: How to access databricks feature store outside databricks?

Elroczy — Wed, 18 May 2022 15:17:00 GMT

still need help