topic Re: What programming frameworks and languages can be used with Databricks Feature Store in Machine Learning

What programming frameworks and languages can be used with Databricks Feature Store

rjwswenson — Mon, 08 Aug 2022 16:45:38 GMT

To leverage Databricks feature store, can only Python be utilized? If otherwise, what other language frameworks are supported. Below is my question in 2 parts

Part 1) What languages can be utilized to write data frames as feature tables in the Feature Store?

Part 2) Can models in R, SparkR, or Scala used for inference, access the Feature Store ?

Thanks,

Ryan

Re: What programming frameworks and languages can be used with Databricks Feature Store

yogu — Tue, 22 Nov 2022 14:21:19 GMT

1)DataFrame API is available in Scala, Java, Python, and R.

you can use any of above language as per you choice.

Re: What programming frameworks and languages can be used with Databricks Feature Store

chakri — Wed, 23 Nov 2022 07:33:17 GMT

There are four languages available namely Python, SQL, Scala and R.

U can also use SQL in Python notebook using magic commands like %sql.

Re: What programming frameworks and languages can be used with Databricks Feature Store

Wunlung — Thu, 01 Dec 2022 04:09:08 GMT

From the official documentation, it looks like you can only use Python API to access Featurestore.

And only Python API reference is available on the Documentation page.

You need a featurestoreclient(Only available to python) to write the table to featurestore.

What languages can be utilized to write data frames as feature tables in the Feature Store? Python
Can models in R, SparkR, or Scala used for inference, access the Feature Store ? No

However, if you understand the underlying storage of FeatureStore, it's just a delta table. You can use any other DataframeAPI available in Scala, Java, Python and R and write to the delta table.

And the register the existing Delta Table as a feature table using python API.

Reference:

https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/feature-tables#create-feature-table

A feature table is stored as a Delta table.

https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/troubleshooting-and-limitations

Re: What programming frameworks and languages can be used with Databricks Feature Store

Rajeev_Basu — Thu, 01 Dec 2022 06:09:41 GMT

you can use any of Scala, R, Java or Python to play around with dataframes.

Re: What programming frameworks and languages can be used with Databricks Feature Store

Ajay-Pandey — Tue, 06 Dec 2022 09:24:58 GMT

Hi you can use Scala, Java, Python, and R language in databricks ,

You have to just add % and then your language like- @sql, %python, etc. starting with your cmd.

Re: What programming frameworks and languages can be used with Databricks Feature Store

Heman2 — Tue, 06 Dec 2022 11:44:05 GMT

Hello,

you can use Python, Scala, Java, and R language in databricks ,

You need to specify the cell starting with which language you use by adding % and then your language like- %sql, %python, etc. starting with your cmd.

Re: What programming frameworks and languages can be used with Databricks Feature Store

boyelana — Tue, 06 Dec 2022 15:19:37 GMT

you can use any of these languages Python, SQL, Scala and R