cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

What programming frameworks and languages can be used with Databricks Feature Store

rjwswenson
New Contributor II

To leverage Databricks feature store, can only Python be utilized? If otherwise, what other language frameworks are supported. Below is my question in 2 parts

Part 1) What languages can be utilized to write data frames as feature tables in the Feature Store?

Part 2) Can models in R, SparkR, or Scala used for inference, access the Feature Store ?

Thanks,

Ryan

7 REPLIES 7

yogu
Honored Contributor III

1)DataFrame API is available in Scala, Java, Python, and R.

you can use any of above language as per you choice.

chakri
New Contributor III

There are four languages available namely Python, SQL, Scala and R.

U can also use SQL in Python notebook using magic commands like %sql.

Wunlung
Contributor

From the official documentation, it looks like you can only use Python API to access Featurestore.

And only Python API reference is available on the Documentation page.

You need a featurestoreclient(Only available to python) to write the table to featurestore.

  1. What languages can be utilized to write data frames as feature tables in the Feature Store? Python
  2. Can models in R, SparkR, or Scala used for inference, access the Feature Store ? No

However, if you understand the underlying storage of FeatureStore, it's just a delta table. You can use any other DataframeAPI available in Scala, Java, Python and R and write to the delta table.

And the register the existing Delta Table as a feature table using python API.

Reference:

Register an existing Delta table as a feature table

https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/feature-tables#cre...

A feature table is stored as a Delta table. 

https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/troubleshooting-an...

Rajeev_Basu
Contributor III

you can use any of Scala, R, Java or Python to play around with dataframes.

Ajay-Pandey
Esteemed Contributor III

Hi you can use Scala, Java, Python, and R language in databricks ,

You have to just add % and then your language like- @sql, %python, etc. starting with your cmd.

Heman2
Valued Contributor II

Hello,

you can use Python, Scala, Java, and R language in databricks ,

You need to specify the cell starting with which language you use by adding % and then your language like- %sql, %python, etc. starting with your cmd.​

boyelana
Contributor III

you can use any of these languages Python, SQL, Scala and R

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.