cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

What programming frameworks and languages can be used with Databricks Feature Store

rjwswenson
New Contributor II

To leverage Databricks feature store, can only Python be utilized? If otherwise, what other language frameworks are supported. Below is my question in 2 parts

Part 1) What languages can be utilized to write data frames as feature tables in the Feature Store?

Part 2) Can models in R, SparkR, or Scala used for inference, access the Feature Store ?

Thanks,

Ryan

7 REPLIES 7

yogu
Honored Contributor III

1)DataFrame API is available in Scala, Java, Python, and R.

you can use any of above language as per you choice.

chakri
New Contributor III

There are four languages available namely Python, SQL, Scala and R.

U can also use SQL in Python notebook using magic commands like %sql.

Wunlung
Contributor

From the official documentation, it looks like you can only use Python API to access Featurestore.

And only Python API reference is available on the Documentation page.

You need a featurestoreclient(Only available to python) to write the table to featurestore.

  1. What languages can be utilized to write data frames as feature tables in the Feature Store? Python
  2. Can models in R, SparkR, or Scala used for inference, access the Feature Store ? No

However, if you understand the underlying storage of FeatureStore, it's just a delta table. You can use any other DataframeAPI available in Scala, Java, Python and R and write to the delta table.

And the register the existing Delta Table as a feature table using python API.

Reference:

Register an existing Delta table as a feature table

https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/feature-tables#cre...

A feature table is stored as a Delta table. 

https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/troubleshooting-an...

Rajeev_Basu
Contributor III

you can use any of Scala, R, Java or Python to play around with dataframes.

Ajay-Pandey
Esteemed Contributor III

Hi you can use Scala, Java, Python, and R language in databricks ,

You have to just add % and then your language like- @sql, %python, etc. starting with your cmd.

Ajay Kumar Pandey

Heman2
Valued Contributor II

Hello,

you can use Python, Scala, Java, and R language in databricks ,

You need to specify the cell starting with which language you use by adding % and then your language like- %sql, %python, etc. starting with your cmd.โ€‹

boyelana
Contributor III

you can use any of these languages Python, SQL, Scala and R

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group