โ08-08-2022 09:45 AM
To leverage Databricks feature store, can only Python be utilized? If otherwise, what other language frameworks are supported. Below is my question in 2 parts
Part 1) What languages can be utilized to write data frames as feature tables in the Feature Store?
Part 2) Can models in R, SparkR, or Scala used for inference, access the Feature Store ?
Thanks,
Ryan
โ11-22-2022 06:21 AM
1)DataFrame API is available in Scala, Java, Python, and R.
you can use any of above language as per you choice.
โ11-22-2022 11:33 PM
There are four languages available namely Python, SQL, Scala and R.
U can also use SQL in Python notebook using magic commands like %sql.
โ11-30-2022 08:09 PM
From the official documentation, it looks like you can only use Python API to access Featurestore.
And only Python API reference is available on the Documentation page.
You need a featurestoreclient(Only available to python) to write the table to featurestore.
However, if you understand the underlying storage of FeatureStore, it's just a delta table. You can use any other DataframeAPI available in Scala, Java, Python and R and write to the delta table.
And the register the existing Delta Table as a feature table using python API.
Reference:
Register an existing Delta table as a feature table
A feature table is stored as a Delta table.
โ11-30-2022 10:09 PM
you can use any of Scala, R, Java or Python to play around with dataframes.
โ12-06-2022 01:24 AM
Hi you can use Scala, Java, Python, and R language in databricks ,
You have to just add % and then your language like- @sql, %python, etc. starting with your cmd.
โ12-06-2022 03:44 AM
Hello,
you can use Python, Scala, Java, and R language in databricks ,
You need to specify the cell starting with which language you use by adding % and then your language like- %sql, %python, etc. starting with your cmd.โ
โ12-06-2022 07:19 AM
you can use any of these languages Python, SQL, Scala and R
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group