What programming frameworks and languages can be used with Databricks Feature Store
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-08-2022 09:45 AM
To leverage Databricks feature store, can only Python be utilized? If otherwise, what other language frameworks are supported. Below is my question in 2 parts
Part 1) What languages can be utilized to write data frames as feature tables in the Feature Store?
Part 2) Can models in R, SparkR, or Scala used for inference, access the Feature Store ?
Thanks,
Ryan
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-22-2022 06:21 AM
1)DataFrame API is available in Scala, Java, Python, and R.
you can use any of above language as per you choice.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-22-2022 11:33 PM
There are four languages available namely Python, SQL, Scala and R.
U can also use SQL in Python notebook using magic commands like %sql.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-30-2022 08:09 PM
From the official documentation, it looks like you can only use Python API to access Featurestore.
And only Python API reference is available on the Documentation page.
You need a featurestoreclient(Only available to python) to write the table to featurestore.
- What languages can be utilized to write data frames as feature tables in the Feature Store? Python
- Can models in R, SparkR, or Scala used for inference, access the Feature Store ? No
However, if you understand the underlying storage of FeatureStore, it's just a delta table. You can use any other DataframeAPI available in Scala, Java, Python and R and write to the delta table.
And the register the existing Delta Table as a feature table using python API.
Reference:
Register an existing Delta table as a feature table
A feature table is stored as a Delta table.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-30-2022 10:09 PM
you can use any of Scala, R, Java or Python to play around with dataframes.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-06-2022 01:24 AM
Hi you can use Scala, Java, Python, and R language in databricks ,
You have to just add % and then your language like- @sql, %python, etc. starting with your cmd.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-06-2022 03:44 AM
Hello,
you can use Python, Scala, Java, and R language in databricks ,
You need to specify the cell starting with which language you use by adding % and then your language like- %sql, %python, etc. starting with your cmd.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-06-2022 07:19 AM
you can use any of these languages Python, SQL, Scala and R