Databricks

mhansinger · 01-13-2023

From a notebook I created a new feature store via:%sql CREATE DATABASE IF NOT EXISTS feature_store_ebp;Within that feature store I fill my table with:feature_store_name = "feature_store_ebp.table_1" try: fs.write_table( name=feature_stor...

mhansinger · 02-25-2022

Hello,I would like to set the default "spark.driver.maxResultSize" from the notebook on my cluster. I know I can do that in the cluster settings, but is there a way to set it by code?I also know how to do it when I start a spark session, but in my ca...

mhansinger · 11-10-2021

Hi,is there a way to get the time stamp of the last update of a feature store table with the feature store client API? The creation time stamp can be querried as: feature_store.FeatureStoreClient().get_feature_table(name="my.table").creation_timestam...

mhansinger · 01-16-2023

Hi @Kaniz Fatma, unfortunately, that did not solve the problem.

mhansinger · 02-25-2022

Hi @Kaniz Fatma thanks for your reply.Not sure if that helps. When I check after execution of your code with spark.conf.get("spark.driver.maxResultSize")I still get the default "spark.dirver.maxResultSize", instead of 4096.

Databricks

User Stats

User Activity

Cannot write Feature Table because of invalid access token

Set default "spark.driver.maxResultSize" from the notebook

Get FeatureStore write date

Re: Cannot write Feature Table because of invalid access token

Re: Set default "spark.driver.maxResultSize" from the notebook