I was following the Databricks Academy "New Capabilities Overview: Feature Store" module. However when I try to run the code in the example notebook I get a security exception as explained below.
When I try to run the example notebook "01-Populate a feature store" I get an error while creating a feature table, I get a
py4j.security.Py4JSecurityException: Method public java.lang.String org.apache.spark.api.java.JavaSparkContext.getLocalProperty(java.lang.String) is not whitelisted on class class org.apache.spark.api.java.JavaSparkContext
This error is on the first line of the code
fs.create_feature_table(
name=f"fxs_eu_ntwkdaor_efsx_001.tmp_{username}_trip_pickup_features",
keys=["zip", "ts"],
features_df=pickup_features,
partition_columns="yyyy_mm",
description="Taxi Fares. Pickup Features",
)
fs.create_feature_table(
name=f"fxs_eu_ntwkdaor_efsx_001.tmp_{username}_trip_dropoff_features",
keys=["zip", "ts"],
features_df=dropoff_features,
partition_columns="yyyy_mm",
description="Taxi Fares. Dropoff Features",
)
:
How can I get this whitelisted?
