After much digging, observed i was using standard runtime. Once i switched to ML runtime of databricks, issue was resolved.

To use Feature Store capability, ensure that you select a Databricks Runtime ML version from the Databricks Runtime Version drop-down