cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Databricks3
by Contributor
  • 16587 Views
  • 11 replies
  • 12 kudos

Resolved! INFORMATION_SCHEMA IS NOT POPULATED WITH TABLE INFORMATION

I have created a metastore and within that metastore i have created multiple schemas and tables underlying it but none of table details is visible from information schema. All the tables are empty.Could you please let me know if I am missing here. Be...

  • 16587 Views
  • 11 replies
  • 12 kudos
Latest Reply
EwenGillies
New Contributor II
  • 12 kudos

I noticed this issue is currently caused when you rename a catalog.  The contents of <catalog>.information_schema are all views like this:SELECT * FROM system.information_schema.columns WHERE table_catalog = '<catalog>'If you rename the catalog...

  • 12 kudos
10 More Replies
Direo
by Contributor
  • 2213 Views
  • 3 replies
  • 2 kudos

Feature store feature table location

Can Databricks feature tables be stored outside of DBFS?

  • 2213 Views
  • 3 replies
  • 2 kudos
Latest Reply
the-sab
New Contributor II
  • 2 kudos

Yes, Databricks feature tables can be stored outside of Databricks File System (DBFS). You can store your feature tables in external storage systems such as Amazon S3, Azure Blob Storage, Azure Data Lake Storage, or Hadoop Distributed File System (HD...

  • 2 kudos
2 More Replies
Jack_Watson
by Contributor
  • 8971 Views
  • 6 replies
  • 0 kudos

Resolved! I am saving a new feature table to the Databricks feature store, and it won't write the data sources of the tables used to create the feature table, because they are Hive tables that point to Azure Data Lake Storage Gen1 Delta tables

My notebook is pulling in Hive tables from DBFS, that point to ADLS Gen1 file locations for their data (Delta tables), creating the feature table as a data frame within the notebook, then calling on the feature store client to save down the feature t...

  • 8971 Views
  • 6 replies
  • 0 kudos
Latest Reply
Atanu
Esteemed Contributor
  • 0 kudos

@Jack Watson​  Could you please confirm the write is succeeding ? If yes, as per my understanding This is a warning for some validation that we will be removing shortly. We’ll likely remove the validation which save the data source.Thanks.

  • 0 kudos
5 More Replies
Labels