cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Table is being dropped when cluster terminates in comunity edition

Sas
New Contributor II

Hi Expert

I have created an external table in databricks community edition. Table is external table. But when i cluster is terminated, i am not able to query the table any more. What is the reason? What i need to do so that table is not dropped. Table creation script is as below

DeltaTable.createOrReplace(spark)\
    .tableName("delta_internal_demo")\
    .addColumn("emp_id",'INT')\
    .addColumn("emp_name",'STRING')\
    .addColumn("gender",'STRING')\
    .addColumn("Salary",'INT')\
    .addColumn('Dept','STRING')\
    .property("description",'table created for demo purpose')\
    .location("/FileStore/tables/delta/archival_demo")\
    .execute()
1 ACCEPTED SOLUTION

Accepted Solutions

jose_gonzalez
Moderator
Moderator

This is an expected behavior to the community edition clusters. Upon termination of the cluster, the data is purged.

View solution in original post

2 REPLIES 2

jose_gonzalez
Moderator
Moderator

This is an expected behavior to the community edition clusters. Upon termination of the cluster, the data is purged.

Sas
New Contributor II

Thanks for your reply. I am seeing that data files are still there. But table defination is dropped. When i recreate the table with same script, i am able to access old data

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.