Unable to drop a table

brickster_2018 — Fri, 25 Jun 2021 16:19:02 GMT

I have a Table which and I do not have access to the underlying data any longer. We do not need this dataset anymore, but unable to drop the table

Re: Unable to drop a table

brickster_2018 — Fri, 25 Jun 2021 16:19:55 GMT

Use the below code snippet to forcefully drop the table:

package org.apache.spark.sql.hive {
import org.apache.spark.sql.hive.HiveUtils
import org.apache.spark.SparkContext
 
object utils {
    def dropTable(sc: SparkContext, dbName: String, tableName: String, ignoreIfNotExists: Boolean, purge: Boolean): Unit = {
      HiveUtils
          .newClientForMetadata(sc.getConf, sc.hadoopConfiguration)
          .dropTable(dbName, tableName, ignoreIfNotExists, false)
    }
  }
}

import org.apache.spark.sql.hive.utils
utils.dropTable(sc, "default", "my_table", true, true)

topic Re: Unable to drop a table in Data Engineering

Unable to drop a table

Re: Unable to drop a table