Delete row from table is not working.

kjoth
Contributor II

‎10-12-2021 11:54 PM

I have created External table using spark via below command. (Using Data science & Engineering)

df.write.mode("overwrite").format("parquet").saveAsTable(name=f'{db_name}.{table_name}', path="dbfs:/reports/testing")

I have tried to delete a row based on filter condition using SQL endpoint (Using SQL )

DELETE FROM
 
  testing.mobile_number_table
 
WHERE
 
  x1 == 9940062964

Getting below error message.

Spark 3.0 Plans are not fully supported on table acl or credential passthrough clusters: DeleteFromTable (x1#6341L = 9940062964)