cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Christine
by • Contributor II
  • 20275 Views
  • 2 replies
  • 2 kudos

ADD COLUMN IF NOT EXISTS does not recognize "IF NOT EXIST". How do I add a column to an existing delta table with SQL if the column does not already exist?

How do I add a column to an existing delta table with SQL if the column does not already exist?I am using the following code: <%sqlALTER TABLE table_name ADD COLUMN IF NOT EXISTS column_name type; >but it prints the error: <[PARSE_SYNTAX_ERROR] Synta...

  • 20275 Views
  • 2 replies
  • 2 kudos
Latest Reply
Woldie
New Contributor II
  • 2 kudos

Here some SQL devilry that does not require SQL Scripting nor pythons.  It adds a my_extra_column FLOAT to the target table with null values. I'm as shocked as anyone that this works, (and if it's undocumented behavior, someone in Databricks Command ...

  • 2 kudos
1 More Replies
vinaykumar
by • Databricks Partner
  • 15493 Views
  • 9 replies
  • 0 kudos

Log files are not getting deleted automatically after logRetentionDuration internal

Hi team Log files are not getting deleted automatically after logRetentionDuration internal from delta log folder and after analysis , I see checkpoint files are not getting created after 10 commits . Below table properties using spark.sql(    f"""  ...

No checkpoint.parquet
  • 15493 Views
  • 9 replies
  • 0 kudos
Latest Reply
alex307
New Contributor II
  • 0 kudos

Any body get any solution?

  • 0 kudos
8 More Replies
Labels