cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

vr
by Contributor
  • 4117 Views
  • 5 replies
  • 6 kudos

Resolved! How to avoid trimming in EXPLAIN?

I am looking on EXPLAIN EXTENDED plan for a statement.In == Physical Plan == section, I go down to FileScan node and see a lot of ellipsis, like +- FileScan parquet schema.table[Time#8459,TagName#8460,Value#8461,Quality#8462,day#8...

  • 4117 Views
  • 5 replies
  • 6 kudos
Latest Reply
SS2
Valued Contributor
  • 6 kudos

I also faced the same ​

  • 6 kudos
4 More Replies
pawelmitrus
by Contributor
  • 1575 Views
  • 3 replies
  • 3 kudos

log4j vulnerability - action plan for clients

I'm looking for some information regarding log4j vulnerability - if any databricks runtime should be changed manually by the client or when specific update will be applied.I know I can go through the docs by myself, finding out which log4j library is...

  • 1575 Views
  • 3 replies
  • 3 kudos
Latest Reply
Mr_Srinivasa
New Contributor II
  • 3 kudos

Thanks for sharing such important facts. I got the best security service provider website on the internet. They are excellence in the field of security. 

  • 3 kudos
2 More Replies
User16826994223
by Honored Contributor III
  • 4494 Views
  • 2 replies
  • 1 kudos

AssertionError: assertion failed: Unable to delete the record but I am able to select it though

Is there any reason this command works well:%sql SELECT * FROM datanase.table WHERE salary > 1000returning 2 rows, while the below:%sql delete FROM datanase.table WHERE salary > 1000ErrorError in SQL statement: AssertionError: assertion failed:...

  • 4494 Views
  • 2 replies
  • 1 kudos
Latest Reply
User16826994223
Honored Contributor III
  • 1 kudos

DELETE FROM (and similarly UPDAT. aren't supported on the Parquet files - right now on Databricks, it's supported for Delta format. You can convert your parquet files into delta using CONVERT TO DELTA, and then this command will work for you.

  • 1 kudos
1 More Replies
Labels