cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
pvignesh92
Honored Contributor
since ‎11-26-2022
‎02-20-2024

User Stats

  • 111 Posts
  • 16 Solutions
  • 10 Kudos given
  • 43 Kudos received

User Activity

Very often, we need to know how many files my table path contains and the overall size of the path for various optimizations. In the past, I had to wr...

05-26-2023
Very often, we need to know how many files my table path contains and the overall size of the path for various optimizations. In the past, I had to write my own logic to accomplish this.Delta Lake is making life easier. See how simple it is to obtain...

lnkd.in

05-22-2023
Databricks Auto Loader is an interesting feature that can be used to load data incrementally.✳ It can process new data files as they arrive in the cloud object stores✳ It can be used to ingest JSON, CSV, PARQUET, AVRO, ORC, TEXT and even Binary file ...

Pls restrict Spamming

03-30-2023
Hi @Vidula Khanna​ , Recently there has been too many spams posted in the community discussions. I'm sure you might have noticed them. Is there any chance to clear all of them and may be restrict them in some way so that the purpose of this community...

Multi Statement Writes from Spark to Snowflake

03-10-2023
Does Spark support multi statement writes to Snowflake in a single session? To elaborate, I have a requirement where I need to do A selective deletion of data from a Snowflake table and Insert records to Snowflake table ( Ranges from around 1 M rows)...

Optimizing Writes from Databricks to Snowflake

03-10-2023
My job after doing all the processing in Databricks layer writes the final output to Snowflake tables using df.write API and using Spark snowflake connector. I often see that even a small dataset (16 partitions and 20k rows in each partition) takes a...
View more