- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-14-2022 11:38 PM
i have copied a table in to a Parquet file now can i update a row or a column in a parquet file without rewriting all the data as the data is huge.
using Databricks or ADF
Thank You
- Labels:
-
ADF Pipeline
-
Azure databricks
-
Table
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-15-2022 06:31 AM
You can only append Data with Parquet that's why you need to convert your parquet table to Delta. It will be much easier.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-15-2022 06:40 AM
Thank You for the reply.
True, but for a requirement, I was looking for a way to update a Parquet file.
I guess we cant.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-16-2022 02:30 AM
correct. parquet files are immutable.
