How Photon Acceleration Actually works?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-24-2024 11:59 PM
Hey folks!
I would like to know that how photon acceleration actually works, I have tested it on a sample of 219MB, 513MB, 2.7 GB, 4.1 GB of Data and the difference in seconds between normal and photon accelerated compute was not so much, So my question is, is it really worth to enable photon for reading and writing the data and if it is so for what data size and from what data size?
One more thing I would like to ask is the data is in parquet or delta format will there be a time reduction in photon compute comparatively to a normal compute
Will be looking forward to the answers
Regards,
Priyansh
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-25-2024 01:50 AM
Try to check merge operation on tables over 200GB.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-25-2024 01:56 AM
Hey @arch_db
I will try it, can you please also tell me how Vectorized query processing helps in this, if the tales are either being read in batch or by row by row, in batch also each row should be read, so how it can help in time efficiency?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-25-2024 02:08 AM
Photon enable dynamic file pruning.
About DFP speedup you can watch in https://www.youtube.com/watch?v=yZmrpXJg-G8

