docs.databricks.com
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-28-2021 06:23 AM
Advantage of using Photon Engine
The following summarizes the advantages of Photon:
- Supports SQL and equivalent DataFrame operations against Delta and Parquet tables.
- Expected to accelerate queries that process a significant amount of data (100GB+) and include aggregations and joins.
- Data is accessed repeatedly and likely in the Delta Lake cache.
- More robust scan performance on tables with many columns and many small files.
- Faster Delta and Parquet writing using UPDATE, DELETE, MERGE INTO, INSERT and CREATE TABLE AS SELECT especially for wide tables (hundreds to thousands of columns).
- Photon replaces sort-merge joins with hash-joins.
More details are on - https://docs.databricks.com/runtime/photon.html
Labels:
- Labels:
-
Delta
-
Photon
-
Photon Engine
0 REPLIES 0
![](/skins/images/97567C72181EBE789E1F0FD869E4C89B/responsive_peak/images/icon_anonymous_message.png)
![](/skins/images/97567C72181EBE789E1F0FD869E4C89B/responsive_peak/images/icon_anonymous_message.png)