@neerajdubey_86 Yes, enabling Photon generally improves performance while lowering compute costs. Photon is a native vectorized query engine that processes data in columnar batches and created by Databricks. It delivers better price performance for data and analytics compared to other cloud data warehouses with no code changes required. It accelerates SQL workloads, DataFrame operations, joins, shuffles, scans, and writes (including Delta, Iceberg and Parquet). Photon is already the default engine in all Databricks SQL warehouses.
The cost-performance benefit depends on few characteristics. Photon provides the greatest gains for longer-running queries on large datasets involving complex transformations such as joins, aggregations and wide-table operations. Queries that normally complete in under two seconds see minimal improvement because execution time is dominated by planning and scheduling overhead rather than data processing. Simple batch ETL jobs without wide transformations or large data volumes may see negligible impact. Additionally, Photon is enabled on a per-cluster or per-warehouse basis, and since it uses the same compute resources, the cost savings come from faster completion times rather than lower per-hour rates - so workloads that don't benefit from acceleration could see higher per-unit costs with no corresponding speedup. More details here
