cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Photon Acceleration not getting enabled for ML runtime in Azure

Sajid1
Contributor

I tried to enable the photon acceleration in ML runtime 9.1 LTS ML (Scala 2.12,Spark 3.1.2) but getting error "selected runtime version does not support photon".

I tried for other versions of ML runtime with single and multinode , access mode being single.

  • Node : Standard_E4ds_v4

Kindly let me know where am I going wrong

1 ACCEPTED SOLUTION

Accepted Solutions

But it is not available to ML runtime. Photon acceleration is provided for only Standard runtime above 9.1 LTS

View solution in original post

3 REPLIES 3

karthik_p
Esteemed Contributor

@Sajid Thavalengal Rahiman​ Yes please, we have also tried that and found it is not supported for ML Runtimes. but other way to run your data science workloads is use standard DBR above 9.1 LTS and enable photon and run your workloads and keep on tuning your worker type and driver type

Photon runtime | Databricks on AWS

But it is not available to ML runtime. Photon acceleration is provided for only Standard runtime above 9.1 LTS

Anonymous
Not applicable

Hi @Sajid Thavalengal Rahiman​ 

Does @Kaniz Fatma​ response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?

We'd love to hear from you.

Thanks!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group