topic Re: Error when creating a compute resource with runtime 16.1 in Data Engineering

Error when creating a compute resource with runtime 16.1

juchom — Tue, 11 Feb 2025 10:41:43 GMT

Hello,

Is there any restriction on community edition runtimes, because when I try to create a compute resource with runtime 16.1 it takes a long time and then always end with a failure like the following screenshot.

Thanks for your help,

Re: Error when creating a compute resource with runtime 16.1

Alberto_Umana — Tue, 11 Feb 2025 12:47:00 GMT

Hello @juchom,

Yes, there are restrictions on the Databricks Community Edition runtimes. The Community Edition has certain limitations, including the versions of DBR that can be used, but to confirm could you please advise what is the error you are observing?

Re: Error when creating a compute resource with runtime 16.1

juchom — Tue, 11 Feb 2025 13:05:12 GMT

Hello Alberto,

Here is a picture of the logs with the error message.

And the details

Time

2025-02-11 10:25:34 CET

Message

Compute terminated. Reason: Container launch failure

Help

An unexpected error was encountered while launching containers on worker instances for the cluster. Please retry and contact Databricks if the problem persists.

Instance ID: i-0e64a26f2b6594754

Internal error message: Failed to launch spark container on instance i-0e64a26f2b6594754. Exception: Unexpected internal error, please contact Databricks support

Let me know if you need more information or a specific test.

Thanks,

Julien

Re: Error when creating a compute resource with runtime 16.1

Alberto_Umana — Tue, 11 Feb 2025 13:06:03 GMT

Hi @juchom,

Thanks for the details, are you using any type of container (docker) image? Or any special setting on the cluster?

If you use any LTS DBR version it works fine, right?

I will see if I can replicate this.

Re: Error when creating a compute resource with runtime 16.1

juchom — Tue, 11 Feb 2025 13:20:31 GMT

Thanks for the details, are you using any type of container (docker) image? Or any special setting on the cluster?

Nothing special, I just click on create compute button, then select 16.1 from the dropdown and click create compute button again.

If you use any LTS DBR version it works fine, right?

Yes, I have just created a 15.4 fine.