topic Re: Time-out when using init script to install GDAL in Data Engineering

Time-out when using init script to install GDAL

meystingray — Tue, 12 Sep 2023 19:53:03 GMT

I'm following this post to run an init script to install gdal.

https://community.databricks.com/t5/get-started-discussions/gdal-on-databricks-cluster-runtime-12-2-lts/m-p/39091#M662

My script is simply:

--------------

#!/bin/bash

apt-get update && apt-get upgrade

apt-get install gdal*

--------------

This should be simple enough. However when starting the cluster, the script runs for an hour and then times out. What gives? How to fix?

Re: Time-out when using init script to install GDAL

meystingray — Wed, 13 Sep 2023 20:20:46 GMT

Really appreciate the response, @Retired_mod. So using your advice, I tried commenting out various parts of the script, but kept getting an error of the type: "Init script failure:
Cluster scoped init script /Users/XYZ/gdal_install.sh failed: Script exit status is non-zero"

The only thing that worked was:

apt-get update

I'm trying to install gdal on a Databricks Runtime Version 13.2 ML. Thanks, Sean

Re: Time-out when using init script to install GDAL

-werners- — Thu, 14 Sep 2023 08:21:23 GMT

you could skip the upgrade part and just go for the gdal install instead.