cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
cancel
Showing results for 
Search instead for 
Did you mean: 

My Global Init Script doesn't run with the new(er) LTS version 13.3. It runs great on 12.2LTS

Benedetta
New Contributor III

Hey Databricks,

     Seems like you changed the way Global Init Scripts work.  How come you changed it? My Global Init Script runs great on 12.2LTS but not on the new(er) LTS version 13.3. We don't have Unity Catalog turned on. What's up with that? Are Global Init scripts going away for good?

Thank you

Benedetta

1 ACCEPTED SOLUTION

Accepted Solutions

ChloeBors
New Contributor III

Hello Benedetta,

I had the same issue with an odbc init script.

Within the global script it was using an ubuntu version (16.04).
After I upgraded this version in the script to 22.04 it worked! (that 22.04 version also shows on Databricks Runtime 13.3 LTS | Databricks on AWS under System Environment)

I hope this will help you!

View solution in original post

4 REPLIES 4

Kaniz
Community Manager
Community Manager

Hi @BenedettaHello! It appears you’ve noticed some changes in the way Global Init Scripts function in Databricks. Let me provide some insights into this:

  1. Global Init Scripts:

    • These scripts run on every cluster created within your workspace.
    • They are useful when you want to enforce organization-wide library configurations or implement security measures.
    • Only workspace admins can create global init scripts, and they can be set up using either the UI or REST API.
    • Keep in mind that because global init scripts run on all clusters, there are potential impacts to consider:
  2. Cluster-Scoped Init Scripts:

  3. Unity Catalog:

    • Since you mentioned that you don’t have Unity Catalog turned on, it’s essential to understand that global init scripts are not run on model serving clusters.
    • As for the future of global init scripts, there’s no indication that they’re going away for good. However, Databricks continues to evolve its platform, so staying informed about updates is crucial.

Remember to restart your clusters after making any changes to init scripts for them to take effect. If you have further questions or need assistance, feel free to ask! 😊

 

Benedetta
New Contributor III

Hi Kaniz,

     Thanks for your reply. I still don't understand if my pyodbc global init script is supposed to run on LTS 13.3. If so.....it doesn't. The connection to the server fails. In the past when upgrading to the latest LTS runtime, I don't recall the init scripts failing.  Could you please confirm if my init script should run on the newer 13.3 LTS version, as it does on the LTS 12.2 version?

Thank you!

Benedetta

ChloeBors
New Contributor III

Hello Benedetta,

I had the same issue with an odbc init script.

Within the global script it was using an ubuntu version (16.04).
After I upgraded this version in the script to 22.04 it worked! (that 22.04 version also shows on Databricks Runtime 13.3 LTS | Databricks on AWS under System Environment)

I hope this will help you!

Benedetta
New Contributor III

Thank you ChloeBors - I tried upgrading the ubuntu version per your suggestion but got a new error "Can t open lib ODBC Driver 17 for SQL Server file not found 0 SQLDriverConnect". I tried modifying this line to 18:  ACCEPT_EULA=Y apt-get install msodbcsql17 but I got the same error about 17. Not sure what to do next.

 

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.