TrainingArguments fails

thomas_berry
Databricks Partner

Hello,

I am working on an ML project for text classification and I have a problem.

The following piece of code stalls completely. It prints 'start' but never 'end'.

from transformers import TrainingArguments
print("start")
args = TrainingArguments(output_dir="test")
print("end")

 I installed the hugging face package with the following cell:

%pip install  transformers[torch] torch
%restart_python

I am trying to run it in runtime 17.3 (without ML) but it also stalls in the serverless environment "base v5" of databricks free which runs in python 3.12. 

I tried running the same code in my laptop with python 3.12 and it does not fail.

Has anyone else had this problem? How did you solve it?