Trying out Dolly - how to load pytorch_model.bin so it's not downloading it every time the cluster is restarted
Hi, I am new to LLM and am curious to try it out. I did the following code to test from the databricks website:import torch from transformers import pipeline instruct_pipeline = pipeline(model="databricks/dolly-v2-12b", torch_dtype=torch.bfloat16, tr...
- 10280 Views
- 5 replies
- 2 kudos
Latest Reply
Just set the HF cache dir to a persistent path on /dbfs:import os os.environ['TRANSFORMERS_CACHE'] = "/dbfs/..."
- 2 kudos