Databricks Community

Authors: Anastasia Prokaieva and Puneet Jain  In our first part, we have covered the main aspects of the data loading using Hugging Face integration with the Spark dataframes and how to use RayAIR to distribute your fine-tuning for BERT model for 2 c...

Authors: Anastasia Prokaieva and Puneet Jain The aim of this blog is to show the end-to-end process of conversion from vanilla Hugging Face 珞 to Ray AIR 珞 on Databricks, without changing the training logic unless necessary. We have seen many customer...