Welcome 2023 Virtual hackathon participants, we're happy to have you! ✋ Please use this space to ask questions, we'll have some folks from Da...

[KarenBT]

Welcome 2023 Virtual hackathon participants, we're happy to have you! ✋

Please use this space to ask questions, we'll have some folks from Databricks and the community join to help out. We're really excited to see what you work on and if you have any additional datasets, resources you think would be helpful for others, please share them here.

DEVPOST HACKATHON URL for easy referral 🐑

 🚩 NOTE - This hackathon is open to everyone, and using the Databricks platform is purely optional and has no bearing on project judgment. Feel free to use any platform to run your training or inference, whether this is on your own environment to a managed service. 

[Michelle_-_Devp]

Hi all! Michelle from Devpost here.👋 Excited to see what you all do with large language models or Spark Connect! If you have any questions about the rules or Devpost, I’ll try my best to answer. Happy building!

[rogave]

Hi! I am Robert! 😁 Can we host the solution in AWS or needs to be cloud agnostic?

[KarenBT]

Hey @Robert Garcia Ventura​ I'll ask the team and get back to you. stay tuned!

[KarenBT]

@Robert Garcia Ventura​ You can totally use AWS, feel free to use what you'd like!

[sanggusti]

Hi! I'm Gusti, would love to learn and try my best shot on this Hackathon. Do we got any GPU instances to run processes? Since embedding and fitting LLM models could be very costly and most of free options are not reliable enough.

[sanggusti]

Hi, I also have another question. Do we get any Databricks platform access for the period of hackathon? My company didn't use one and the trial is only 14 days. I'm pretty aware of the capability and since the hackathon are held by Databricks I think the participants should get one month subscription at least.

[KarenBT]

Hi @Gusti Winata​ I'm working on getting you an answer, stay tuned. Excited you're participating! - Karen

[KarenBT]

@Gusti Winata​ This hackathon is open to everyone, and using the Databricks platform is purely optional and has no bearing on project judgment. Feel free to use any platform to run your training or inference, whether this is on your own environment to a managed service.  Thanks for your question! 🙂

[bayang]

@Karen Bajza-Terlouw​ Thanks, it is good to know, I will use AWS instances.

[KarenBT]

@Gusti Winata​ This hackathon is open to everyone, and using the Databricks platform is purely optional and has no bearing on project judgment. Feel free to use any platform to run your training or inference, whether this is on your own environment to a managed service.  Thanks for your question!

[sanggusti]

If you say so, but can we get any credits for azure/gcp/aws since indexing and embedding is computely heavy?

[KarenBT]

As this is an open hackathon, we cannot offer cloud/service credits. As mentioned above, using a cloud/service is not a requirement for participating in this open hackathon. 🙂

[kamalds]

Hi Karen @Karen Bajza-Terlouw​ ​ ,

I have a similar question. Can a databricks account be provided for 1 month access for this hackathon ? Because some LLM's from databricks need the respective compute from databricks too.

Thanks

Kamal

[Michelle_-_Devp]

Hi Kamalds, While using Databricks is not necessary and will not impact how your project is reviewed, If you’d like to use Databricks and don’t already have an account, you may create a Databricks Community Edition account to get started. If you need more resources, you may also set up a full-platform Databricks account with the free 14-day trial in the last two weeks of the competition. 

Additional resources from the public cloud partners:

https://cloud.google.com/free

https://azure.microsoft.com/en-us/free/

https://aws.amazon.com/free