Databricks Community

KarenBT · ‎05-16-2023

Welcome 2023 Virtual hackathon participants, we're happy to have you! ✋

Please use this space to ask questions, we'll have some folks from Databricks and the community join to help out. We're really excited to see what you work on and if you have any additional datasets, resources you think would be helpful for others, please share them here.

DEVPOST HACKATHON URL for easy referral 🐑

🚩 NOTE - This hackathon is open to everyone, and using the Databricks platform is purely optional and has no bearing on project judgment. Feel free to use any platform to run your training or inference, whether this is on your own environment to a managed service.

Michelle_-_Devp · ‎05-19-2023

Hi all! Michelle from Devpost here.👋 Excited to see what you all do with large language models or Spark Connect! If you have any questions about the rules or Devpost, I’ll try my best to answer. Happy building!

rogave · ‎05-20-2023

Hi! I am Robert! 😁 Can we host the solution in AWS or needs to be cloud agnostic?

KarenBT · ‎05-22-2023

Hey @Robert Garcia Ventura I'll ask the team and get back to you. stay tuned!

KarenBT · ‎05-22-2023

@Robert Garcia Ventura You can totally use AWS, feel free to use what you'd like!

sanggusti · ‎05-20-2023

Hi! I'm Gusti, would love to learn and try my best shot on this Hackathon. Do we got any GPU instances to run processes? Since embedding and fitting LLM models could be very costly and most of free options are not reliable enough.

sanggusti · ‎05-20-2023

Hi, I also have another question. Do we get any Databricks platform access for the period of hackathon? My company didn't use one and the trial is only 14 days. I'm pretty aware of the capability and since the hackathon are held by Databricks I think the participants should get one month subscription at least.

KarenBT · ‎05-22-2023

Hi @Gusti Winata I'm working on getting you an answer, stay tuned. Excited you're participating! - Karen

KarenBT · ‎05-23-2023

@Gusti Winata This hackathon is open to everyone, and using the Databricks platform is purely optional and has no bearing on project judgment. Feel free to use any platform to run your training or inference, whether this is on your own environment to a managed service. Thanks for your question! 🙂

bayang · ‎06-03-2023

@Karen Bajza-Terlouw Thanks, it is good to know, I will use AWS instances.

KarenBT · ‎05-23-2023

@Gusti Winata This hackathon is open to everyone, and using the Databricks platform is purely optional and has no bearing on project judgment. Feel free to use any platform to run your training or inference, whether this is on your own environment to a managed service. Thanks for your question!

sanggusti · ‎05-23-2023

If you say so, but can we get any credits for azure/gcp/aws since indexing and embedding is computely heavy?

KarenBT · ‎05-23-2023

As this is an open hackathon, we cannot offer cloud/service credits. As mentioned above, using a cloud/service is not a requirement for participating in this open hackathon. 🙂

kamalds · ‎05-29-2023

Hi Karen @Karen Bajza-Terlouw ,

I have a similar question. Can a databricks account be provided for 1 month access for this hackathon ? Because some LLM's from databricks need the respective compute from databricks too.

Thanks

Kamal

Michelle_-_Devp · ‎05-30-2023

Hi Kamalds, While using Databricks is not necessary and will not impact how your project is reviewed, If you’d like to use Databricks and don’t already have an account, you may create a Databricks Community Edition account to get started. If you need more resources, you may also set up a full-platform Databricks account with the free 14-day trial in the last two weeks of the competition.

Additional resources from the public cloud partners:

https://cloud.google.com/free

https://azure.microsoft.com/en-us/free/

https://aws.amazon.com/free