cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Community Articles
Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

(Teaser CHALLENGE - Community Data Pull) - Upcoming Challenge For the Community

BS_THE_ANALYST
Databricks Partner

Hey everybody, 

I've been dying to share this with the community. Over the last few weeks, I've been thinking about how I can do a Data Pull from the Community to highlight some of the cool stuff we all do! ๐Ÿฅณ. Below is a snippet of visual from the Data Pull, I think it's the top 15 people purely based on volume of posts & it's split by discussion board. I'm sure y'all can do a better job at the analysis than me ๐Ÿ˜‚. Remember, there's other ways to highlight who other rockstars in the community are! What about most solutions given? Most questions asked? Most replies? Most likes? ... There's many stories to be told ๐Ÿซก.

BS_THE_ANALYST_0-1759439818993.png

I'm really hoping to get a few things out of this 

  1. The Community, i.e. you guys (me included) try and design either a dashboard or report that highlights loads of cool insights from the data. It could be things like: Solutions by boardFavourite Day of the Week for PostingIdentify most popular day for accepting solutions (Christmas? ๐Ÿค”๐Ÿ˜‚)
  2. We can present our findings to Databricks to get some cool initiatives backed and inspired by the community๐Ÿ‘. These could contribute to regular announcements ๐Ÿ˜Š.
  3. If we could host the dashboard to have it available to filter and interactively play with, that'd be amazing ๐Ÿ˜Ž.

Please Note
I've not set this up as a pipeline and the idea isn't to do so. My hope is that we will have enough data from my pull, I think we have 1000 data points to play with, and we build some really cool stuff from this. We can then present our ideas and get this backed and implemented by Databricks themselves so we don't put strain on the community website ๐Ÿ˜‚

NERDY COOL THING
Yes, I went to the effort to design a delta table for us (below is a snippet of a few columns, note: there are many more ๐Ÿ˜‚๐Ÿคฃ). I've even got Structs if you want to practice playing with different data structures. We have things like Posted Time, is solution, Parent Message, Message Depth. Loads of cool things ๐Ÿ˜€.

BS_THE_ANALYST_2-1759440586037.png

WHEN IS THE CHALLENGE DROPPING?
Challenge isn't live yet so keep your eyes peeled โค๏ธ.

Really hope you enjoy this one, it wasn't as straightforward as it seems ๐Ÿ˜‰.

All the best,
BS

2 REPLIES 2

BS_THE_ANALYST
Databricks Partner

I'll aim to have the data for the challenge sorted and ready for next week! ๐Ÿ‘†๐Ÿซก. I want to strip out some of the columns and figure out where is best to host the data ๐Ÿค”. Potentially I could have it on the Databricks Marketplace or Github.

All the best,
BS

Hi @BS_THE_ANALYST ,

It looks like a really interesting challenge! Iโ€™m not sure if Iโ€™ll be able to participate due to the workload on my projects, but I will definitely follow how it develops.
You can share the data through the marketplace - that will probably be the easiest way and users not familiar with setting up repository can quickly get access to data as well.