We want to see where the magic happens! Share a photo of your workspace setup, whether it's your desk, home office, or a cool co-working space. Let’s showcase the environments where you're solving big data challenges! You never know—you might inspire...
What’s your favorite announcement from Databricks summit 2024?
I have a general question regarding how the table in Databricks changes when we change the underlying data file in S3. For example, if I convert multiple folders that are defined by dates in a single folder into parquet by using the following code: C...
Hi, In Databricks, external tables are linked to an existing object store in Unity Catalog by registering their metadata, enabling SQL queries on the data. However, Databricks doesn't automatically track changes or updates made in the external storag...
How to decide when to go for RAG vs CPT? If we go with CPT and if the training documents change, it is okay to take the CPT model and apply RAG on top of it? Will it unlearn previous information?
For large or dynamic knowledge bases RAG is what we have tended to go with. It allows for quite a bit of scalability with little overhead.CPT is good for building foundational knowledge around a subject, your internal industry information for example...
Is there way to apply custom masking to assets shared via delta sharing?
Yes you can apply row and column masking. You can also use clean room.
load cdc data using any integrates into databricks
What’s your first time experience attending DB conference?
Tons of great stuff!
I’m agree!
So many new features and good vendors at Databricks summit!
We're planning our next user group event (target February) - would love to hear from the group on topics you'd like to hear about. Please comment with topic ideas !
I'd love to hear anyone's hands-on experience on setting up unity catalog.
Don't miss it: Great food including Free lard Tamales, Burgers, Rachel's Ginger Beer, Hello Robin cookies, & other great #Seattle local food joints! See details & register here https://www.meetup.com/seattle-spark-meetup/events/298796071/
https://www.meetup.com/seattle-spark-meetup/events/288738839/Last minute post.. While it's not a specific Databricks community meet up, it's still very relevant. If you're able to join, come hang out! THIS Wednesday, October 19, 2022 at 2:00 PM to 4...
